Smart Media Based Recommendation System
Abstract
Smart media devices such as: smartphones and tablets are getting more powerful, smarter, cheaper and hence more popular. Recommendation systems become very common in e-business and e-Commerce, for example:
Amazon, Google, eBay, Facebook, etc. all are using recommendation systems to promote their business. Recommendation systems are rarely used in learning; however it can be very useful. The proposed project works as follow:
Send a learning query to sites, sources and repositories across the Web and gather relevant information through the use of recommendation system that filter all the useless or irrelevant materials off the main list of recommended items.
Filter result from other user’s preference using collaborative-filtering, having the current query in mind.
Use TFIDF for content-based filtering and ranking of the shortlisted pages or articles. Present the shortlist based on their rank to the user of the system. Chapter one of A Smart Media Based Recommendation System
1. Introduction
With the growth of the web, there is an explosion in the size of content available to various users around the world. The materials available are a mixture of useful and useless documents to the interest of the user.
This show gives the need for a better way of getting useful document from the web and mostly through the taste of the user of the web. This project aims at using the taste and the behavior of a user to get documents that are relevant to what the user needs.
Depending on the choices of the user, they may have people with the same taste as them, and the system is to harness this opportunity and recommend materials, based on interaction of the neighbor of the users with other interesting materials.
Using a collaborative filtering approach, the system can find the items (document) that other users with similar interest with the current user have read and rated to a good degree. In the early stages of the system’s life, the system can’t depend on the Collaborative approach alone, or else the system’s recommendation will be inadequate, thus prompting the need for another filtering approach to support the weaknesses of the collaborative approach.
The most use filtering approach that has been used with the collaborative filtering approach is the “Content-based filtering” approach. Adding a content-based filter to the result of the collaborative will yield a more concrete recommendation that will be close to what the user requires.
1.1. Context
Recently Recommendation Systems are becoming common and important in e-technologies such as e-business and e-learning. Many major companies such as Amazon, Google, etc. have its own recommendation system. Recommendation systems can help customers to pick up the most relevant products that fit with their needs.
In the area of e-learning and learning in general, there is no much research have been done to design and build a reliable recommendation system that can help learners to pick up the most relevant materials that can speed up and enhance their learning process.
In this project we plan to design and implement a learning recommendation system, which supports smart media such as smartphone and tablets, as its clients. To achieve this, the system needs to be hosted probably on a remote server with the capability to run codes efficiently, and optimally.
A server side will be written in Java Servlets in order to be7 | M S c . C o m p u t e r S c i e n c e A U S T 2 0 1 3 / 2 0 1 4able to use various libraries available. All communication will be across a network and the source data will be from the internet.
1.2. Problem Statement
In the digital world today, the amount of content finding their way to the internet, has become alarming in the rate of increase, and this has led to an increase in the scrutiny of this content by search engines and other pointer-sites. It is now glaring that there is a need to provide a personal touch to the recommendation of materials to users.
If a form of recommendation can be added to the search result of user’s, then the probability of them getting more interesting materials will become high. Take for example, a school with lots of materials in their repository, which offers the students or the public access to their wealth of content, but the only provide a generic search.
If there is a way of finding the articles or papers of interest, and at the same time finding materials with similar relevant content, based on the content similarities and the people who previously viewed and rated the materials, thus saving the next person the trouble of viewing irrelevant materials.
1.3. Research Objective
In this research, the aim is to aid common search with the help of filtering techniques, in order to improve the quality of materials recommended to people or users of the system. Due to the fact that finding material for research and study may be hard to get on the web, a user might search with a search engine for materials and information, and the user may or may
not get the result he/she seek from the first search engine, and he/she may try the second, third, fourth etc. this process of searching numerous places for information may be time consuming and tedious.
Then a system that searches more than one place will surely be better. We aim to provide a multi-platform search that is based on hybrid filtering, in order to provide the user with a result that is close to what the user wants or needs.
The normal search (e.g. Google) also does its filtering, but we aim to join the result from different sites and repositories, giving users a list that is more scrutinized than the result presented by a singular website or service.8 | M S c . C o m p u t e r S c i e n c e A U S T 2 0 1 3 / 2 0 1 4
With the help of a user’s preference and the help of the characteristic of users with the same preference as the current user, our system will be able to provide a better result-set for the user of the system.
Let us consider a university of library reach in materials, and there is a way of searching for materials, the system will be able to provide good search based on the title of the material or even the some part of the content might be taking into consideration.
This project not only emphasizes on the approach that will be adopted in the implementation, but it depends on the creativity of future developers to enhance the application, and use it for more advanced reasons. We aim to show how relevant the content-based and collaborative filtering algorithms are in the recommendation of materials based on the current query of a user.
1.4. Research Methodology
The approaches to be adopted in this project are:
1.4.1. Information gathering
This is where we source the internet for information, primarily using search engines to gather information, and using a tool to search the DOM for links (The Document Object Model (DOM) is an application programming interface (API) for HTML and XML documents.
It defines the logical structure of documents and the way a document is accessed and manipulated [13]).When the list from different sources have been obtained, then they will be combined to form a single list without duplicates.
This list will be sent to the collaborative filter before it’s sent to the content-based filter.The list mentioned above is a database table with fields of ID, TITLE, URL, BODY, and SCORE. When the list gathered, then the system using JSoup, the system will get for all the URLs, the title of the page, the content of the pages
(i.e. the texts inside the body of the page), and saves the URL also in the URL field. This table is used exclusively by the current user in order to avoid inconsistency in the recommendation.
1.4.2. Collaborative Filtering
Sometimes called social filtering, it is a filtering technique that uses the relationship between peer users with similar rating history, to generate recommendations using the neighborhood [19].9 | M S c . C o m p u t e r S c i e n c e A U S T 2 0 1 3 / 2 0 1 4With this filtering process, the system makes recommendations based on the whether the URLs in the list fetched from the internet have been rated before, for every URL in the list that has been rated a recommendation (finding URLs/items similar to the current one) for extra URLs are made by the system, and they are added to the list of URLs.
1.4.3. Content-based filtering
The system generates recommendations from two sources: product features, and user-ratings. Content-based recommenders treat recommendation as a user-specific classification problem and learn a classifier for the user’s likes and dislikes based on product features [19]
.With this process, I intend to rank documents in relation to their weight for a group of terms in a query. For each term, a document has a weight, and depending on the number of terms in a query, a documents has a combined weight.
This combine-weight will be used to rank the documents in the temporary-corpus.1.4.4. Hybridization of Both filtering methods The combination of two different filtering approaches together to create a new system that is better than any individual filter. Using a hybrid will help to overcome the flaws of a single filter-system.
In this case, after the collaborative filter has finished recommending and adding its recommendation to the list, the list is sent to the content-based filter to undergo filtering again, thus creating a rank that brings the important documents to the top, and leaving the less-relevant ones at the bottom.
1.4.5. Connecting of the Android application to the Server through HTTP protocol The project client is primarily an android program that queries the system to get some results proposed by the system.
So the mobile app needs to communicate with the server in some way, and Android can communicate with remote web servers via a network with the Hypertext Transfer Protocol (HTTP).To leverage the power of Java, I decided to use the Java-Servlet to run the request sent by the Android application.
Different packages have been created to accommodate the various techniques to be used by the system, even the use of Java external libraries like Apache Mahout [4], JSoup, JDBC-MySQL connector etc.10 | M S c . C o m p u t e r S c i e n c e A U S T 2 0 1 3 / 2 0 1 4Figure 1 Structure of the recommendation process1.5. Organization of document
The organization of this document is as follows: Chapter 2, Shows a detailed review of the techniques and theory used in this thesis. Chapter 3, Shows the processes of the implemented software for our case-study. Chapter 4, is the conclusion that shows the work done in the cause of the project, and the limitation of the application and proposed methods in the use-case.
Do You Have New or Fresh Topic? Send Us Your Topic
INSTRUCTIONS AFTER PAYMENT
- 1.Your Full name
- 2. Your Active Email Address
- 3. Your Phone Number
- 4. Amount Paid
- 5. Project Topic
- 6. Location you made payment from