Aikaterini Aretaki

MSc Semester Project

Title

Mobile applications for object duplicate detection

Candidate

Aikaterini Aretaki

Supervisor

Prof. Dr. Touradj Ebrahimi
Assistant: Peter Vajda

Expected

June 10, 2011

Place

EPFL

Description

Mobile image search and retrieval has become increasingly popular among researchers in recent years. Some prototype applications have been developed in order to study different aspects of mobile image search. Besides these scientific prototypes, commercial applications and services have been developed, such as Kooaba, Google Goggles, and Snaptell.

One of the challenges in mobile visual search is reliable and efficient identification of 3D as opposed to planar objects. Most state of the art techniques in visual search assume that a 2D projection of the 3D query object does not much affect its performance. A demonstrator for reliable 3D object duplicate detection has been developed for mobile phones in Multimedia Signal Processing Group of EPFL.

In this semester project, the student will develop museum and tourist guide applications on mobile phones based on previously designed object duplicate detection algorithms. This project contains the following tasks:

  • Design an intuitive tourist guide application for mobile phone. This application provides automatically audio and visual information of landmarks near user’s location.

  • Develop and implement a tourist guide application on Android mobile phone, using the QWiki application for landmark guide and Wikipedia search with geographic information.

  • Analyse and evaluate the tourist guide application by means of a demonstration.

  • Design a museum guide application. The visitor uses his/her mobile phone to take a picture of an artifact in the museum. Then the mobile phone sends this information to a server that applies visual object recognition by searching visual content in an image database. These images are associated with audio, textual and video information, which is automatically shown to the visitor when the matched object is found. Through this application additional information can be added to the audio guide.

  • The student will contact a major museum in Lausanne to ask for audio, textual and video information for research purpose.

  • Develop a museum guide application on Android mobile phone using external server for image search.

  • The student will demonstrate this application on a real case scenario on selected artifacts in the museum.

  • The student will evaluate the system on selected artifacts from the above mentioned museum.