Author:Kozma, László
Title:A Proactive Interface for Image Retrieval
Publication type:Master's thesis
Publication year:2009
Pages:xxx + xx      Language:   eng
Department/School:Tietotekniikan laitos
Main subject:Informaatiotekniikka   (T-61)
Supervisor:Kaski, Samuel
Instructor:Klami, Arto
OEVS:
Electronic archive copy is available via Aalto Thesis Database.
Instructions

Reading digital theses in the closed network of the Aalto University Harald Herlin Learning Centre

In the closed network of Learning Centre you can read digital and digitized theses not available in the open network.

The Learning Centre contact details and opening hours: https://learningcentre.aalto.fi/en/harald-herlin-learning-centre/

You can read theses on the Learning Centre customer computers, which are available on all floors.

Logging on to the customer computers

  • Aalto University staff members log on to the customer computer using the Aalto username and password.
  • Other customers log on using a shared username and password.

Opening a thesis

  • On the desktop of the customer computers, you will find an icon titled:

    Aalto Thesis Database

  • Click on the icon to search for and open the thesis you are looking for from Aaltodoc database. You can find the thesis file by clicking the link on the OEV or OEVS field.

Reading the thesis

  • You can either print the thesis or read it on the customer computer screen.
  • You cannot save the thesis file on a flash drive or email it.
  • You cannot copy text or images from the file.
  • You cannot edit the file.

Printing the thesis

  • You can print the thesis for your personal study or research use.
  • Aalto University students and staff members may print black-and-white prints on the PrintingPoint devices when using the computer with personal Aalto username and password. Color printing is possible using the printer u90203-psc3, which is located near the customer service. Color printing is subject to a charge to Aalto University students and staff members.
  • Other customers can use the printer u90203-psc3. All printing is subject to a charge to non-University members.
Location:P1 Ark Aalto  5317   | Archive
Keywords:eye movements
proactive interfaces
image retrieval
implicit feedback
Abstract (eng): This thesis studies interfaces for browsing and searching for images.
A novel gaze-based interface was developed which attempts to tailor the set of available choices according to the interest of the user.
The system is integrated with PicSOM, a content-based image retrieval engine and is able to interact with various eye tracking devices.
It can be used in online exploration of large image databases.

Users interact with the system through a zooming interface inspired by the concept of infinite-desktops and Dasher, a tool for predictive text entry.
The system computes on-line predictions of relevance of images based on implicit feedback, and when the user zooms in, the images predicted to be the most relevant are brought out.
The key novelty is that the relevance feedback is inferred from implicit cues obtained in real-time from the gaze pattern, using an estimator learned during a separate training phase.
It is found that there is sufficient amount of information in the gaze patterns to make the estimated relevance feedback a viable choice to complement or ultimately even replace explicit feedback by pointing-and-clicking, although the accuracy is not as good as with explicit feedback.
The reliability of the relevance prediction is evaluated first as a stand-alone module, then in integration with the full system.
For this purpose we carried out eye tracking experiments with test subjects using our software.

The thesis describes the design and implementation of the image navigation system, and an evaluation of its performance.
In addition, alternative approaches were explored.
A simpler variant of the interface uses clicking or explicit selection with eye movements as feedback.
An interface using a static collage-view has also been developed.
ED:2009-07-15
INSSI record number: 38074
+ add basket
INSSI