search query: @supervisor Oja, Erkki / total: 113
reference: 2 / 113
« previous | next »
Author:Hazara, Murtaza
Title:Unsupervised methods in multilingual and multimodal semantic modeling
Publication type:Master's thesis
Publication year:2014
Pages:vii + 70 s. + liitt. 30      Language:   eng
Department/School:Perustieteiden korkeakoulu
Main subject:Machine Learning and Data Mining   (SCI3015)
Supervisor:Oja, Erkki
Instructor:Honkela, Timo
Electronic version URL: http://urn.fi/URN:NBN:fi:aalto-201410072760
OEVS:
Electronic archive copy is available via Aalto Thesis Database.
Instructions

Reading digital theses in the closed network of the Aalto University Harald Herlin Learning Centre

In the closed network of Learning Centre you can read digital and digitized theses not available in the open network.

The Learning Centre contact details and opening hours: https://learningcentre.aalto.fi/en/harald-herlin-learning-centre/

You can read theses on the Learning Centre customer computers, which are available on all floors.

Logging on to the customer computers

  • Aalto University staff members log on to the customer computer using the Aalto username and password.
  • Other customers log on using a shared username and password.

Opening a thesis

  • On the desktop of the customer computers, you will find an icon titled:

    Aalto Thesis Database

  • Click on the icon to search for and open the thesis you are looking for from Aaltodoc database. You can find the thesis file by clicking the link on the OEV or OEVS field.

Reading the thesis

  • You can either print the thesis or read it on the customer computer screen.
  • You cannot save the thesis file on a flash drive or email it.
  • You cannot copy text or images from the file.
  • You cannot edit the file.

Printing the thesis

  • You can print the thesis for your personal study or research use.
  • Aalto University students and staff members may print black-and-white prints on the PrintingPoint devices when using the computer with personal Aalto username and password. Color printing is possible using the printer u90203-psc3, which is located near the customer service. Color printing is subject to a charge to Aalto University students and staff members.
  • Other customers can use the printer u90203-psc3. All printing is subject to a charge to non-University members.
Location:P1 Ark Aalto  1741   | Archive
Keywords:symbol grounding
automatic thesaurus extraction
multimodal fusion
hierarchical clustering
Abstract (eng):In the first part of this project, independent component analysis has been applied to extract word clusters from two Farsi corpora.
Both word-document and word-context matrices have been considered to extract such clusters.
The application of ICA on the word-document matrices extracted from these two corpora led to the detection of syntagmatic word clusters, while the utilization of word-context matrix resulted in the extraction of both syntagmatic and paradigmatic word clusters.
Furthermore, we have discussed some potential benefits of this automatically extracted thesaurus.

In such a thesaurus, a word is defined by some other words without being connected to the outer physical objects.
In order to fill such a gap, symbol grounding has been proposed by philosophers as a mechanism which might connect words to their physical referents.
From their point of view, if words are properly connected to their referents, their meaning might be realized.
Once this objective is achieved, a new promising horizon would open in the realm of artificial intelligence.

In the second part of the project, we have offered a simple but novel method for grounding words based on the features coming from the visual modality.
Firstly, indexical grounding is implemented.
In this naïve symbol grounding method, a word is characterized using video indexes as its context.
Secondly, such indexical word vectors have been normalized according to the features calculated for motion videos.
This multimodal fusion has been referred to as the pattern grounding.
In addition, the indexical word vectors have been normalized using some randomly generated data instead of the original motion features.
This third case was called randomized grounding.
These three cases of symbol grounding have been compared in terms of the performance of translation.
Besides that, word clusters have been excerpted by comparing the vector distances and from the dendrograms generated using an agglomerative hierarchical clustering method.

We have observed that pattern grounding exceled the indexical grounding in the translation of the motion annotated words, while randomized grounding has deteriorated the translation significantly.
Moreover, pattern grounding culminated in the formation of clusters in which a word fit semantically to the other members, while using the indexical grounding, some of the closely related words dispersed into arbitrary clusters.
ED:2014-10-05
INSSI record number: 49820
+ add basket
« previous | next »
INSSI