Loading...

Multi-modal distance metric learning: A bayesian non-parametric approach

Babagholami Mohamadabadi, B ; Sharif University of Technology | 2015

706 Viewed
  1. Type of Document: Article
  2. DOI: 10.1007/978-3-319-16199-0_5
  3. Publisher: Springer Verlag , 2015
  4. Abstract:
  5. In many real-world applications (e.g. social media application), data usually consists of diverse input modalities that originates from various heterogeneous sources. Learning a similarity measure for such data is of great importance for vast number of applications such as classification, clustering, retrieval, etc. Defining an appropriate distance metric between data points with multiple modalities is a key challenge that has a great impact on the performance of many multimedia applications. Existing approaches for multi-modal distance metric learning only offer point estimation of the distance matrix and/or latent features, and can therefore be unreliable when the number of training examples is small. In this paper we present a novel Bayesian framework for learning distance functions on multi-modal data through Beta Process, by which we embed data of different modalities into a single latent space. Moreover, using the flexible Beta process model, we can infer the dimensionality of the hidden space using training data itself. We also develop a novel Variational Bayes (VB) algorithm to compute the posterior distribution of the parameters that imposes the constraints (similarity/dissimilarity constraints) directly on the posterior distribution. We apply our framework to text/image data and present empirical results on retrieval and classification to demonstrate the effectiveness of the proposed model
  6. Keywords:
  7. Modal analysis ; Text processing ; Beta process ; Gibbs sampling ; Metric learning ; Multi-modal data ; Variational inference ; Computer vision
  8. Source: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6 September 2014 through 12 September 2014 ; Volume 8927 , September , 2015 , Pages 63-77 ; 03029743 (ISSN) ; 9783319161983 (ISBN)
  9. URL: http://link.springer.com/chapter/10.1007%2F978-3-319-16199-0_5