Semi-supervised metric learning by maximizing constraint margin

ABSTRACT

Distance metric learning is an old problem that has been researched in the supervised learning field for a very long time. In this paper, we consider the problem of learning a proper distance metric under the guidance of some weak supervisory information. Specifically, those information are in the form of pairwise constraints which specify whether a pair of data points are in the same class (must link constraints) or in the different classes (cannot link constraints). Given those constraints, our algorithm aims to learn a distance metric under which the points with must link constraints are pushed as close as possible, while simultaneously the points with cannot link constraints are pulled away as far as possible. Finally the experimental results are presented to show the effectiveness of our method.

REFERENCES

• 1: C. Blake, E. Keogh, and C. J. Merz, UCI repository of machine learning databases. Department of Information and Computer Science, UC Irvine, 1998.
• 2: Bjornar Larsen , Chinatsu Aone, Fast and effective text mining using linear-time document clustering, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.16-22, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.312186]
• 3: K. Wagstaff, C. Cardie, S. Rogers, and S. Schroedl. knowledge. In proceedings of ICML, 2001.
• 4: F. Wang, C. Zhang. Feature Extraction by Maximizing the Constraint Margin. CVPR 2007.
• 5: K. Q. Weinberger and L. K. Saul. An Introduction to Nonlinear Dimensionality Reduction by Maximum Variance Unfolding.In proceedings of AAAI, 2006.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning
          Subjects: Knowledge acquisition

General Terms:
Algorithms

Keywords:
constraint margin, metric learning