Interactive machine learning

ABSTRACT

Perceptual user interfaces (PUIs) are an important part of ubiquitous computing. Creating such interfaces is difficult because of the image and signal processing knowledge required for creating classifiers. We propose an interactive machine-learning (IML) model that allows users to train, classify/view and correct the classifications. The concept and implementation details of IML are discussed and contrasted with classical machine learning models. Evaluations of two algorithms are also presented. We also briefly describe Image Processing with Crayons (Crayons), which is a tool for creating new camera-based interfaces using a simple painting metaphor. The Crayons tool embodies our notions of interactive machine learning

REFERENCES

• 1: Cover, T., and Hart, P. Nearest Neighbor Pattern Classification. IEEE Transactions on Information Theory, 13, (1967) 21--27.
• 2: Richard O. Duda , Peter E. Hart , David G. Stork, Pattern Classification (2nd Edition), Wiley-Interscience, 2000
• 3: Jerry Alan Fails , Dan Olsen Jr., Light widgets: interacting in every-day spaces, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502729]
• 4: Usama M. Fayyad , Keki B. Irani, On the Handling of Continuous-Valued Attributes in Decision Tree Generation, Machine Learning, v.8 n.1, p.87-102, Jan. 1992 [doi>10.1023/A:1022638503176]
• 5: Jaimes, A. and Chang, S.-F. A Conceptual Framework for Indexing Visual Information at Multiple Levels. IS&T/SPIE Internet Imaging 2000, (San Jose CA, January 2000).
• 6: Jaimes, A. and Chang, S.-F. Automatic Selection of Visual Features and Classifier. Storage and Retrieval for Image and Video Databases VIII, IS&T/SPIE (San Jose CA, January 2000).
• 7: Jaimes, A. and Chang, S.-F. Integrating Multiple Classifiers in Visual Object Detectors Learned from User Input. Invited paper, session on Image and Video Databases, 4th Asian Conference on Computer Vision (ACCV 2000), Taipei, Taiwan, January 8-11, 2000.
• 8: Myron W. Krueger , Thomas Gionfriddo , Katrin Hinrichsen, VIDEOPLACE—an artificial reality, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-40, April 1985, San Francisco, California, United States
• 9: Dan R. Olsen, Jr. , Travis Nielsen, Laser pointer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.17-22, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365030]
• 10: J. R. Quinlan, Induction of Decision Trees, Machine Learning, v.1 n.1, p.81-106 [doi>10.1023/A:1022643204877]
• 11: J. Ross Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 12: David E. Rumelhart , Bernard Widrow , Michael A. Lehr, The basic ideas in neural networks, Communications of the ACM, v.37 n.3, p.87-92, March 1994 [doi>10.1145/175247.175256]
• 13: Schmidt, A. Implicit Human Computer Interaction Through Context. Personal Technologies, Vol 4(2), June 2000.
• 14: Maribeth Gandy , Thad Starner , Jake Auxier , Daniel Ashbrook, The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring, Proceedings of the 4th IEEE International Symposium on Wearable Computers, p.87, October 18-21, 2000
• 15: Triggs, B. Model-based Sonar Localisation for Mobile Robots. Intelligent Robotic Systems 93, Zakopane, Poland, 1993.
• 16: John Underkoffler , Hiroshi Ishii, Illuminating light: an optical design tool with a luminous-tangible interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.542-549, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274717]
• 17: John Underkoffler , Brygg Ullmer , Hiroshi Ishii, Emancipated pixels: real-world graphics in the luminous room, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.385-392, July 1999 [doi>10.1145/311535.311593]
• 18: A. Vailaya , Y. Zong , A. K. Jain, A Hierarchical System for Efficient Image Retrieval, Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276, p.356, August 25-29, 1996
• 19: Viola, P. and Jones, M. Robust real-time object detection. Technical Report 2001/01, Compaq CRL, February 2001.
• 20: Yang, M.H. and Ahuja, N. Gaussian Mixture Model for Human Skin Color and Its Application in Image and Video Databases. Proceedings of SPIE 99 (San Jose CA, Jan 1999), 458--466.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

General Terms:
Design, Experimentation

Keywords:
classification, image processing, interaction, machine learning, perceptive user interfaces