Mixed interaction space: designing for camera based interaction with mobile devices

ABSTRACT

In mobile devices, such as mobile phones and PDAs, an integrated camera can be used to interact with the device in new ways. In this paper we introduce the term mixed interaction space and argue that the possibility of using mixed interaction spaces is what distinguishes camera-based interaction from other types of sensor-based interaction on mobile devices. We present our implemented applications, and related work that use mixed interaction spaces. Based on this we address how mixed interaction spaces can have different identities, be mapped to applications, and how it can be visualized.

REFERENCES

• 1: Victoria Bellotti , Maribeth Back , W. Keith Edwards , Rebecca E. Grinter , Austin Henderson , Cristina Lopes, Making sense of sensing systems: five questions for designers and researchers, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503450]
• 2: BlipNodes. http://www.blipsystems.com/
• 3: Chalmers, M., MacColl, I., Seamful and Seamless Design in Ubiquitous Computing, Technical Report Equator-03-005, 2004.
• 4: Kevin Christian , Bill Kules , Ben Shneiderman , Adel Youssef, A comparison of voice controlled and mouse controlled web browsing, Proceedings of the fourth international ACM conference on Assistive technologies, p.72-79, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354345]
• 5: Greenberg, S., Boyle, M., Customizable Physical Interfaces for Interacting with Conventional Applications. In CHI Letters, 4, 2(2002), 31--40.
• 6: Beverly L. Harrison , Kenneth P. Fishkin , Anuj Gujar , Carlos Mochon , Roy Want, Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.17-24, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274647]
• 7: Masui, T., Tsukada, K., Siio, I. MouseField: A Simple and Versatile Input Device for Ubiquitous Computing, In Proceedings of UbiCom2004, Springer (2004), 319--328.
• 8: Norman, D. The Design of Everyday Things, Doubleday, New York, (1999), p 23.
• 9: Kasim Rehman , Frank Stajano , George Coulouris, Interfacing with the invisible computer, Proceedings of the second Nordic conference on Human-computer interaction, October 19-23, 2002, Aarhus, Denmark [doi>10.1145/572020.572048]
• 10: Rohs, M., Real-World Interaction with Camera-Phones, 2nd International Symposium on Ubiquitous Computing Systems (UCS 2004), 2004.
• 11: Ben Shneiderman, Designing the user interface (videotape), University of Maryland at College Park, College Park, MD, 1987
• 12: SemaCode. http://semacode.org/
• 13: SpotCode. http://www.highenergymagic.com/spotcode/
• 14: Roy Want , Kenneth P. Fishkin , Anuj Gujar , Beverly L. Harrison, Bridging physical and virtual worlds with electronic tags, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.370-377, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303111]
• 15: L. Xu , E. Oja , P. Kultanen, A new curve detection method: randomized Hough transform (RHT), Pattern Recognition Letters, v.11 n.5, p.331-338, May. 1990 [doi>10.1016/0167-8655(90)90042-Z]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O; Graphical user interfaces (GUI)

Keywords:
augmented reality, input and interaction technologies, interaction design, tangible UI