WUW - wear Ur world: a wearable gestural interface

ABSTRACT

Information is traditionally confined to paper or digitally to a screen. In this paper, we introduce WUW, a wearable gestural interface, which attempts to bring information out into the tangible world. By using a tiny projector and a camera mounted on a hat or coupled in a pendant like wearable device, WUW sees what the user sees and visually augments surfaces or physical objects the user is interacting with. WUW projects information onto surfaces, walls, and physical objects around us, and lets the user interact with the projected information through natural hand gestures, arm movements or interaction with the object itself.

REFERENCES

• 1: Agarwal, A., Izadi, S., Chandraker, M. and Blake, A. High precision multi-touch sensing on surfaces using overhead cameras. IEEE International Workshop on Horizontal Interactive Human-Computer System, 2007.
• 2: Apple iPhone. http://www.apple.com/iphone.
• 3: Ronald Azuma , Yohan Baillot , Reinhold Behringer , Steven Feiner , Simon Julier , Blair MacIntyre, Recent Advances in Augmented Reality, IEEE Computer Graphics and Applications, v.21 n.6, p.34-47, November 2001 [doi>10.1109/38.963459]
• 4: Buxton, B. Multi-touch systems that i have known and loved. http://www.billbuxton.com/multitouchOverview.html.
• 5: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 6: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 7: Julien Letessier , François Bérard, Visual tracking of bare fingers for interactive surfaces, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029652]
• 8: LM3LABS Ubiq'window. http://www.ubiqwindow.jp
• 9: Shahzad Malik , Joe Laszlo, Visual touchpad: a two-handed gestural input device, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027980]
• 10: Nobuyuki Matsushita , Jun Rekimoto, HoloWall: designing a finger, hand, body, and object sensitive wall, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.209-210, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263549]
• 11: Microsoft Surface. http://www.surface.com
• 12: Oblong G-speak. http://www.oblong.com
• 13: Perceptive Pixel. http://www.perceptivepixel.com
• 14: Claudio S. Pinhanez, The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces, Proceedings of the 3rd international conference on Ubiquitous Computing, p.315-331, September 30-October 02, 2001, Atlanta, Georgia, USA
• 15: Ramesh Raskar , Jeroen van Baar , Paul Beardsley , Thomas Willwacher , Srinivas Rao , Clifton Forlines, iLamps: geometrically aware and self-configuring projectors, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 16: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 17: Segen, J. and Kumar, S. Shadow Gestures: 3D Hand Pose Estimation Using a Single Camera. In Proc. CVPR1999, (1999), 479--485.
• 18: Thad Starner , Joshua Weaver , Alex Pentland, A Wearable Computer Based American Sign Language Recognizer, Proceedings of the 1st IEEE International Symposium on Wearable Computers, p.130, October 13-14, 1997
• 19: Maribeth Gandy , Thad Starner , Jake Auxier , Daniel Ashbrook, The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring, Proceedings of the 4th IEEE International Symposium on Wearable Computers, p.87, October 18-21, 2000
• 20: Norimichi Ukita , Masatsugu Kidode, Wearable virtual tablet: fingertip drawing on a portable plane-object using an active-infrared camera, Proceedings of the 9th international conference on Intelligent user interfaces, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964475]
• 21: Andrew D. Wilson, PlayAnywhere: a compact interactive tabletop projection-vision system, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095047]
• 22: Andrew D. Wilson, TouchLight: an imaging touch screen and display for gesture-based interaction, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027946]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI); Natural language; Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design

Keywords:
augmented reality, gestural interaction, object augmentation, tangible computing, wearable interface