Transparent 2-D markers on an LCD tabletop system

ABSTRACT

Tabletop systems are currently being focused on and many applications using these systems are being developed. In such tabletop systems, how to recognize real objects on the table is an essential and important issue. In existing tabletop systems, 2-D markers have been often used. However, their black-and-white pattern, which means nothing to humans, spoils the appearance of the object. We developed transparent markers on a liquid crystal display (LCD) tabletop system by using the polarization features of the LCD and optical lms. In particular, through experiments with various kinds of optical films, we found that two halfwave plates make the markers rotation invariant. By using the transparent markers, tangible transparent Magic Lenses(TM) applications were developed.

REFERENCES

• 1: Toshifumi Arai , Kimiyoshi Machii , Soshiro Kuzunuki, Retrieving electronic documents with real-world objects on InteractiveDESK, Proceedings of the 8th annual ACM symposium on User interface and software technology, p.37-38, November 15-17, 1995, Pittsburgh, Pennsylvania, United States [doi>10.1145/215585.215642]
• 2: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, August 02-06, 1993, Anaheim, CA [doi>10.1145/166117.166126]
• 3: Mark Billinghurst , Raphael Grasset , Julian Looser, Designing augmented reality interfaces, ACM SIGGRAPH Computer Graphics, v.39 n.1, February 2005 [doi>10.1145/1057792.1057803]
• 4: Denso Corp. QR Code. http://http://en.wikipedia.org/wiki/QR Code.
• 5: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 6: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 7: Steve Hodges , Shahram Izadi , Alex Butler , Alban Rrustemi , Bill Buxton, ThinSight: versatile multi-touch sensing for thin form-factor displays, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294258]
• 8: Shahram Izadi , Steve Hodges , Stuart Taylor , Dan Rosenfeld , Nicolas Villar , Alex Butler , Jonathan Westhues, Going beyond the display: a surface technology with an electronically switchable diffuser, Proceedings of the 21st annual ACM symposium on User interface software and technology, October 19-22, 2008, Monterey, CA, USA [doi>10.1145/1449715.1449760]
• 9: Yasuaki Kakehi , Takero Hosomi , Makoto Iida , Takeshi Naemura , Mitsunori Matsushita, Transparent Tabletop Interface for Multiple Users on Lumisight Table, Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems, p.143-150, January 05-07, 2006 [doi>10.1109/TABLETOP.2006.34]
• 10: Y. Kakehi and T. Naemura. Ulteriorscape: Interactive optical superimposing on view-dependent tabletop display. In Proc. of 3rd IEEE Intl. Workshop on Horizontal Interactive Human Computer Systems (TABLETOP 2008), pages 189--192. IEEE, 2008.
• 11: Martin Kaltenbrunner , Ross Bencina, reacTIVision: a computer-vision framework for table-based tangible interaction, Proceedings of the 1st international conference on Tangible and embedded interaction, February 15-17, 2007, Baton Rouge, Louisiana [doi>10.1145/1226969.1226983]
• 12: Hirokazu Kato , Mark Billinghurst, Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System, Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, p.85, October 20-21, 1999
• 13: Hideki Koike , Yoichi Sato , Yoshinori Kobayashi , Hiroaki Tobita , Motoki Kobayashi, Interactive textbook and interactive Venn diagram: natural and intuitive interfaces on augmented desk system, Proceedings of the SIGCHI conference on Human factors in computing systems, p.121-128, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332415]
• 14: M. Krueger. Artificial Reality. Addison-Wesley, 2nd edition, 1991.
• 15: Julian Looser , Raphael Grasset , Mark Billinghurst, A 3D Flexible and Tangible Magic Lens in Augmented Reality, Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, p.1-4, November 13-16, 2007 [doi>10.1109/ISMAR.2007.4538825]
• 16: Nobuyuki Matsushita , Jun Rekimoto, HoloWall: designing a finger, hand, body, and object sensitive wall, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.209-210, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263549]
• 17: Microsoft. Microsoft surface. http://surface.microsoft.com.
• 18: T. Nishi, Y. Sato, and H. Koike. SnapLink: Interactive object registration and recognition for augmented desk interface. In Proceedings of IFIP International Conference on Human-Computer Interaction (INTERACT'01), pages 240--246. IOS Press, 2001.
• 19: Kenji Oka , Yoichi Sato , Hideki Koike, Real-Time Fingertip Tracking and Gesture Recognition, IEEE Computer Graphics and Applications, v.22 n.6, p.64-71, November 2002 [doi>10.1109/MCG.2002.1046630]
• 20: Open Source Computer Vision Library. http://www.intel.com/technology/computing/opencv/.
• 21: Hanhoon Park , Jong-Il Park, Invisible Marker Tracking for AR, Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality, p.272-273, November 02-05, 2004 [doi>10.1109/ISMAR.2004.37]
• 22: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 23: Jun Rekimoto , Katashi Nagao, The world through the computer: computer augmented interaction with real world environments, Proceedings of the 8th annual ACM symposium on User interface and software technology, p.29-36, November 15-17, 1995, Pittsburgh, Pennsylvania, United States [doi>10.1145/215585.215639]
• 24: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 25: P. Robinson. Animated paper documents. In Proceedings of HCI'97(21B), pages 655--658, 1997.
• 26: T. Sato, K. Fukuchi, and H. Koike. Camera-based flicking gesture recognition and game applications. In Adjunct proceedings of ACM UIST '06 User Interface Software and technology (demonstration paper), pages 73--74, 2006.
• 27: SDL: Simple Directmedia Layer. http://www.libsdl.org/.
• 28: Y. Shirai, M. Matsushita, and T. Ohguro. HIEI Projector: Augmenting a real environment with invisible information. In The 11th Workshop on Interactive Systems and Software (WISS2003), in Japanese, pages 115--122, 2003.
• 29: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 30: Manuela Waldner , Jörg Hauber , Jürgen Zauner , Michael Haller , Mark Billinghurst, Tangible tiles: design and evaluation of a tangible user interface in a collaborative tabletop setup, Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments, November 20-24, 2006, Sydney, Australia [doi>10.1145/1228175.1228203]
• 31: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]
• 32: Andrew D. Wilson, PlayAnywhere: a compact interactive tabletop projection-vision system, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095047]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

General Terms:
Human Factors

Keywords:
LCD, augmented reality, magic lenses, marker, polarization, tabletop, tangible user interface, vision-based HCI