Tracking users through a projection screen

ABSTRACT

Smart walls, interactive displays, and immersive projection dis are increasingly used in visualization and multimedia system. Tracking the user is one key element to implement inter, or e.g., to render new views according to the viewer's position to creat virtual reality-type displays. Persons viewing traditional screens or virtual reality rooms (CAVE) can be track with elec, optical, or many other tracking methods. If optica or computer vision track is used, then line of sight between the cameras and the tracked object is required. Opaque projection screens severely restrict the possibl camera setup, especially in CAVE-like environments.We present a novel, patented method to track users in three di through a projection screen. Our novel idea is to emplo a screen material that is opaque in the visible spectrum, and trans in the near-infrared (IR) spec, and then to use com vision -based or other optical tracking method to track the viewer in infrared spectrum. Non-solid screens like the FogScree seem to be one screen material that can deliver our objective, but also solid screens may be possible.

REFERENCES

• 1: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, ACM SIGGRAPH Computer Graphics, v.14 n.3, p.262-270, July 1980
• 2: DiVerdi, S., Rakkolainen, I., Höllerer, T., Olwal, A., A Novel Walk-through 3D Display. SPIE Electronic Imaging, Stereoscopic Displays and Applications XVII, San Jose, CA, USA, January 15-18, 2006.
• 3: dnp Holo Screen. DNP, http://www.dnp.dk/. May 2006.
• 4: FogScreen display. FogScreen Inc., http://www.fogscreen.com, May 2006.
• 5: Myron W. Krueger , Thomas Gionfriddo , Katrin Hinrichsen, VIDEOPLACE—an artificial reality, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-40, April 1985, San Francisco, California, United States
• 6: Bastian Leibe , Thad Starner , William Ribarsky , Zachary Wartell , David Krum , Brad Singletary , Larry Hodges, The Perceptive Workbench: Toward Spontaneous and Natural Interaction in Semi-Immersive Virtual Environments, Proceedings of the IEEE Virtual Reality 2000 Conference, p.13, March 18-22, 2000
• 7: Precision position tracker. WorldViz, http://www.worldviz.com/, May 2006.
• 8: Rakkolainen, I. Palovuori, K., A Walk-thru Screen. IS&T / SPIE Electronic Imaging 2002, Proceedings of Conference on Projection Displays VIII, San Jose, CA, USA, January 23-24, 2002. 17--22.
• 9: Rakkolainen, I., Method and apparatus for tracking through a projection screen. Patent application FIN-20020489. Accepted.
• 10: Rakkolainen, I., Palovuori, K., FogScreen - An Immaterial, Interactive Screen. Society for Information Displays (SID 2005) Invited paper. Boston, MA, USA, May 22-27, 2005.
• 11: Ismo Rakkolainen , Jan Landkammer , Markku Laitinen , Mika Piirto , Karri Palovuori, The interactive FogScreen, ACM SIGGRAPH 2005 Emerging technologies, July 31-August 04, 2005, Los Angeles, California [doi>10.1145/1187297.1187306]
• 12: Ismo Rakkolainen , Karri Palovuori, Laser scanning for the interactive walk-through fogScreen, Proceedings of the ACM symposium on Virtual reality software and technology, November 07-09, 2005, Monterey, CA, USA [doi>10.1145/1101616.1101661]
• 13: Rekimoto, J., Matsushita, N., Perceptual Surfaces: Towards a Human and Object Sensitive Interactive Display. In Worksho on Perceptual User Interfaces (PUI'97), October 1997, pp. 30--32.
• 14: Richards, A., Alien Vision: Exploring the Electromagnetic Spectrum with Imaging Technology. SPIE Press, Bellingham, WA, USA, 2001.
• 15: Meredith Ringel , Henry Berg , Yuhui Jin , Terry Winograd, Barehands: implement-free interaction with a wall-mounted display, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634284]
• 16: Smart-Nav EG hands free mouse. Eye control technologies Inc., http://www.naturalpoint.com/, May 2006.
• 17: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Experimentation, Human Factors, Measurement

Keywords:
computer vision, fogScreen, interaction, tracking