Interacting with reflections in virtual environments

ABSTRACT

Immersive virtual environments require input devices that complement and bolster natural interaction with the virtual content. Such an input device, in addition to it needing to be wireless, should be able to affect multiple degrees of freedom. Computer vision presents a means of creating such a device. However conventional computer vision solutions to 3D tend to be complicated and expensive or inaccurate. We present a single camera approach, "Reflections", which presents a simple and inexpensive way of implementing a three, and more, degree of freedom wireless interaction and tracking device having suitable accuracy. We consider advantages and limitations of this method. We also discuss it's implementation in two applications; firstly a virtual drums application and secondly a virtual reality application, Ndebele painting.

REFERENCES

• 1: Andrew Blake , Michael Isard, 3D position, attitude and shape input using video tracking of hands and lips, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.185-192, July 1994 [doi>10.1145/192161.192197]
• 2: P. Dai. G. Eckel, M. Goebel, F. Hasenbrink, V. Lalioti, U. Lechner, J. Strassner., H. Tramberend., G. Wesche. Virtual Spaces - VR Projection System Technologies and Applications, Tutorial Notes of the 1997 Eurographics Conference, Budapest, 1997.
• 3: William T. Freeman , David B. Anderson , Paul A. Beardsley , Chris N. Dodge , Michal Roth , Craig D. Weissman , William S. Yerazunis , Hiroshi Kage , Kazuo Kyuma , Yasunari Miyake , Ken-ichi Tanaka, Computer Vision for Interactive Computer Graphics, IEEE Computer Graphics and Applications, v.18 n.3, p.42-53, May 1998 [doi>10.1109/38.674971]
• 4: Simon Gibbs, Virtual Studios, IEEE MultiMedia, v.5 n.1, p.17, January 1998 [doi>10.1109/MMUL.1998.664739]
• 5: Vali Lalioti , Andries Malan , James Pun , Juergen Wind, Ndebele Painting in VR, IEEE Computer Graphics and Applications, v.21 n.2, p.10-13, March 2001 [doi>10.1109/38.909010]
• 6: J. Lane. Virtual Drums, South African Institute of Computer Scientists and Information Technologies, Annual Research Conference, SAICSIT2000, South Africa, Cape Town, 1-3 November 2000.
• 7: Bastian Leibe , Thad Starner , William Ribarsky , Zachary Wartell , David Krum , Justin Weeks , Bradley Singletary , Larry Hodges, Toward Spontaneous Interaction with the Perceptive Workbench, IEEE Computer Graphics and Applications, v.20 n.6, p.54-65, November 2000 [doi>10.1109/38.888008]
• 8: Nobuyuki Matsushita , Jun Rekimoto, HoloWall: designing a finger, hand, body, and object sensitive wall, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.209-210, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263549]
• 9: Jakub Segen , Senthil Kumar, Look ma, no mouse!, Communications of the ACM, v.43 n.7, p.102-109, July 2000 [doi>10.1145/341852.341869]
• 10: Joshua Smith , Tom White , Christopher Dodge , Joseph Paradiso , Neil Gershenfeld , David Allport, Electric Field Sensing For Graphical Interfaces, IEEE Computer Graphics and Applications, v.18 n.3, p.54-60, May 1998 [doi>10.1109/38.674972]
• 11: Henrik Tramberend, Avocado: A Distributed Virtual Reality Framework, Proceedings of the IEEE Virtual Reality, p.14, March 13-17, 1999
• 12: Efraim Turban , Louis E. Frenzel, Expert Systems and Applied Artificial Intelligence, Prentice Hall Professional Technical Reference, 1992
• 13: John Underkoffler , Brygg Ullmer , Hiroshi Ishii, Emancipated pixels: real-world graphics in the luminous room, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.385-392, July 1999 [doi>10.1145/311535.311593]
• 14: F.vd Bergh and V. Lalioti. Software Chroma-keying in Immersive Virtual Environments, Computer Science and Information Systems, South African Computer Journal, no. 24, November 1999.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.1 Hardware architecture
          Subjects: Input devices
      I.3.8 Applications
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Computer vision

General Terms:
Algorithms, Performance

Keywords:
Camera calibration, Input devices, Input/Output Devices, Scene Analysis, Virtual reality