Reach the virtual environment: 3D tangible interaction with scientific data

ABSTRACT

In this paper we present an augmented virtuality system with a set of tangible devices for interactive visualization with scientific data (volumetric scalar field data and molecular data). We describe the design concepts and application scenarios that underlie the development of the interfaces and system. The prototype system allows users to interact with scientific data by manipulating tangible devices, such as a graspable cube, pen and plane frame. These devices provide passive haptic cues that help the user to maintain position awareness and relative spatial relation during three-dimensional (3D) interaction. Active stereoscopic shutter glasses can be used to provide a 3D display, whenever necessary. We describe the differences with traditional fish tank and fully immersive virtual reality (VR) systems. At the end of the paper, we discuss the user experience and the research questions related to VR system with tangible interfaces for visualization application. Our planned activities for obtaining a more in-depth understanding of some of the usability issues involved through user study are described as well.

REFERENCES

• 1: Z. M. Ai and T. Frhlich. (1998). Molecular dynamics simulation in virtual environments. Computer Graph Forum, 17(3): 267--273.
• 2: Doug A. Bowman , Ernst Kruijff , Joseph J. LaViola , Ivan Poupyrev, 3D User Interfaces: Theory and Practice, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 2004
• 3: Frederick P. Brooks, What's Real About Virtual Reality?, IEEE Computer Graphics and Applications, v.19 n.6, p.16-27, November 1999 [doi>10.1109/38.799723]
• 4: Steve Bryson, Virtual reality in scientific visualization, Communications of the ACM, v.39 n.5, p.62-71, May 1996 [doi>10.1145/229459.229467]
• 5: Andries van Dam , Andrew S. Forsberg , David H. Laidlaw , Joseph J. LaViola , Rosemary M. Simpson, Immersive VR for Scientific Visualization: A Progress Report, IEEE Computer Graphics and Applications, v.20 n.6, p.26-52, November 2000 [doi>10.1109/38.888006]
• 6: Edward De Guzman , F. Wai-ling Ho-Ching , Tara Matthews , Tye Rattenbury , Maribeth Back , Steve Harrison, EEWWW!!: tangible interfaces for navigating into the human body, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766003]
• 7: Bernd Fröhlich , John Plate, The cubic mouse: a new device for three-dimensional input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.526-531, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332491]
• 8: A. Fuhrmann, B. Ozer and H. Hauser. (2002). VR2 -interactive volume rendering using pc-based virtual reality. Technical Report TR-VRVis-2002-014 at the VRVis Research Center, Vienna.
• 9: N. Guex and M. Peitsh. (1997). Swiss-model and Swiss-PDB Viewer: an environment for comparative modeling. Electrophoresis, 18: 2714--2723.
• 10: C. Henn, M. Teschner, A. Engel and U. Aebi. (1996). Real-time isocontouring and texture mapping meet new challenges in interactive molecular graphics applications. Journal of Structural Biology, 116:92--96.
• 11: Christopher Johnson , Charles Hansen, Visualization Handbook, Academic Press, Inc., Orlando, FL, 2004
• 12: Ken Hinckley, Haptic issues for virtual manipulation, University of Virginia, Charlottesville, VA, 1997
• 13: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 14: W. Humphrey, A. Dalke and K. Schulten. (1996). "VMD - Visual Molecular Dynamics", J. Molec. Graphics, vol. 14, 33--38.
• 15: Brent Edward Insko , Frederick P. Brooks, Jr., Passive haptics significantly enhances virtual environments, 2001
• 16: C. Johnson, Y. Livnat, L. Zhukov, D. Hart and G. Kindlmann. (2001). Computational field visualization. In Mathematics Unlimited - 2001 and Beyond, 2: 605--630.
• 17: A. C. Limaye and S. R. Gadre. (2001). Univis-2000: An indigenously developed comprehensive visualization package. CURRENT SCIENCE, 80(10):1296--1301.
• 18: Robert W. Lindeman , John L. Sibert , James K. Hahn, Towards usable VR: an empirical study of user interfaces for immersive virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.64-71, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302995]
• 19: Robert van Liere , Jurriaan D. Mulder, Optical Tracking Using Projective Invariant Marker Pattern Properties, Proceedings of the IEEE Virtual Reality 2003, p.191, March 22-26, 2003
• 20: R. Liere and J. Mulder. (2004). Emerging frameworks for tangible user interfaces. In Workshop Beyond Glove and Wand based Interaction, Proceedings of the IEEE Virtual Reality Conference 2004, 126--136.
• 21: Robert van Liere , Arjen van Rhijn, Search space reduction in optical tracking, Proceedings of the workshop on Virtual environments 2003, p.207-214, May 22-23, 2003, Zurich, Switzerland [doi>10.1145/769953.769977]
• 22: P. Milgram, H. Takemura, A. Utsumi and F. Kishino. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems, 12:1321--1329.
• 23: Jean-Bernard Martens , Wen Qi , Dima Aliakseyeu , Arjan J. F. Kok , Robert van Liere, Experiencing 3D interactions in virtual reality and augmented reality, Proceedings of the 2nd European Union symposium on Ambient intelligence, November 08-10, 2004, Eindhoven, Netherlands [doi>10.1145/1031419.1031425]
• 24: Michael Meiβner , Ulrich Hoffmann , Wolfgang Straβer, Enabling Classification and Shading for 3D Texture Mapping Based Volume Rendering, Proceedings of the 10th IEEE Visualization 1999 Conference (VIS '99), October 25-28, 1999
• 25: J. Mulder and R. Van Liere. (2002). The personal space station: Bringing interaction within reach. In Fourth Virtual Reality International Conference, 73--81.
• 26: Wen Qi , Jean-Bernard Martens, Tangible user interfaces for 3D clipping plane interaction with volumetric data: a case study, Proceedings of the 7th international conference on Multimodal interfaces, October 04-06, 2005, Torento, Italy [doi>10.1145/1088463.1088507]
• 27: Steven Schkolne , Hiroshi Ishii , Peter Schroder, Immersive Design of DNA Molecules with a Tangible Interface, Proceedings of the conference on Visualization '04, p.227-234, October 10-15, 2004 [doi>10.1109/VIS.2004.47]
• 28: R. Sayle and E. Milner-White. (1995). Rasmol: biomolecular graphics for all. Trends Biochem Science, 20:374--376.
• 29: D. Schmalstieg, A. Fuhrmann, Z. Szalavari and M. Gervautz. (1998). Studierstube-an environment for collaboration in augmented reality. Virtual Reality -Systems, Development and Applications, 3:37--49.
• 30: Rajeev Sharma , Michael Zeller , Vladimir I. Pavlovic , Thomas S. Huang , Zion Lo , Stephen Chu , Yunxin Zhao , James C. Phillips , Klaus Schulten, Speech/Gesture Interface to a Visual-Computing Environment, IEEE Computer Graphics and Applications, v.20 n.2, p.29-37, March 2000 [doi>10.1109/38.824531]
• 31: Colin Ware , Kevin Arthur , Kellogg S. Booth, Fish tank virtual reality, Proceedings of the SIGCHI conference on Human factors in computing systems, p.37-42, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169066]
• 32: U. Wössner , J. P. Schulze , S. P. Walz , U. Lang, Evaluation of a collaborative volume rendering application in a distributed virtual environment, Proceedings of the workshop on Virtual environments 2002, May 30-31, 2002, Barcelona, Spain
• 33: S. Whittaker, L. Terveen and B. Nardi. (2000). Let's stop pushing the envelope and start addressing it: A reference task agenda for HCI. Human-Computer Interaction, 15(2/3), 75--106.

INDEX TERMS

Keywords:
scientific visualisation, tangible interface, virtual reality