Combining 3-D geovisualization with force feedback driven user interaction

ABSTRACT

We describe a prototype software system for investigating novel human-computer interaction techniques for 3-D geospatial data. This system, M4-Geo (Multi-Modal Mesh Manipulation of Geospatial data), aims to provide a more intuitive interface for directly manipulating 3-D surface data, such as digital terrain models (DTM). The M4-Geo system takes place within a 3-D environment and uses a Phantom haptic force feedback device to enhance 3-D computer graphics with touch-based interactions. The Phantom uses a 3-D force feedback stylus, which acts as a virtual "finger tip" that allows the user to feel the shape (morphology) of the terrain's surface in great detail. In addition, it acts as a touch sensitive tool for different GIS tasks, such as digitizing (draping) of lines and polygons directly onto a 3-D surface and directly deforming surfaces (by pushing or pulling the stylus in or out). The user may adjust the properties of the surface deformation (e.g., soft or hard) locally by painting it with a special "material color."

The overlap of visual and force representation of 3-D data aides hand-eye coordination for these tasks and helps the user to perceive the 3-D spatial data in a more holistic, multi-sensory way. The use of such a 3-D force feedback device for direct interaction may thus provide more intuitive and efficient alternatives to the mouse and keyboards driven interactions common today, in particular in areas related to digital landscape design, surface hydrology and geotechnical engineering.

REFERENCES

• 1: Atlan, S, and M Garland. Interactive Multiresolution Editing and Display of Large Terrains (2006) Computer Graphics Forum 25.2, p. 211--23.
• 2: Doug A. Bowman , Ernst Kruijff , Joseph J. LaViola , Ivan Poupyrev, An Introduction to 3-D User Interface Design, Presence: Teleoperators and Virtual Environments, v.10 n.1, p.96-108, February 2001 [doi>10.1162/105474601750182342]
• 3: Gerwin de Haan , Michal Koutek , Frits H. Post, Towards intuitive exploration tools for data visualization in VR, Proceedings of the ACM symposium on Virtual reality software and technology, November 11-13, 2002, Hong Kong, China [doi>10.1145/585740.585758]
• 4: Döllner, Jürgen (2005) Geovisualization and Real-Time 3D Computer Graphics, in Exploring geovisualization / ed. by J. Dykes, A. M. MacEachren and M. J. Kraak. Elsevier, 2005 p. 343--366.,
• 5: Fikkert, W., T. Bierz, M. D'Ambros, and T. J. Jankun-Kelly. Interacting with Visualizations (2007) In: Human-Centered Visualization Environments, volume 4417 of Lecture Notes in Computer Science. Vol. 4417, chapter 3, p. 257--294.
• 6: Bernd Fröhlich , Stephen Barrass , Björn Zehner , John Plate , Martin Göbel, Exploring geo-scientific data in virtual environments, Proceedings of the conference on Visualization '99: celebrating ten years, p.169-173, October 1999, San Francisco, California, United States
• 7: Golledge, R, Rice, M, Jacobson R (2006) Multimodal interfaces for representing and accessing geospatial information. In Frontiers of Geographic Information Technology, p. 181--208
• 8: Harding, C., Ioannis A. Kakadiaris, John F. Casey, R. Bowen Loftin (2002) A multi-sensory system for the investigation of geoscientific data, Computers & Graphics, Volume 26, Issue 2, p. 259--269.
• 9: Hay R. J. (2003) Visualisation and Presentation of Three Dimensional Geoscience Information (2003) In Proceedings of 21st International Cartographic Conference 2003.
• 10: Milan Ikits , J. Dean Brederson , Charles D. Hansen , Christopher R. Johnson, A Constraint-Based Technique for Haptic Volume Exploration, Proceedings of the 14th IEEE Visualization 2003 (VIS'03), p.35, October 22-24, 2003 [doi>10.1109/VISUAL.2003.1250381]
• 11: Kowalik, W. (2001) "3D Device Interaction with. Force Feedback" in: Gocad 3DH, 2001.
• 12: Kraak, M.-J., MacEachren, A. M. Geovisualization and GIScience (2005) Cartography and Geographic Information Science, Vol. 32, p. 67--68
• 13: David M. Krum , Olugbenga Omoteso , William Ribarsky , Thad Starner , Larry F. Hodges, Evaluation of a multimodal interface for 3D terrain visualization, Proceedings of the conference on Visualization '02, October 27-November 01, 2002, Boston, Massachusetts
• 14: Dale A. Lawrence , Lucy Y. Pao , Christopher D. Lee , Roman Y. Novoselov, Synergistic Visual/Haptic Rendering Modes for Scientific Visualization, IEEE Computer Graphics and Applications, v.24 n.6, p.22-30, November 2004 [doi>10.1109/MCG.2004.60]
• 15: Karljohan Lundin , Matthew Cooper , Anders Persson , Daniel Evestedt , Anders Ynnerman, Enabling design and interactive selection of haptic modes, Virtual Reality, v.11 n.1, p.1-13, February 2007 [doi>10.1007/s10055-006-0033-7]
• 16: MacEachren, A. Kraak, M. 2001 Research challenges in geovisualization. Cartography and Geographic Information Science 28, p. 3--12
• 17: Helena Mitasova , Lubos Mitas , Carlo Ratti , Hiroshi Ishii , Jason Alonso , Russell S. Harmon, Real-Time Landscape Model Interaction Using a Tangible Geospatial Modeling Environment, IEEE Computer Graphics and Applications, v.26 n.4, p.55-63, July 2006 [doi>10.1109/MCG.2006.87]
• 18: Nöllenburg, M. (2007) Geographic visualization. In: Human-Centered Visualization Environments, volume 4417 of Lecture Notes in Computer Science. Vol. 4417, chapter 6, pages 257--294. Springer-Verlag, 2007
• 19: Wen Qi, Geometry based haptic interaction with scientific data, Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications, June 14-April 17, 2006, Hong Kong, China [doi>10.1145/1128923.1128999]
• 20: Ratti C., Wang Y., Ishii H., Piper B., Frenchman D., (2004), "Tangible User Interfaces (TUIs): a novel paradigm for GIS", TGIS Transactions in GIS, 8:4, pp. 487--421, ISSN 1361--1682
• 21: Jonathan C. Roberts , Sabrina Paneels, Where are we with Haptic Visualization?, Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.316-323, March 22-24, 2007 [doi>10.1109/WHC.2007.126]
• 22: Jonathan C. Roberts , Keith Franklin, Haptic Glyphs (Hlyphs) " Structured Haptic Objects for Haptic Visualization, Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.369-374, March 18-20, 2005 [doi>10.1109/WHC.2005.68]
• 23: Kenneth Salisbury , Francois Conti , Federico Barbagli, Haptic Rendering: Introductory Concepts, IEEE Computer Graphics and Applications, v.24 n.2, p.24-32, March 2004 [doi>10.1109/MCG.2004.1274058]
• 24: Eva-Lotta Sallnäs , Kirsten Rassmus-Gröhn , Calle Sjöström, Supporting presence in collaborative environments by haptic force feedback, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.4, p.461-476, Dec. 2000 [doi>10.1145/365058.365086]
• 25: Slocum, T. A., C. Blok, B. Jiang, A. Koussoulakou, D. R. Montello, S. Fuhrmann, and N. R. Hedley (2001) "Cognitive and Usability Issues in Geovisualization," Cartography and Geographic Information Science, vol. 28, pp. 61--75, 2001
• 26: USGS Seamless web site: http://seamless.usgs.gov/
• 27: Ward, M., and J. Yang (2004) Interaction spaces in data and information visualization. Proc. Joint Eurographics - IEEE TCVG Symposium on Visualization, pp. 137--146 (May, 2004).
• 28: van Dam, A., Laidlaw, D. H. and Simpson, R. M. Experiments in Immersive Virtual Reality for Scientific Visualization (2002) Computer & Graphics 26, p. 535--555
• 29: Wood, Jo, Sabine Kirschenbauer, Jurgen Dollner, Adriano Lopes, and Lars Bodum. (2005) "Using 3D in Visualization." In Exploring Geovisualization, edited by Jason Dykes, Alan M. MacEachren, and Menno-Jan Kraak, 295--312. Oxford: Elsevier Ltd, 2005.
• 30: Sarah F. Gibson, 3D chainmail: a fast algorithm for deforming volumetric objects, Proceedings of the 1997 symposium on Interactive 3D graphics, p.149-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253324]
• 31: Li, Y. and Brodlie, K. (2003) Soft object modeling with generalised chainmail, Computer Graphics Forum, 22(4): pp. 717--7

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.2 PHYSICAL SCIENCES AND ENGINEERING

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.2 Graphics Systems

General Terms:
Design, Human Factors

Keywords:
3-D, GIS, data exploration spatial decision support, geovisualization, haptics, human-computer interaction, scientific visualization, spatial analysis, virtual environments