Mobile, hardware-accelerated urban 3D maps in 3G networks

ABSTRACT

3D maps can visualize static and dynamic features of real environments, and act as 3D gateways to location-based information. Insufficient network speed has been a major bottleneck for dynamic download of 3D content for mobile devices. 3G network technologies promise to solve this issue, allowing faster response times and higher data rates. Similarly, mobile 3D graphics hardware should provide a dramatic increase in rendering speed. We examine wireless IP network properties, and develop an optimized network scheme suited for navigation purposes. The presented system allows free roaming in the 3D scene, while progressively down-loading 3D data. For case platforms, we use two 3G Symbian smart phones, one with 3D hardware and one without. Network, 3D rendering and overall application performances are measured. For a scalable 3D engine, 3D hardware improves the rendering performance by over an order of magnitude. By using a compressed network protocol and efficiently formatted 3D data, a textured but lightweight 3D city can be progressively downloaded in 3G networks fast and without degrading application responsiveness.

REFERENCES

• 1: John Milligan Airey , Frederick P. Brooks, Jr., Increasing update rates in the building walkthrough system with automatic model-space subdivision and potentially visible set calculations, The University of North Carolina at Chapel Hill, 1990
• 2: Bleschmied, H., Etz, M., and Haist, J. 2005. Providing of dynamic three-dimensional city models in location-based services. In MOBILE MAPS 2005 - Interactivity and Usability of Map-based Mobile Services. A workshop., Mobile HCI.
• 3: Brenner, C., Haala, N., and Fritsch, D. 2001. Towards fully automated 3d city model generation. In Proc. Workshop Automatic Extraction of Man-Made Objects from Aerial and Space Images III, International Society of Photogrammetry and Remote Sensing.
• 4: Stefano Burigat , Luca Chittaro, Location-aware visualization of VRML models in GPS-based mobile guides, Proceedings of the tenth international conference on 3D Web technology, March 29-April 01, 2005, Bangor, United Kingdom [doi>10.1145/1050491.1050499]
• 5: Chase, W. 1983. Spatial representations of taxi drivers. In Acuisition of Symbolic Skills, D. R. Rogers and J. A. Sloboda, Eds. Plenum, New York.
• 6: Jimmy H. P. Chim , Mark Green , Rynson W. H. Lau , Hong Va Leong , Antonio Si, On caching and prefetching of virtual objects in distributed virtual environments, Proceedings of the sixth ACM international conference on Multimedia, p.171-180, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290769]
• 7: Coors, V. 2001. 3d-gis in networking environments. In International Workshop on 3D Cadastres, FIG Commission 2.
• 8: Volker Coors, Resource-adaptive interactive 3D maps, Proceedings of the 2nd international symposium on Smart graphics, p.140-144, June 11-13, 2002, Hawthorne, New York [doi>10.1145/569005.569026]
• 9: Rudolph P. Darken , Helsin Cevik, Map Usage in Virtual Environments: Orientation Issues, Proceedings of the IEEE Virtual Reality, p.133, March 13-17, 1999
• 10: Darken, R. P., and Peterson, B. 2002. Spatial orientation, wayfinding and representation. In Handbook of Virtual Enviroment Technology, K. M. Stanney, Ed. Lawrence Erlbaum Associates, Inc., ch. 28.
• 11: Jürgen Döllner , Henrik Buchholz, Continuous level-of-detail modeling of buildings in 3D city models, Proceedings of the 13th annual ACM international workshop on Geographic information systems, November 04-05, 2005, Bremen, Germany [doi>10.1145/1097064.1097089]
• 12: Downs, R. M., and Stea, D. 1977. Maps in Minds: Reflections on Cognitive Mapping. Harper & Row, New York.
• 13: Thomas A. Funkhouser , Carlo H. Séquin , Seth J. Teller, Management of large amounts of data in interactive building walkthroughs, Proceedings of the 1992 symposium on Interactive 3D graphics, p.11-20, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147158]
• 14: G. W. Furnas, Generalized fisheye views, Proceedings of the SIGCHI conference on Human factors in computing systems, p.16-23, April 13-17, 1986, Boston, Massachusetts, United States
• 15: Golledge, R., Gale, N., Pellegrino, J., and Doherty, S. 1992. Spatial knowledge acquisition by children: Route learning and relational distances. Annals of the Association of the American Geographers 82, 2, 223--244.
• 16: Hesina, G., and Schmalstieg, D. 1998. A network architecture for remote rendering. Tech. Rep. TR-186-2-98-02, Institute of Computer Graphics and Algorithms, Vienna University of Technology, Favoritenstrasse 9-11/186, A-1040 Vienna, Austria, Apr. human contact: [e-mail].
• 17: Holahan, C. 1982. Environmental Psychology. Random House, Inc., New York.
• 18: JCP, 2005. Jsr 184: Mobile 3d graphics api for j2me. http://www.jcp.org/en/jsr/detail?id=184.
• 19: Json.org, 2006. Introducing json. http://json.org.
• 20: Kolbe, T. H., Gröger, G., and Plümer, L. 2005. Citygml - interoperable access to 3d city models. In First International Symposium on Geo-Information for Disaster Management GI4DM, Oosterom, Zlatanova, and Fendel, Eds. Springer Verlag, March.
• 21: Christian Kray , Christian Elting , Katri Laakso , Volker Coors, Presenting route instructions on mobile devices, Proceedings of the 8th international conference on Intelligent user interfaces, January 12-15, 2003, Miami, Florida, USA [doi>10.1145/604045.604066]
• 22: Tomas Möller , Eric Haines, Real-time rendering, A. K. Peters, Ltd., Natick, MA, 1999
• 23: Nokia, 2006. Nokia n93 technical specifications. http://www.nokia.com.
• 24: Antti Nurminen, m-LOMA - a mobile 3D city map, Proceedings of the eleventh international conference on 3D web technology, April 18-21, 2006, Columbia, Maryland [doi>10.1145/1122591.1122593]
• 25: Oulasvirta, A., Nivala, A.-M., Tikka, V., Liikkanen, L., and Nurminen, A. 2005. Understanding users' strategies with mobile maps. In Mobile Maps 2005 - Interactivity and Usability of Map-based Mobile Services, a workshop, Mobile HCI.
• 26: ParallelGraphics, 2005. Pocket cortona. http://www.parallelgraphics.com/products/cortonace.
• 27: Yoav I. H. Parish , Pascal Müller, Procedural modeling of cities, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.301-308, August 2001 [doi>10.1145/383259.383292]
• 28: Parkvall, S., Englund, E., Malm, P., Hedberg, T., Persson, M., and Peisa, J. 2003. Wedma evolved - high-speed packet-data services. Ericsson Review 2, Ericsson.
• 29: W. Pasman , F. W. Jansen, Comparing Simplification and Image-Based Techniques for 3D Client-Server Rendering Systems, IEEE Transactions on Visualization and Computer Graphics, v.9 n.2, p.226-240, April 2003 [doi>10.1109/TVCG.2003.1196009]
• 30: Przybilski, M., Campadello, S., and Saridakis, T. 2005. Mobile, on demand access of service-annotated 3d maps. In Proceedings of the 23rd IASTED International Conference on SOFTWARE ENGINEERING, IASTED, 448--452.
• 31: Jean-Charles Quillet , Gwenola Thomas , Xavier Granier , Pascal Guitton , Jean-Eudes Marvie, Using expressive rendering for remote visualization of large city models, Proceedings of the eleventh international conference on 3D web technology, April 18-21, 2006, Columbia, Maryland [doi>10.1145/1122591.1122595]
• 32: Rakkolainen, I., Timmerheid, J., and Vainio, T. 2001. A 3d city info for mobile users. Computers and Graphics 25, 4, 619--625.
• 33: J. Royan , R. Balter , C. Bouville, Hierarchical Representation of Virtual Cities for Progressive Transmission over Networks, Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06), p.432-439, June 14-16, 2006 [doi>10.1109/3DPVT.2006.73]
• 34: Arne Schilling , Alexander Zipf, Generation of VRML city models for focus based tour animations: integration, modeling and presentation of heterogeneous geo-data sources, Proceeding of the eighth international conference on 3D Web technology, March 09-12, 2003, Saint Malo, France [doi>10.1145/636593.636599]
• 35: Schmalstieg, D., and Gervautz, M. 1996. Demand-driven geometry transmission for distributed virtual environments. Computer Graphics Forum 15, 3, 421--431.
• 36: Schultz, R., and Schumann, H. 2001. Importance Driven Rendering - Using Importance Information in the Rendering Process. In Hamza M., Sarfraz M. (ed.): Computer Graphics and Imaging (CGIM 2001) Conference Proceedings, 66--71.
• 37: Siegel, A., and White, S. 1975. The development of spatial representations of large-scale environments. In Advances in Child Development and Behaviour, H. Reese, Ed., vol. 10. Academic Press, New York, 9--55.
• 38: Thorndyke, P., and Hayes-Roth, B. 1982. Differences in spatial knowledge acquired from maps and navigation. Cognitive Psychology 14, 560--589.
• 39: Thorndyke, P., and Stasz, C. 1980. Individual differences in procedures for knowledge acquisition from maps. Cognitive Psychology 12, 137--175.
• 40: W3C, 1999. Wap binary xml content format. http://www.w3.org/TR/wbxml.
• 41: Peter Wonka , Michael Wimmer , François Sillion , William Ribarsky, Instant architecture, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Information browsers
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Keywords:
3D maps, VRML, mobile computing, wireless networks