Pervasive views: area exploration and guidance using extended image media

ABSTRACT

This work achieves full registration of scenes in a large area and creates visual indexes for visualization in a digital city. We explore effective mapping, indexing, and display of scenes so that an area becomes "visible". Users can virtual navigate city on the Internet and achieve real guidance with a PDA. Extended images such as route panoramas, scene tunnels, panoramic views and spherical views are acquired in an urban area and associated with geospatial locations. A 3D LIDAR elevation map is used to generate a scanning plan based on visibility, image properties, and importance of scenes. Scanning scenes along streets and at spots of interest allows for compact and complete visual data collection. To access city information, visual indexes from scenes to spaces are created pervasively for flexible space exploration and transition. To visualize a space seamlessly in a large view frame and synchronize scenes with the virtual movement in the map, we stream image data on the Internet. An engine is developed for continuous space traversing, accessing spatial information, and transiting between spaces through visual links. A real urban area has been modeled to verify the effectiveness of such a system.

REFERENCES

• 1: Jiang Yu Zheng , Saburo Tsuji, Panoramic representation for route recognition by a mobile robot, International Journal of Computer Vision, v.9 n.1, p.55-76, Oct. 1992
• 2: Andrew Lippman, Movie-maps: An application of the optical videodisc to computer graphics, Proceedings of the 7th annual conference on Computer graphics and interactive techniques, p.32-42, July 14-18, 1980, Seattle, Washington, United States
• 3: Frueh C., Zakhor A., Constructing 3D city models by merging ground-based and airborne views, IEEE CVPR03, 562--569, 2003.
• 4: Jiang Yu Zheng, Digital Route Panoramas, IEEE MultiMedia, v.10 n.3, p.57-67, July 2003 [doi>10.1109/MMUL.2003.1218257]
• 5: Jiang Yu Zheng , Yu Zhou, Scene tunnels for seamless virtual tour, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027635]
• 6: Zhigang Zhu , Allen R. Hanson , Edward M. Riseman, Generalized Parallel-Perspective Stereo Mosaics from Airborne Video, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.2, p.226-237, January 2004 [doi>10.1109/TPAMI.2004.1262190]
• 7: Daniel N. Wood , Adam Finkelstein , John F. Hughes , Craig E. Thayer , David H. Salesin, Multiperspective panoramas for cel animation, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.243-250, August 1997 [doi>10.1145/258734.258859]
• 8: Shenchang Eric Chen, QuickTime VR: an image-based approach to virtual environment navigation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.29-38, September 1995 [doi>10.1145/218380.218395]
• 9: Zomet A., Feldman D., Peleg S., and Weinshall D., Mosaicing New Views: The crossed-slits projection, IEEE Trans. on PAMI, June 2003, pp. 741--754.
• 10: Daniel G. Aliaga , Ingrid Carlbom, Plenoptic stitching: a scalable method for reconstructing 3D interactive walk throughs, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.443-450, August 2001 [doi>10.1145/383259.383311]
• 11: Leonard McMillan , Gary Bishop, Plenoptic modeling: an image-based rendering system, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.39-46, September 1995 [doi>10.1145/218380.218398]
• 12: Li S., Hayashi A., "Robot navigation in outdoor environments by using GPS information and panoramic views", IEEE/RSJ Int. Conf. IROS, pp. 570--575, 1998.
• 13: S. Coorg , N. Master , S. Teller, Acquisition of a Large Pose-Mosaic Dataset, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.872, June 23-25, 1998
• 14: Takahito Kawanishi , Kazumasa Yamazawa , Hidehiko Iwasa , Haruo Takemura , Naokazu Yokoya, Generation of High-Resolution Stereo Panoramic Images by Omnidirectional Imaging Sensor Using Hexagonal Pyramidal Mirrors, Proceedings of the 14th International Conference on Pattern Recognition-Volume 1, p.485, August 16-20, 1998
• 15: Toru Ishida, Digital city Kyoto, Communications of the ACM, v.45 n.7, p.76-81, July 2002 [doi>10.1145/514236.514238]
• 16: Kinji Matsumura , Kazuya Usui , Kenjiro Kai , Koichi Ishikawa, Location-aware data broadcasting: an application for digital mobile broadcasting in Japan, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957069]
• 17: Kentaro Toyama , Ron Logan , Asta Roseway, Geographic location tags on digital images, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957046]
• 18: Zhao H., Shibasaki R., A Vehicle-borne urban 3D acquisition system using single-row laser range scanners, IEEE Trans. on SMC, B: vol. 33, no. 4, 658--666, 2003.
• 19: Uyttendaele M. et al. Image-based interactive exploration of real-world environments. IEEE Computer Graphics and Application, 24(3), 2004
• 20: Shmuel Peleg , Benny Rousso , Alex Rav-Acha , Assaf Zomet, Mosaicing on Adaptive Manifolds, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.10, p.1144-1154, October 2000 [doi>10.1109/34.879794]
• 21: Rottensteiner F., Briese C., Automatic generation of building models from LIDAR data and the integration of aerial images. ISPRS, Vol. XXXIV, 2003.
• 22: Min Shi , Jiang Yu Zheng, A Slit Scanning Depth of Route Panorama from Stationary Blur, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.1047-1054, June 20-26, 2005 [doi>10.1109/CVPR.2005.46]
• 23: Jiang Yu Zheng , Saburo Tsuji, Generating dynamic projection images for scene representation and understanding, Computer Vision and Image Understanding, v.72 n.3, p.237-256, Dec. 1998 [doi>10.1006/cviu.1998.0678]
• 24: http://www.cs.iupui.edu/~jzheng/digitalcity.html

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Scanning

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Multimedia databases
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Information browsers

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Sampling; Imaging geometry

General Terms:
Algorithms, Design, Experimentation, Measurement, Theory

Keywords:
GIS, image media, image streaming, navigation, pervasive computing, route panorama, scene tunnel, visual indexing