Automatic modeling of a 3D city map from real-world video

ABSTRACT

Mixed reality (MR) systems which integrate the virtual world and the real world have become a major topic in the research area of multimedia. As a practical application of these MR systems, we propose an efficient method for making a 3D map from real-world video data. The proposed method is an automatic organization method focusing on video objects to describe video data in an efficient way, i.e., by collating the real-world video data with map information using DP matching. To demonstrate the reliability of this method, we describe successful experiments that we performed using 3D information obtained from the real-world video data.

REFERENCES

• 1: Java(tm) media framework api home page. http: //java. sun.com/products/java-media/jmf/index.html, Dec. 1998.
• 2: ARISAWA, H., AND TOMII, T. Design of multimedia databese and a query language. In Proceedings of MULTIMEDIA '96 IEEE (Jun. 1996), pp. 462-467.
• 3: BOLLES, R., BAKER, H., AND MARIMONT, D. Epipolar plane image analysis:an approach to determining structure from motion. Int.J.of Computer Vision 1 (1987), 7-55.
• 4: A. Hampapur , T. Weymouth , R. Jain, Digital video segmentation, Proceedings of the second ACM international conference on Multimedia, p.357-364, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192699]
• 5: Peilin Liu , Wei Ku , Katsushi Ikeuchi , Masao Sakauchi, Recognition of Urban Scene Using Silhouette of Buildings and City Map Database, Proceedings of the Third Asian Conference on Computer Vision-Volume II, p.209-216, January 08-10, 1998
• 6: MANSKE, K., MUHLHAUSER, M., AND VOGL, S. Obvi:hierarchical 3d videobrowsing. In Proceedings of S.ZW& Annual ACM Multimedia Conference (1998), pp. 369374.
• 7: NOTOMI, M., OZAWA, S., AND ZEN, H. Modeling of urban scene by motion analysis. IEICE 'lhw. Information and Systems J81-D-II (May 1998), 872-879.
• 8: E. Oomoto , K. Tanaka, OVID: Design and Implementation of a Video-Object Database System, IEEE Transactions on Knowledge and Data Engineering, v.5 n.4, p.629-643, August 1993 [doi>10.1109/69.234775]
• 9: SARKAR, S., AND BOYER, K. L. A computational structure for preattentive perceptual organization: Graphical enumeration and voting methods. IEEE Tnzw.Systems, Man, and Cybernetics 24, 2 (Feb. 1994), 246-267.
• 10: SHI, 2. C., AND SHIBASAKI, R. Automated building extraction from digital stereo imagery. Automatic Extraction of Man-Made Objects from Aerial And Space Images (May 1997), 119-128.
• 11: SZELISKI, R. Video mosaics for virtual envrionment. IEEE Cornput. ( 1996)) 22-30.
• 12: Carlo Tomasi , Takeo Kanade, Shape and motion from image streams under orthography: a factorization method, International Journal of Computer Vision, v.9 n.2, p.137-154, Nov. 1992 [doi>10.1007/BF00129684]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING

General Terms:
Design, Experimentation, Measurement, Theory