Adjusting route panoramas with condensed image slices

ABSTRACT

Route panorama (RP) has become an image medium to archive and visualize cityscapes along streets. Collecting data from a sampling line of a video camera mounted on a moving vehicle, the route panorama may suffer from the vehicle shaking and varying speeds due to uneven roads and busy traffic respectively. These may jitter the route panorama and change object widths. To produce a high quality route panorama, we extract spatial-temporal information in the video volume and rectify the route panorama. In this paper, we propose two condensed image slices to record traces of horizontal and vertical scenes during the vehicle motion. Instead of matching video frames that requires cost computation and large storage, we track the feature traces in the condensed image slices to remove jitter and adjust the local length of route panoramas. The method is effective and efficient in acquiring and rectifying long distance route panoramas.

REFERENCES

• 1: Jiang Yu Zheng , Saburo Tsuji, Panoramic representation for route recognition by a mobile robot, International Journal of Computer Vision, v.9 n.1, p.55-76, Oct. 1992
• 2: Rajiv Gupta , Richard I. Hartley, Linear Pushbroom Cameras, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.9, p.963-975, September 1997 [doi>10.1109/34.615446]
• 3: Jiang Yu Zheng , Saburo Tsuji, Generating dynamic projection images for scene representation and understanding, Computer Vision and Image Understanding, v.72 n.3, p.237-256, Dec. 1998 [doi>10.1006/cviu.1998.0678]
• 4: Paul Rademacher , Gary Bishop, Multiple-center-of-projection images, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.199-206, July 1998 [doi>10.1145/280814.280871]
• 5: Jiang Yu Zheng, Digital Route Panoramas, IEEE MultiMedia, v.10 n.3, p.57-67, July 2003 [doi>10.1109/MMUL.2003.1218257]
• 6: Steven M. Seitz , Jiwon Kim, Multiperspective Imaging, IEEE Computer Graphics and Applications, v.23 n.6, p.16-19, November 2003 [doi>10.1109/MCG.2003.1242377]
• 7: Jiang Yu Zheng , Yu Zhou , Panayiotis Mili, Scanning Scene Tunnel for City Traversing, IEEE Transactions on Visualization and Computer Graphics, v.12 n.2, p.155-167, March 2006 [doi>10.1109/TVCG.2006.37]
• 8: Z. Zhu, A. R. Hanson, 3D LAMP: a new layered panoramic representation, ICCV, 723--730, 2001.
• 9: Aseem Agarwala , Maneesh Agrawala , Michael Cohen , David Salesin , Richard Szeliski, Photographing long scenes with multi-viewpoint panoramas, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 10: Augusto Roman , Gaurav Garg , Marc Levoy, Interactive Design of Multi-Perspective Images for Visualizing Urban Landscapes, Proceedings of the conference on Visualization '04, p.537-544, October 10-15, 2004 [doi>10.1109/VIS.2004.50]
• 11: D. Zomet, D. Feldman, S. Peleg, D. Weinshall, Mosaicing New Views: the crossed-slits projection, IEEE Trans. PAMI, 741--754, 2003.
• 12: Zhigang Zhu , Allen R. Hanson , Edward M. Riseman, Generalized Parallel-Perspective Stereo Mosaics from Airborne Video, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.2, p.226-237, January 2004 [doi>10.1109/TPAMI.2004.1262190]
• 13: John Weng , Yuntao Cui , Narendra Ahuja, Transitory Image Sequences, Asymptotic Properties, and Estimation of Motion and Structure, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.5, p.451-464, May 1997 [doi>10.1109/34.589205]
• 14: Sridhar Srinivasan, Extracting Structure from Optical Flow Using the Fast Error Search Technique, International Journal of Computer Vision, v.37 n.3, p.203-230, June 2000 [doi>10.1023/A:1008111923880]
• 15: Jiang Yu Zheng, Stabilizing Route Panoramas, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4, p.348-351, August 23-26, 2004 [doi>10.1109/ICPR.2004.859]
• 16: Zhigang Zhu , Guangyou Xu , Xueyin Lin, Efficient Fourier-based approach for detecting orientations and occlusions in epipolar plane images for 3D scene modeling, International Journal of Computer Vision, v.61 n.3, p.233-258, February/March 2005
• 17: Jiang Yu Zheng , Xiaolong Wang, Pervasive views: area exploration and guidance using extended image media, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101354]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Sampling

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Scanning; Imaging geometry
      I.4.3 Enhancement
          Subjects: Smoothing; Filtering; Geometric correction

General Terms:
Design, Experimentation, Measurement, Theory

Keywords:
camera motion, image representation, media editing, route panorama, video stabilization