FlyAbout: spatially indexed panoramic video

ABSTRACT

We describe a system called FlyAbout which uses spatially indexed panoramic video for virtual reality applications. Panoramic video is captured by moving a 360@deg camera along continuous paths. Users can interactively replay the video with the ability to view any interesting object or choose a particular direction. Spatially indexed video gives the ability to travel along paths or roads with a map-like interface. At junctions, or intersection points, users can chose which path to follow as well as which direction to look, allowing interaction not available with conventional video. Combining the spatial index with a spatial databsdde of maps or objects allows users to navigate to specific locations or interactively inspect particular objects.

REFERENCES

• 1: Howard Rheingold, Virtual reality, Simon & Schuster, Inc., New York, NY, 1991
• 2: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 3: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 4: Shenchang Eric Chen , Lance Williams, View interpolation for image synthesis, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.279-288, September 1993 [doi>10.1145/166117.166153]
• 5: Shree K. Nayar, Catadioptric Omnidirectional Camera, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.482, June 17-19, 1997
• 6: IPIX, the Interactive Pictures Corporation, http://www.ipix.com
• 7: M. Nicolescu and G. Medioni , "Electronic Pan-Tilt- Zoom: A Solution for Intelligent Room Systems," in Proc. IEEE International Conference on Multimedia and Expo, August 2000.
• 8: FullView wide-field panoramic camera, http://www.panoramtech.comlproduct2000/sources/FV 360.htm
• 9: Immersive Media, http://www.immersivemedia.com
• 10: H. Kawasaki, K. Ikeuchi, M. Sakauchi, "'Automatic 3D City construction System using Omni Camera," in Proc. IEEE International Conference on Multimedia and Expo, August 2000.
• 11: Andrew Lippman, Movie-maps: An application of the optical videodisc to computer graphics, ACM SIGGRAPH Computer Graphics, v.14 n.3, p.32-42, July 1980
• 12: S. S. Beauchemin , J. L. Barron, The computation of optical flow, ACM Computing Surveys (CSUR), v.27 n.3, p.433-466, Sept. 1995 [doi>10.1145/212094.212141]
• 13: M. Naimark, "VBK - A Moviemap of Karlsruhe", in: Tommorrow's Realities - In Proc. SIGGRAPH '91, Las Vegas 1991
• 14: IPIX Corporation. httu://www.ipix.com
• 15: BeHere Corporation. http://www.behere.com
• 16: M. Naimark, "Views of the Golden Gate", Exhibit at the Exploratorium, San Francisco, Fall 2000.
• 17: J. Foote and D. Kimber: "FlyCam: Practical Panoramic Video," in Proc. IEEE International Conference on Multimedia and Expo, vol. III, pp. 1419-1422, August 2000.
• 18: DizzyCity Corporation. http:Nwww.dizzvcitv.com
• 19: T. Pintaric and U. Neumann. "Demonstration of Immersive Panoramic Video," ACM Multimedia 2000, Los Angeles.
• 20: Mapquest.com, Inc. httn://www.mapquest.com

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Spatial databases and GIS
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Design, Experimentation, Performance

Keywords:
interactive video, panoramic video, spatial databases, video maps, virtual reality