Volumetric video compression for interactive playback

ABSTRACT

We develop a volumetric video system which supports interactive browsing of compressed time-varying volumetric features (significant isosurfaces and interval volumes). Since the size of even one volumetric frame in a time-varying 3D data set is very large, transmission and on-line reconstruction are the main bottlenecks for interactive remote visualization of time-varying volume and surface data. We describe a compression scheme for encoding time-varying volumetric features in a unified way, which allows for on-line reconstruction and rendering. To increase the run-time decompression speed and compression ratio, we decompose the volume into small blocks and encode only the significant blocks that contribute to the isosurfaces and interval volumes. The results show that our compression scheme achieves high compression ratio with fast reconstruction, which is effective for interactive client-side rendering of time-varying volumetric features.

REFERENCES

• 1: Chandrajit Bajaj , Insung Ihm , Sanghun Park, 3D RGB image compression for interactive applications, ACM Transactions on Graphics (TOG), v.20 n.1, p.10-38, Jan. 2001 [doi>10.1145/383745.383747]
• 2: Chandrajit Bajaj , Sanghun Park , Insung Ihm, Visualization-Specific Compression of Large Volume Data, Proceedings of the 9th Pacific Conference on Computer Graphics and Applications, p.212, October 16-18, 2001
• 3: Chandrajit L. Bajaj , Valerio Pascucci , Daniel R. Schikore, Fast isocontouring for improved interactivity, Proceedings of the 1996 symposium on Volume visualization, p.39-ff., October 28-29, 1996, San Francisco, California, United States
• 4: Paolo Cignoni , Paola Marino , Claudio Montani , Enrico Puppo , Roberto Scopigno, Speeding Up Isosurface Extraction Using Interval Trees, IEEE Transactions on Visualization and Computer Graphics, v.3 n.2, p.158-170, April 1997 [doi>10.1109/2945.597798]
• 5: David Ellsworth , Ling-Jen Chiang , Han-Wei Shen, Accelerating time-varying hardware volume rendering using TSP trees and color-based error metrics, Proceedings of the 2000 IEEE symposium on Volume visualization, p.119-128, October 09-10, 2000, Salt Lake City, Utah, United States [doi>10.1145/353888.353908]
• 6: Didier Le Gall, MPEG: a video compression standard for multimedia applications, Communications of the ACM, v.34 n.4, p.46-58, April 1991 [doi>10.1145/103085.103090]
• 7: Thomas Gerstner , Renato Pajarola, Topology preserving and controlled topology simplifying multiresolution isosurface extraction, Proceedings of the conference on Visualization '00, p.259-266, October 2000, Salt Lake City, Utah, United States
• 8: Stefan Guthe , Wolfgang Straßer, Real-time decompression and visualization of animated volume data, Proceedings of the conference on Visualization '01, October 21-26, 2001, San Diego, California
• 9: Stefan Guthe , Michael Wand , Julius Gonser , Wolfgang Straßer, Interactive rendering of large volume data sets, Proceedings of the conference on Visualization '02, October 27-November 01, 2002, Boston, Massachusetts
• 10: {10} C.T. Howie, E.H. Black, The mesh propagation algorithm for isosurface construction, Comput. Graph. Forum 13 (3) (1994) 65-74.
• 11: {11} I. Ihm, S. Park, Wavelet-based 3d compression scheme for interactive visualization of very large volume data, in: Proc. Graphics Interface '98, 1998, pp. 107-116.
• 12: Andrei Khodakovsky , Peter Schröder , Wim Sweldens, Progressive geometry compression, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.271-278, July 2000 [doi>10.1145/344779.344922]
• 13: William E. Lorensen , Harvey E. Cline, Marching cubes: A high resolution 3D surface construction algorithm, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.163-169, August 1987
• 14: Eric B. Lum , Kwan Liu Ma , John Clyne, Texture hardware assisted rendering of time-varying volume data, Proceedings of the conference on Visualization '01, October 21-26, 2001, San Diego, California
• 15: Kwan-Liu Ma , David M. Camp, High performance visualization of time-varying volume data over a wide-area network status, Proceedings of the 2000 ACM/IEEE conference on Supercomputing (CDROM), p.29-es, November 04-10, 2000, Dallas, Texas, United States
• 16: Raghu Machiraju , Zhifan Zhu , Bryan Fry , Robert Moorhead, Structure-Significant Representation of Structured Datasets, IEEE Transactions on Visualization and Computer Graphics, v.4 n.2, p.117-132, April 1998 [doi>10.1109/2945.694954]
• 17: {17} OpenGL. Developer faq. http://www.opengl.org/developers/faqs/technical.html.
• 18: Hanspeter Pfister , Bill Lorensen , Chandrajit Bajaj , Gordon Kindlmann , Will Schroeder , Lisa Sobierajski Avila , Ken Martin , Raghu Machiraju , Jinho Lee, The Transfer Function Bake-Off, IEEE Computer Graphics and Applications, v.21 n.3, p.16-22, May 2001
• 19: {19} A. Said, W.A. Pearlman, A new fast and efficient image codec based on set partitioning in hierarchical trees, IEEE Trans. Circ. Syst. Vid. 6 (1996) 243-250.
• 20: Ariel Shamir , Chandrajit Bajaj , Valerio Pascucci, Multi-resolution dynamic meshes with arbitrary deformations, Proceedings of the conference on Visualization '00, p.423-430, October 2000, Salt Lake City, Utah, United States
• 21: {21} J. Shapiro, Embedded image coding using zerotrees of wavelet coefficients, IEEE Trans. Signal Process 41 (12) (1993) 3445-3462.
• 22: Han-Wei Shen, Isosurface extraction in time-varying fields using a temporal hierarchical index tree, Proceedings of the conference on Visualization '98, p.159-166, October 18-23, 1998, Research Triangle Park, North Carolina, United States
• 23: Han-Wei Shen , Charles D. Hansen , Yarden Livnat , Christopher R. Johnson, Isosurfacing in span space with utmost efficiency (ISSUE), Proceedings of the 7th conference on Visualization '96, p.287-ff., October 28-29, 1996, San Francisco, California, United States
• 24: Deborah Silver , Xin Wang, Tracking and Visualizing Turbulent 3D Features, IEEE Transactions on Visualization and Computer Graphics, v.3 n.2, p.129-141, April 1997 [doi>10.1109/2945.597796]
• 25: Bong-Soo Sohn , Chandrajit Bajaj , Vinay Siddavanahalli, Feature based volumetric video compression for interactive playback, Proceedings of the 2002 IEEE symposium on Volume visualization and graphics, October 28-29, 2002, Boston, Massachusetts
• 26: Philip Sutton , Charles D. Hansen, Isosurface extraction in time-varying fields using a temporal branch-on-need tree (T-BON), Proceedings of the conference on Visualization '99: celebrating ten years, p.147-153, October 1999, San Francisco, California, United States
• 27: Gabriel Taubin , Jarek Rossignac, Geometric compression through topological surgery, ACM Transactions on Graphics (TOG), v.17 n.2, p.84-115, April 1998 [doi>10.1145/274363.274365]
• 28: Rüdiger Westermann , Thomas Ertl, Efficiently using graphics hardware in volume rendering applications, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.169-177, July 1998 [doi>10.1145/280814.280860]
• 29: Xiaoyu Zhang , Chandrajit Bajaj , William Blanke, Scalable isosurface visualization of massive datasets on COTS clusters, Proceedings of the IEEE 2001 symposium on parallel and large-data visualization and graphics, October 22-23, 2001, San Diego, California
• 30: Xiaoyu Zhang , Chandrajit Bajaj , Vijaya Ramachandran, Parallel and out-of-core view-dependent isocontour visualization using random data distribution, Proceedings of the symposium on Data Visualisation 2002, May 27-29, 2002, Barcelona, Spain

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Time-varying imagery

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: 3D/stereo scene analysis
  I.4 IMAGE PROCESSING AND COMPUTER VISION
        I.4.10 Image Representation
            Subjects: Volumetric
      I.4.2 Compression (Coding)
          Subjects: Approximate methods
      I.4.5 Reconstruction
          Subjects: Transform methods

  J. Computer Applications
  J.2 PHYSICAL SCIENCES AND ENGINEERING
      Subjects: Earth and atmospheric sciences

General Terms:
Algorithms, Experimentation

Keywords:
3D video, compression, hardware-acceleration, isocontouring, time-varying volume visualization, wavelet transform