Optimized mesh and texture multiplexing for progressive textured model transmission

ABSTRACT

An optimized scheme of multiplexing coded mesh and texture data to facilitate progressive transmission of 3D textured models is proposed in this work. The mesh and texture data of a 3D textured model are fed into their respective compression modules and represented by a series of levels of details. Then, for a given viewpoint, a rate-distortion surface can be generated based on the multiplexing of mesh and texture data in different details. The distortion is calculated by measuring the visual quality of rendered images. Furthermore, an optimal path over the rate-distortion surface is determined by the steepest descent algorithm. When the mesh and texture data streams are transmitted in a certain ratio along the optimal path, it is guaranteed that the rendered images have the best visual quality perceived from the given viewpoint. To deal with an arbitrary viewpoint, we propose a hierarchical sampling algorithm so that the optimal path can be interpolated from finite sampling points. Experimental results demonstrate that the proposed method can provide the best visual quality of a 3D textured model for any observation point at any bit rate.

REFERENCES

• 1: M. J. Abásolo and F. Perales. Geometric-textured bitree: Transmission of a multiresolution terrain across the internet. Journal of Computer Science & Technology, 2(7):34--41, Oct. 2002.
• 2: M. D. Adams and F. Kossentini. JasPer: a software-based JPEG-2000 codec implementation. In Proceedings of IEEE International Conference on Image Processing, pages 53--56, October 2000.
• 3: Kenneth R. Castleman, Digital image processing, Prentice Hall Press, Upper Saddle River, NJ, 1996
• 4: Jonathan Cohen , Marc Olano , Dinesh Manocha, Appearance-preserving simplification, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.115-122, July 1998 [doi>10.1145/280814.280832]
• 5: Michael Garland , Paul S. Heckbert, Simplifying surfaces with color and texture using quadric error metrics, Proceedings of the conference on Visualization '98, p.263-269, October 18-23, 1998, Research Triangle Park, North Carolina, United States
• 6: M. J. Gervais, L. O. H. Jr., and J. O. Roberts. Identification confusions among letters of the alabet. Journal of Experimental Psychology: Human Perception and Performance, 10(5):655--666, 1984.
• 7: Hugues Hoppe, Progressive meshes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.99-108, August 1996 [doi>10.1145/237170.237216]
• 8: Hugues Hoppe, New quadric metric for simplifiying meshes with appearance attributes, Proceedings of the conference on Visualization '99: celebrating ten years, p.59-66, October 1999, San Francisco, California, United States
• 9: A. J. A. Jr. Simplified vision models for image quality assessment. In SID International Symposium Digest of Technical Papers, number~27, pages 397--400, 1996.
• 10: Peter Lindstrom , Greg Turk, Image-driven simplification, ACM Transactions on Graphics (TOG), v.19 n.3, p.204-241, July 2000 [doi>10.1145/353981.353995]
• 11: J. L. Mannos and D. J. Sakrison. The effects of a visual fidelity criterion on the encoding of images. IEEE Transactions on Information Theory, 10(5):525--536, 1974.
• 12: M. Okuda and T. Chen. Joint geometry/texture progressive coding of 3d models. In Proceedings of Int'l Conf. on Image Processing, pages 632--635, 2000.
• 13: Renato Pajarola , Jarek Rossignac, Compressed Progressive Meshes, IEEE Transactions on Visualization and Computer Graphics, v.6 n.1, p.79-93, January 2000 [doi>10.1109/2945.841122]
• 14: Pedro V. Sander , John Snyder , Steven J. Gortler , Hugues Hoppe, Texture mapping progressive meshes, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.409-416, August 2001 [doi>10.1145/383259.383307]
• 15: Andrew B. Watson, Digital images and human vision, MIT Press, Cambridge, MA, 1993

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Additional Classification:
  E. Data
  E.4 CODING AND INFORMATION THEORY
      Subjects: Data compaction and compression

General Terms:
Algorithms, Experimentation

Keywords:
mesh-texture multiplexing, progressive transmission, rate-distortion surface