Rendering of X3D content on mobile devices with OpenGL ES

ABSTRACT

The availability of more powerful mobile devices, sometimes equipped with graphics accelerators, is making it easier to experiment with mobile 3D graphics. In this paper, we exploit the main emerging standard in 3D rendering on mobile devices (OpenGL ES) to build a mobile player (called MobiX3D) for X3D and H-Anim content. The rendering engine of the MobiX3D player supports classic lighting and shading algorithms. We discuss the performance of the player and we apply it to sign language visualization.

REFERENCES

• 1: Antochi, I., Juurlink, B., and Vassiliadis, S. 2002. Selecting the Optimal Tile Size for Low-Power Tile-Based Rendering. In ProRISC 2002: Proceedings of the thirteenth Annual Workshop on Circuits, Systems and Signal Processing, 1--6.
• 2: Christian Babski , Daniel Thalmann, A seamless shape for HANIM compliant bodies, Proceedings of the fourth symposium on Virtual reality modeling language, p.21-28, February 23-26, 1999, Paderborn, Germany [doi>10.1145/299246.299257]
• 3: Stefano Burigat , Luca Chittaro, Location-aware visualization of VRML models in GPS-based mobile guides, Proceedings of the tenth international conference on 3D Web technology, March 29-April 01, 2005, Bangor, United Kingdom [doi>10.1145/1050491.1050499]
• 4: Fabio Buttussi , Luca Chittaro , Daniele Nadalutti, H-animator: a visual tool for modeling, reuse and sharing of X3D humanoid animations, Proceedings of the eleventh international conference on 3D web technology, April 18-21, 2006, Columbia, Maryland [doi>10.1145/1122591.1122606]
• 5: Chun-Fa Chang , Shyh-Haur Ger, Enhancing 3D Graphics on Mobile Devices by Image-Based Rendering, Proceedings of the Third IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing, p.1105-1111, December 16-18, 2002
• 6: Digital Sandbox Inc. 2000. MiniGL. http://www.dsbox.com/minigl.html.
• 7: Florent Duguet , George Drettakis, Flexible Point-Based Rendering on Mobile Devices, IEEE Computer Graphics and Applications, v.24 n.4, p.57-63, July 2004 [doi>10.1109/MCG.2004.5]
• 8: R. Elliott , J. R. W. Glauert , J. R. Kennaway , I. Marshall, The development of language processing support for the ViSiCAST project, Proceedings of the fourth international ACM conference on Assistive technologies, p.101-108, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354349]
• 9: Sarah Geitz , Timothy Hanson , Stephen Maher, Computer generated 3-dimensional models of manual alphabet handshapes for the World Wide Web, Proceedings of the second annual ACM conference on Assistive technologies, p.27-31, April 11-12, 1996, Vancouver, British Columbia, Canada [doi>10.1145/228347.228353]
• 10: Ian J. Grimstead , Nick J. Avis , David W. Walker, Visualization across the pond: how a wireless PDA can collaborate with million-polygon datasets via 9,000km of cable, Proceedings of the tenth international conference on 3D Web technology, March 29-April 01, 2005, Bangor, United Kingdom [doi>10.1145/1050491.1050498]
• 11: Humanoid Animation Working Group. 2004. H-Anim. http://h-anim.org.
• 12: Hybrid Ltd. 2005. Rasteroid. http://www.hybrid.fi/main/esframework/index.php.
• 13: INTEL. 2004. Intel 2700G Graphics Accelerator. http://www.intel.com/design/pca/prodbref/300571.htm.
• 14: Masatoshi Kameyama , Yoshiyuki Kato , Hitoshi Fujimoto , Hiroyasu Negishi , Yukio Kodama , Yoshitsugu Inoue , Hiroyuki Kawai, 3D graphics LSI core for mobile phone "Z3D", Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, July 26-27, 2003, San Diego, California
• 15: Karpouzis, K., Caridakis, G., Fotinea, S.-E., and Efthimiou, E. 2006. Educational Resources and Implementation of a Greek Sign Language Synthesis Architecture. Computers & Education, Special Issue in Web3D Technologies in Learning, Education and Training, Elsevier. (In press).
• 16: Kessenich, J., Baldwin, D., and Rost, R. 2004. The OpenGL Shading Language. http://www.opengl.org/documentation/oglsl.html.
• 17: Khronos Group. 2003. OpenGL ES. http://www.khronos.org/opengles/.
• 18: Fabrizio Lamberti , Claudio Zunino , Andrea Sanna , Antonino Fiume , Marco Maniezzo, An accelerated remote graphics architecture for PDAS, Proceeding of the eighth international conference on 3D Web technology, March 09-12, 2003, Saint Malo, France [doi>10.1145/636593.636602]
• 19: Narkhede, A., and Manocha, D. 1995. Fast Polygon Triangulation Based on Seidel's Algorithm. In Graphics Gems V, A. W. Paeth, Ed. AP Professional, Boston, MA, USA, 394--397.
• 20: Parallelgraphics. 2004. Pocket Cortona. http://www.parallelgraphics.com/products/cortonace/.
• 21: Wouter Pasman , Charles Woodward, Implementation of an Augmented Reality System on a PDA, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.276, October 07-10, 2003
• 22: PocketGL. 2000. http://www.sundialsoft.freeserve.co.uk/pgl.htm.
• 23: Pouderoux, J., and Marvie, J. E. 2005. GlutES. http://iparla.labri.fr/softwares/glutes/.
• 24: Hirohiko Sagawa , Masaru Takeuchi, A teaching system of Japanese sign language using sign language recognition and generation, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641035]
• 25: Sanna, A., Zunino, C., and Lamberti, F. 2004. A Distributed Architecture for Searching, Retrieving and Visualizing Complex 3D Models on Personal Digital Assistants. International Journal of Human Computer Studies 60, 701--716.
• 26: Ju-Ho Sohn , Ramchan Woo , Hoi-Jun Yoo, A programmable vertex shader with fixed-point SIMD datapath for low power wireless applications, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, August 29-30, 2004, Grenoble, France [doi>10.1145/1058129.1058144]
• 27: Jacob Ström , Tomas Akenine-Möller, iPACKMAN: high-quality, low-complexity texture compression for mobile phones, Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, July 30-31, 2005, Los Angeles, California [doi>10.1145/1071866.1071877]
• 28: Udine3D. 2004. http://udine3d.uniud.it.
• 29: S. Wilcox , J. Scheibman , D. Wood , D. Cokely , W. C. Stokoe, Multimedia dictionary of American Sign Language, Proceedings of the first annual ACM conference on Assistive technologies, p.9-16, October 31-November 01, 1994, Marina Del Rey, California, United States [doi>10.1145/191028.191031]
• 30: Will, H. M. 2004. Vincent. http://sourceforge.net/projects/ogl-es.
• 31: Woo, R., Yoon, C. W., Kook, J., Lee, S. J., and Yoo, H. J. 2002. A 120mW 3D Rendering Engine with 6Mb Embedded DRAM and 3.2Gbyte/s Runtime Reconfigurable Bus for PDA-Chip. IEEE Journal of Solid-State Circuits 37 (Oct.), 1352--1355.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.8 Applications

Keywords:
3D rendering, OpenGL ES, X3D, mobile devices, sign language