A 3D hypermedia with biomedical stereoscopic images: from creation to exploration in virtual reality

ABSTRACT

We present in this paper a new method for building and exploring a 3D hypermedia in virtual reality and for a biomedical domain. Starting from the acquisition of stereoscopic images and from the calibration of cameras, our system offers the user the possibility to visualize these images in 3D and to annotate specific areas with texts or voice recording. Then the user may define links between annotations, and each annotation may point to annotations from the same image or from other images. The user thus constructs a 3D hypermedia. He may have a global view of the images database using a graph display. We present a first graph which was built with images of faces.

REFERENCES

• 1: Alfonso, B. 2005. Featured Virtual Lab in their NetWatch. Science Magazine, a publication by the AAAS section vol. 308.
• 2: Bernard, A., Cohen, M., Christoph, U., Lehmann M. D. 2008. DermAtlas. Johns Hopkins University. www.dermatlas.org.
• 3: Chalam, K. V., Jain, P., Shah, V. A., Shah, Y. 2006. Evaluation of web-based annotation of ophthalmic images for multicentric clinical trials. Indian Journal of Ophthalmology, n° 54, 126--9.
• 4: Dermnet© 2007. www.dermnet.com. Interactive Medical Media LLC.
• 5: Thomas M. J. Fruchterman , Edward M. Reingold, Graph drawing by force-directed placement, Software—Practice & Experience, v.21 n.11, p.1129-1164, Nov. 1991 [doi>10.1002/spe.4380211102]
• 6: Fukatsu, T. 2006. http://amaznode.fladdict.net .
• 7: Fabien Girardin , Francesco Calabrese , Filippo Dal Fiore , Carlo Ratti , Josep Blat, Digital Footprinting: Uncovering Tourists with User-Generated Content, IEEE Pervasive Computing, v.7 n.4, p.36-43, October 2008 [doi>10.1109/MPRV.2008.71]
• 8: Haouach, M., Benzeroual, K., Guinot, C., Venturini, G. 2009. Acquisition, annotation and interactive exploration of stereo images with virtual reality. International conference on Health Informatics, 369--374.
• 9: Jia Li , James Z. Wang, Real-Time Computerized Annotation of Pictures, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.30 n.6, p.985-1002, June 2008 [doi>10.1109/TPAMI.2007.70847]
• 10: Ortiz, S. et al 2008. http://www.bestiario.org/research/tedsphere.
• 11: Bryan C. Russell , Antonio Torralba , Kevin P. Murphy , William T. Freeman, LabelMe: A Database and Web-Based Tool for Image Annotation, International Journal of Computer Vision, v.77 n.1-3, p.157-173, May 2008 [doi>10.1007/s11263-007-0090-8]
• 12: Van Sande, S. 2007. http:/vansande.org/facebook/visualiser/.
• 13: Weskamp, M. 2005. http://www.marumushi.com/apps/flickrgraph/.
• 14: Yamashita, M., Sakane, S. 2001. Adaptive annotation using a human-robot interface system PARTNER. Robotics and Automation. vol 3, 2661 -- 2667.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

General Terms:
Experimentation, Human Factors, Measurement

Keywords:
graph of images, interactive exploration, stereoscopic image annotation, virtual reality, visualization