Annotating and sketching on 3D web models

ABSTRACT

This paper reports on our progress and findings in building a Web annotation system for non-immersive 3D virtual environments. Over the last two years, we developed and tested two systems for collaborating designers to comment on virtual 3D models. Our first system, Redliner [12] lets design team members browse and leave text annotations on surfaces in three-dimensional models. Experience with Redliner, including two user evaluations in different settings, led us to develop Space Pen [13], a second annotation system with improved interaction capabilities. It goes beyond the post-it note metaphor, allowing users to draw in and on the virtual environment.

REFERENCES

• 1: Adriano C. M., Raposo A. B., Ricarte I. L. M., Magalhaes L. P., Changing interaction paradigms in annotation environments, EDMEDIA 2000, Montreal, Canada
• 2: Alex van Ballegooij , Anton Eliéns, Navigation by query in virtual worlds, Proceedings of the sixth international conference on 3D Web technology, p.77-83, February 2001, Paderbon, Germany [doi>10.1145/363361.363380]
• 3: A. J. Bernheim Brush , David Bargeron , Anoop Gupta , J. J. Cadiz, Robust annotation positioning in digital documents, Proceedings of the SIGCHI conference on Human factors in computing systems, p.285-292, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365117]
• 4: Burton N, Kilgour A C and Taylor H, A Case Study in the Use of VRML 2.0 for Marketing a Product, Proceedings of From Desk-Top to Web-Top: Virtual Environments on the Internet, World Wide Web and Networks, International Conference, Bradford, April 1997, pp. 1-24.
• 5: J. J. Cadiz , Anop Gupta , Jonathan Grudin, Using Web annotations for asynchronous collaboration around documents, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.309-318, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.359002]
• 6: Craig, D. L. and Zimring, C., 1999, Support for Collaborative Design Reasoning In Shared Virtual Spaces, Media and Design Process, Proceedings of ACADIA '99, Salt Lake City, p.126-137
• 7: Mike Daily , Mike Howard , Jason Jerald , Craig Lee , Kevin Martin , Doug McInnes , Pete Tinker, Distributed design review in virtual environments, Proceedings of the third international conference on Collaborative virtual environments, p.57-63, September 2000, San Francisco, California, United States [doi>10.1145/351006.351013]
• 8: Dr DWG, http://www.drdwg.com/
• 9: T. Goddard , V. S. Sunderam, ToolSpace: Web based 3D collaboration, Proceedings of the fourth symposium on Virtual reality modeling language, p.161-166, February 23-26, 1999, Paderborn, Germany [doi>10.1145/299246.299290]
• 10: Gross, M.D. and Do, E.Y., Drawing on the Back of an Envelope: a framework for interacting with application programs by freehand drawing, Computers and Graphics 24 (2000):835-849.
• 11: Pat Hanrahan , Paul Haeberli, Direct WYSIWYG painting and texturing on 3D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.215-223, September 1990, Dallas, TX, USA
• 12: Andrew J. Hanson , Eric A. Wernert, Constrained 3D navigation with 2D controllers, Proceedings of the 8th conference on Visualization '97, p.175-ff., October 18-24, 1997, Phoenix, Arizona, United States
• 13: Reid Harmon , Walter Patterson , William Ribarsky , Jay Bolter, The Virtual Annotation System, Proceedings of the 1996 Virtual Reality Annual International Symposium (VRAIS 96), p.239, March 30-April 03, 1996
• 14: Iris Annotator: http://www.sgi.com/software/annotator/
• 15: Jung T., Do E. Y. and Gross M. D., 1999, Immersive Redlining and Annotation of 3D Design Models on the Web, 8 th International Conference on Computer Aided Architectural Design Futures p. 81-98. Kluwer.
• 16: Jung T., Gross M. D. and Do E. Y., 2001, Space Pen: Annotation and Sketching on 3D Models on the Internet, Proceedings of the 9 th International Conference on Computer Aided Architectural Design Futures, pp. 257- 270
• 17: James A. Landay , Brad A. Myers, Sketching Interfaces: Toward More Human Interface Design, Computer, v.34 n.3, p.56-64, March 2001
• 18: Landay J. A., Interactive Sketching for the Early Stages of User Interface Design. Ph.D. dissertation, Carnegie Mellon University, Pittsburgh, PA. December, 1999
• 19: Maria M. Loughlin , John F. Hughes, An annotation system for 3D fluid flow visualization, Proceedings of the conference on Visualization '94, October 17-21, 1994, Washinton, D.C.
• 20: Catherine C. Marshall, Annotation: from paper books to the digital library, Proceedings of the second ACM international conference on Digital libraries, p.131-140, July 23-26, 1997, Philadelphia, Pennsylvania, United States [doi>10.1145/263690.263806]
• 21: Desney S. Tan , George G. Robertson , Mary Czerwinski, Exploring 3D navigation: combining speed-coupled flying with orbiting, Proceedings of the SIGCHI conference on Human factors in computing systems, p.418-425, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365307]
• 22: Alasdair Turner , Dave Chapman , Alan Penn, Sketching a virtual environment: modeling using line-drawing interpretation, Proceedings of the ACM symposium on Virtual reality software and technology, p.155-161, December 20-22, 1999, London, United Kingdom [doi>10.1145/323663.323687]
• 23: Verlinden J. C.; Bolter J. D., van der Mast C. "Virtual Annotation: Verbal Communication in Virtual Reality", Proceedings of the European Simulation Symposium 1993 (ESS'93, Delft 25-28 october).
• 24: VoloView,http://www3.autodesk.com/adsk/index/0,,224 835-123112,00.html
• 25: Steve Whittaker , Heinrich Schwarz, Back to the future: pen and paper technology supports complex group coordination, Proceedings of the SIGCHI conference on Human factors in computing systems, p.495-502, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223971]
• 26: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]
• 27: World Wide Web Consortium, "The Annotea Project ", http://www.w3.org/2001/Annotea/

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: 3D/stereo scene analysis

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Text analysis
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Design, Experimentation, Human Factors, Performance, Theory

Keywords:
3D models, Java 3D, VRML, annotation, collaboration, gesture recognition, pen-based interface, sketch in 3D