Links in the palm of your hand: tangible hypermedia using augmented reality

ABSTRACT

Contextualised Open Hypermedia can be used to provide added value to document collections or artefacts. However, transferring the underlying hyper structures into a users conceptual model is often a problem. Augmented reality provides a mechanism for presenting these structures in a visual and tangible manner, translating the abstract action of combining contextual linkbases into physical gestures of real familiarity to users of the system. This paper examines the use of augmented reality in hypermedia and explores some possible modes of interaction that embody the functionality of open hypermedia and contextual linking using commonplace and easily understandable real world metaphors.

REFERENCES

• 1: Opengl.org web site, http://www.opengl.org
• 2: Web3d consortium, http://www.web3d.org
• 3: Kenneth M. Anderson , Richard N. Taylor , E. James Whitehead, Jr., Chimera: hypertext for heterogeneous software environments, Proceedings of the 1994 ACM European conference on Hypermedia technology, p.94-107, September 19-23, 1994, Edinburgh, Scotland [doi>10.1145/192757.192783]
• 4: Christopher Bailey , Wendy Hall , David E. Millard , Mark J. Weal, Towards Open Adaptive Hypermedia, Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, p.36-46, May 29-31, 2002
• 5: Benford, S. Information Visualisation, Browsing and Sharing in Populated Information Terrains. In Proceedings of the Seminar Series on New Directions in Software Development: The World Wide Web (Mar. 1995), University of Wolverhampton
• 6: Billinghurst, M., and Kato, H. Collaborative mixed reality. In Proceedings of International Symposium on Mixed Reality (ISMR '99). Mixed Reality - Merging Real and Virtual Worlds (1999), pp.261--284
• 7: Billinghurst, M., Kato, H., Weghorst, S., and Furness, T. A mixed reality 3d conferencing application. Tech. Rep. R-99-1, Human Interface Technology Laboratory - University of Washington, 1999
• 8: Bra, P. D., and Calvi, L. Aha! an adaptive hypermedia architecture. The New Review of Hypertext and Multimedia 4 (1998), pp.115--139
• 9: Peter Brusilovsky, Adaptive Hypermedia, User Modeling and User-Adapted Interaction, v.11 n.1-2, p.87-110, 2001 [doi>10.1023/A:1011143116306]
• 10: Chaomei Chen , Linda Thomas , Janet Cole , Chiladda Chennawasin, Representing the Semantics of Virtual Spaces, IEEE MultiMedia, v.6 n.2, p.54-63, April 1999 [doi>10.1109/93.771373]
• 11: Liren Chen , Katia Sycara, WebMate: a personal agent for browsing and searching, Proceedings of the second international conference on Autonomous agents, p.132-139, May 10-13, 1998, Minneapolis, Minnesota, United States [doi>10.1145/280765.280789]
• 12: H. C. Davis , D. E. Millard , S. Reich , N. Bouvin , K. Grønbæk , P. J. Nürnberg , L. Sloth , U. K. Wiil , K. Anderson, Interoperability between hypermedia systems: the standardisation work of the OHSWG, Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, p.201-202, February 21-25, 1999, Darmstadt, Germany [doi>10.1145/294469.294904]
• 13: Davis, H. C., Rizk, A., and Lewis, A. J. OHP: A Draft Proposal for a Standard Open Hypermedia Protocol. In Proceedings of the 2nd Workshop on Open Hypermedia Systems, ACM Hypertext '96, Washington, D.C., March 16-20. Available as Report No. ICS-TR-96-10 from the Dept. of Information and Computer Science, University of California, Irvine (1996), U. K. Wiil and S. Demeyer, Eds., pp. 27--53
• 14: Erickson, T. D. Working with Interface Metaphors. In The Art of Human Computer Interface Design, B. Laurel, Ed. Addison Wesley, 1990, pp.65--74
• 15: Steven Feiner , Blair Macintyre , Dorée Seligmann, Knowledge-based augmented reality, Communications of the ACM, v.36 n.7, p.53-62, July 1993 [doi>10.1145/159544.159587]
• 16: Steven Feiner , Blair MacIntyre , Tobias Hollerer , Anthony Webster, A Touring Machine: Prototyping 3D Mobile Augmented Reality Systems for Exploring the Urban Environment, Proceedings of the 1st IEEE International Symposium on Wearable Computers, p.74, October 13-14, 1997
• 17: Andrew M. Fountain , Wendy Hall , Ian Heath , Hugh C. Davis, MICROCOSM: an open model for hypermedia with dynamic linking, Hypertext: concepts, systems and applications, Cambridge University Press, New York, NY, 1992
• 18: Kaj Grønbæk , Randall H. Trigg, Design issues for a Dexter-based hypermedia system, Communications of the ACM, v.37 n.2, p.40-49, Feb. 1994 [doi>10.1145/175235.175238]
• 19: Hirokazu Kato , Mark Billinghurst, Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System, Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, p.85, October 20-21, 1999
• 20: Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., and Tachibana, K. Virtual object manipulation on a table-top ar environment. In Proceedings of the International Symposium on Augmented Reality (ISAR 2000) (October 2000)
• 21: Lab, M. M. Tangible media group - http://tangible.www.media.mit.edu/groups/tangible
• 22: Danius T. Michaelides , David E. Millard , Mark J. Weal , David De Roure, Auld Leaky: A Contextual Open Hypermedia Link Server, Revised Papers from the nternational Workshops OHS-7, SC-3, and AH-3 on Hypermedia: Openness, Structural Awareness, and Adaptivity, p.59-70, August 14-18, 2001
• 23: David E. Millard , Hugh C. Davis, Navigating Spaces: The Semantics of Cross Domain Interoperability, Proceedings of the 6th International Workshop and 2nd International Workshop on Open Hypertext Systems and Structural Computing, p.129-139, May 30-June 03, 2000
• 24: Dave E. Millard , Luc Moreau , Hugh C. Davis , Siegfried Reich, FOHM: a fundamental open hypertext model for investigating interoperability between hypertext domains, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.93-102, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336334]
• 25: Poupyrev, I., Berry, R., Kurumisawa, J., Nakao, K., Baldwin, L., Shigeo, I., Billinghurst, M., and Kato, H. Augmented groove. In Proceedings of the ACM SIGGRAPH 2000 Conference Abstracts and Applications (2000)
• 26: Poupyrev, I., Billinghurst, M., Tan, D., Kato, H., and Regenbrecht, H. A tangible augmented reality interface for prototyping instrument panels. In International Symposium on Augmented Reality IEEE ISAR2000, Munich, Germany (Oct. 2000)
• 27: Eric Rose , David Breen , Klaus H. Ahlers , Chris Crampton , Mihran Tuceryan , Ross Whitaker , Douglas Greer, Annotating real-world objects using augmented reality, Computer graphics: developments in virtual environments, Academic Press Ltd., London, UK, 1995
• 28: Dorée Duncan Seligmann , Cati Laporte , Stephan Vladimir Bugaj, The message is the medium, Selected papers from the sixth international conference on World Wide Web, p.1519-1530, September 1997, Santa Clara, California, United States
• 29: Mia Stern , Beverly Park Woolff, Curriculum Sequencing in a Web-Based Tutor, Proceedings of the 4th International Conference on Intelligent Tutoring Systems, p.574-583, August 16-19, 1998
• 30: Nichole Yankelovich , Bernard J. Haan , Norman K. Meyrowitz , Steven M. Drucker, Intermedia: The Concept and the Construction of a Seamless Information Environment, Computer, v.21 n.1, p.81-83, 90-96, January 1988 [doi>10.1109/2.222120]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: User issues

General Terms:
Experimentation, Human Factors

Keywords:
adaptive hypermedia, augmented reality, contextual hypermedia, tangible interfaces