HYUI: a visual framework for prototyping hybrid user interfaces

ABSTRACT

This paper describes a pragmatic approach for the design of hybrid user interfaces based on a number of extensions of an existing 3D authoring system. We present the design and realization of a visual framework dedicated to the prototyping of hybrid user interfaces. The rapid development environment was applied in a teaching context during lectures on advanced user interface design. The results showed that our framework provides a suitable tool to quickly design and test hybrid user interfaces.

REFERENCES

• 1: Steven Feiner , Ari Shamash, Hybrid user interfaces: breeding virtually bigger interfaces for physically smaller computers, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.9-17, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120783]
• 2: Michel Beaudouin-Lafon, Instrumental interaction: an interaction model for designing post-WIMP user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.446-453, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332473]
• 3: Céline Coutrix , Laurence Nigay, Mixed reality: a model of mixed interaction, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133274]
• 4: Christian Sandor , Alex Olwal , Blaine Bell , Steven Feiner, Immersive Mixed-Reality Configuration of Hybrid User Interfaces, Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality, p.110-113, October 05-08, 2005 [doi>10.1109/ISMAR.2005.37]
• 5: C. Pirchheim, D. Schmalstieg, A. Bornik: Visual Programming for Hybrid User Interfaces. In: Proc 2nd International Workshop on Mixed Reality User Interfaces (MRUI'07)
• 6: James D. Foley , Victor L. Wallace , Peggy Chan, The human factors of computer graphics interaction techniques, IEEE Computer Graphics and Applications, v.4 n.11, p.13-48, Nov. 1984
• 7: Stuart K. Card , Jock D. Mackinlay , George G. Robertson, A morphological analysis of the design space of input devices, ACM Transactions on Information Systems (TOIS), v.9 n.2, p.99-122, April 1991 [doi>10.1145/123078.128726]
• 8: D. F. Abawi, S. Reinhold, R. Dörner. A Toolkit for Authoring Non-linear Storytelling Environments Using Mixed Reality. TIDSE 2004. Technologies for interactive Storytelling, Springer, 2004.
• 9: Blair MacIntyre , Maribeth Gandy , Steven Dow , Jay David Bolter, DART: a toolkit for rapid design exploration of augmented reality experiences, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029669]
• 10: Rafael Ballagas , Meredith Ringel , Maureen Stone , Jan Borchers, iStuff: a physical user interface toolkit for ubiquitous computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642705]
• 11: Hans Gellersen , Gerd Kortuem , Albrecht Schmidt , Michael Beigl, Physical Prototyping with Smart-Its, IEEE Pervasive Computing, v.3 n.3, p.74-82, July 2004 [doi>10.1109/MPRV.2004.1321032]
• 12: Björn Hartmann , Scott R. Klemmer , Michael Bernstein , Leith Abdulla , Brandon Burr , Avi Robinson-Mosher , Jennifer Gee, Reflective physical prototyping through integrated design, test, and analysis, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166300]
• 13: Icube-X. http://www.infusionsystems.com
• 14: Arduino. http://www.arduino.cc
• 15: D. Wagner, D. Schmalstieg. ARToolKitPlus for Pose Tracking on Mobile Devices. Proc. CVWW'07.
• 16: Martin Kaltenbrunner , Ross Bencina, reacTIVision: a computer-vision framework for table-based tangible interaction, Proceedings of the 1st international conference on Tangible and embedded interaction, February 15-17, 2007, Baton Rouge, Louisiana [doi>10.1145/1226969.1226983]
• 17: EiToolkit. http://www.eitoolkit.de
• 18: Optitrack. http://www.naturalpoint.com
• 19: Max/MSP. http://www.cycling74.com
• 20: GlovePie. http://carl.kenner.googlepages.com/glovepie
• 21: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 22: C. Geiger , V. Paelke , C. Reimann , W. Rosenbach , J. Stoecklein, Testable Design Representations for Mobile Augmented Reality Authoring, Proceedings of the 1st International Symposium on Mixed and Augmented Reality, p.281, September 30-October 01, 2002
• 23: C. Geiger, J. Stöcklein, T. Pflug. Towards Structured Design of Mixed Realty Content, eProceedings, HCI International 2005.
• 24: Christian Geiger , Joerg Stoecklein , Florian Klompmaker , Robin Fritze, Development of an augmented reality game by extendinga 3D authoring system, Proceedings of the international conference on Advances in computer entertainment technology, June 13-15, 2007, Salzburg, Austria [doi>10.1145/1255047.1255099]
• 25: AMIRE. http://www.amire.net/
• 26: Marc Cavazza , Jean-Luc Lugrin , Simon Hartley , Paolo Libardi , Matthew J. Barnes , Mikael Le Bras , Marc Le Renard , Louis Bec , Alok Nandi, New ways of worldmaking: the Alterne platform for VR art, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027542]
• 27: Virtools. http://www.virtools.com
• 28: CWiimote. http://www.wiili.org/index.php/CWiimote
• 29: Phantom Omni. http://www.sensable.com
• 30: DMX512-A protocol. http://www.usitt.org/standards/DMX512.html
• 31: Scott R. Klemmer , Jack Li , James Lin , James A. Landay, Papier-Mache: toolkit support for tangible input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.399-406, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985743]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Keywords:
3D authoring, hybrid user interfaces, prototyping