Investigating touch interactions for an augmented world

ABSTRACT

Touch screen interaction usually requires the user to view the input surface in order to make their selections. When the interaction platform is purposefully occluded to allow for natural interaction with an augmented reality (AR) system new issues are raised in regard to the usability of the touch sensitive interface.

This paper details a user evaluation scenario that we have conducted looking at pen-based selection techniques for a personal, light-weight AR system and introduces a trial for manipulation testing that we are currently conducting. By testing various techniques we are identifying a combination of operations that will enable effective and usable communication with an unobtrusive, mobile AR system.

REFERENCES

• 1: Benjamin Avery , Bruce H. Thomas , Joe Velikovsky , Wayne Piekarski, Outdoor augmented reality gaming on five dollars a day, Proceedings of the Sixth Australasian conference on User interface, p.79-88, January 30-February 03, 2005, Newcastle, Australia
• 2: Sebastian Baumgärtner , Achim Ebert , Matthias Deller , Stefan Agne, 2D meets 3D: a human-centered interface for visual data exploration, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1240993]
• 3: William Buxton, A three-state model of graphical input, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.449-456, August 27-31, 1990
• 4: Nguyen Thong Dang , Monica Tavanti , Ivan Rankin , Matthew Cooper, A comparison of different input devices for a 3D environment, Proceedings of the 14th European conference on Cognitive ergonomics: invent! explore!, August 28-31, 2007, London, United Kingdom [doi>10.1145/1362550.1362581]
• 5: Jane Hwang , Jaehoon Jung , Gerard Jounghyun Kim, Hand-held virtual reality: a feasibility study, Proceedings of the ACM symposium on Virtual reality software and technology, November 01-03, 2006, Limassol, Cyprus [doi>10.1145/1180495.1180568]
• 6: I. Scott MacKenzie , Aleks Oniszczak, A comparison of three selection techniques for touchpads, Proceedings of the SIGCHI conference on Human factors in computing systems, p.336-343, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274691]
• 7: I. Scott MacKenzie , Abigail Sellen , William A. S. Buxton, A comparison of input devices in element pointing and dragging tasks, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.161-166, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108868]
• 8: Nielsen, M., Kramp, G., & Grøønbæk, K. (2004). Mobile Augmented Reality Support for Architects based on Feature Tracking Techniques. Proc. ICCS'04. Springer, pp 921--928.
• 9: Alex Olwal , Steven Feiner , Susanna Heyman, Rubbing and tapping for precise and rapid selection on touch-screen displays, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357105]
• 10: Wayne Piekarski , Bruce H. Thomas, Tinmith-Mobile Outdoor Augmented Reality Modelling Demonstration, Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality, p.317, October 07-10, 2003
• 11: R. L. Potter , L. J. Weldon , B. Shneiderman, Improving the accuracy of touch screens: an experimental evaluation of three strategies, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-32, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57171]
• 12: Reitmayr, G., et. al. (2005). iOrb -- Unifying Command and 3D Input for Mobile Augmented Reality. Proc. IEEE VR 2005 Workshop on New Directions in 3D User Interfaces, ACM.
• 13: Reitmayr, G., & Schmalstrieg, D. (2001). Mobile Colaborative Augmented Reality. Proc. ISAR'01, ACM, pp. 114--123.
• 14: Xiangshi Ren , Shinju Moriya, Improving selection performance on pen-based systems: a study of pen-based interaction for selection tasks, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.3, p.384-416, Sept. 2000 [doi>10.1145/355324.355328]
• 15: Daniel Vogel , Patrick Baudisch, Shift: a technique for operating pen-based interfaces using touch, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240727]
• 16: Daniel Wagner , Dieter Schmalstieg, First Steps Towards Handheld Augmented Reality, Proceedings of the 7th IEEE International Symposium on Wearable Computers, p.127, October 21-23, 2003
• 17: Ka-Ping Yee, Peephole displays: pen interaction on spatially aware handheld computers, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642613]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Experimentation, Human Factors, Measurement, Performance, Reliability

Keywords:
augmented reality, convergence, portable devices, private scope, touch interaction, unobtrusive, user testing