Exploring cues and rhythm for designing multimodal tools to support mobile users in wayfinding

ABSTRACT

In recent navigation HCI studies, the shift from investigating map-based mobile applications towards supporting mobile users' wayfinding tasks with multimodal navigation aids is apparent. While there have been many studies of navigation design guidelines for using maps or speech- or tactile-based guidance in mobile devices, in this paper we propose an initial study of multimodal navigation design utilising the theory of designing episodes of motion originating from urban planning. The implications of designing cues and providing rhythm, as the theory of episodes of motions suggests, are explored, with pedestrians as the subjects using wayfinding tasks in an urban area. The main contributions of this paper are in investigating the design principles, evaluating them in the context of mobile wayfinding tasks, and reflecting upon the results in terms of users' wayfinding behaviour. It is concluded that by designing predictive clues and rhythm into mobile multimodal navigation applications, we can improve navigation aids for users.

REFERENCES

• 1: Jörg Baus , Antonio Krüger , Wolfgang Wahlster, A resource-adaptive mobile navigation system, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502723]
• 2: Stephen Brewster , Joanna Lumsden , Marek Bell , Malcolm Hall , Stuart Tasker, Multimodal 'eyes-free' interaction techniques for wearable devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642694]
• 3: Gale, N., Golledge, R. G., Halperin, W. C. and Couclelis, H. Exploring spatial familiarity. Professional Geographer, 42, 3 (1990), 299-313.
• 4: Giuseppe Ghiani , Barbara Leporini , Fabio Paternò, Vibrotactile feedback as an orientation aid for blind users of mobile guides, Proceedings of the 10th international conference on Human computer interaction with mobile devices and services, September 02-05, 2008, Amsterdam, The Netherlands [doi>10.1145/1409240.1409306]
• 5: Golledge, R., D. (ed.) Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes. Baltimore, MD: John Hopkins Press, 1999.
• 6: Eve Hoggan , Stephen Brewster, Designing audio and tactile crossmodal icons for mobile devices, Proceedings of the 9th international conference on Multimodal interfaces, November 12-15, 2007, Nagoya, Aichi, Japan [doi>10.1145/1322192.1322222]
• 7: Simon Holland , David R. Morse , Henrik Gedenryd, AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface, Personal and Ubiquitous Computing, v.6 n.4, p.253-259, September 2002 [doi>10.1007/s007790200025]
• 8: Hund, A. M. and Minarik, J. L. Getting from here to there: spatial anxiety, wayfinding strategies, direction type and wayfinding efficiency. Spatial Cognition and Computation 6, 3 (2006), 179-201.
• 9: Lawton, C. 1994. Gender differences in wayfinding strategies: relationship to spatial ability and spatial anxiety. Journal of Sex Roles, 30, 11-12, 765-779.
• 10: Lawton, C. A. and Kallai, J. Gender differences in wayfinding strategies and anxiety about wayfinding: a cross-cultural comparison. Sex Roles, 47, 389-401.
• 11: Lynch, K. Image of the City. Cambridge, MA: Technology Press & Harvard University Press, 1960.
• 12: Mental Rotation Experiment Software (MENTROT). Available at: http://artsci.wustl.edu/~rabrams/psychlab/mentrot.htm
• 13: NASA Task Load Index (TLX). Available at: http://www.cc.gatech.edu/classes/AY2005/cs7470_fall/pap ers/TLXScale.pdf
• 14: Antti Oulasvirta , Renaud Petit , Mika Raento , Sauli Tiitta, Interpreting and acting on mobile awareness cues, Human-Computer Interaction, v.22 n.1, p.97-135, May 2007
• 15: Antti Oulasvirta , Sakari Tamminen , Virpi Roto , Jaana Kuorelahti, Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055101]
• 16: Sharon Oviatt , Rachel Coulston , Rebecca Lunsford, When do we interact multimodally?: cognitive load and multimodal communication patterns, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027957]
• 17: Schraggen, J. M. C. An experimental comparison between different types of in-car navigation information Tech. Rep. No. IZF 1991 B-1. The Netherland TNO Institute for Perception, 1991.
• 18: Stenros, H. and Aura, S. Time, Motion and Architecture. Weilin + Göös, Espoo, 1987.
• 19: Tolman, E. Cognitive maps in rats and men. Psychological Review 55 (1948), 189-208.
• 20: Thordyke, P. and Hayes-Roth, B. Differences in spatial knowledge acquired from maps and navigation, Cognitive Psychology 14 (1982), 560-589.
• 21: Tversky, B. Navigating by mind and by body. In Freksa et al. (eds.) Spatial Cognition III, Springer-Verlag, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.0 General

General Terms:
Design, Human Factors

Keywords:
human factors, mobile navigation, multimodality