Gait alignment in mobile phone conversations

ABSTRACT

Conversation partners on mobile phones can align their walking gait without physical proximity or visual feedback. We investigate gait synchronization, measured by accelerometers while users converse via mobile phones. Hilbert transforms are used to infer gait phase angle, and techniques from synchronization theory are used to infer level of alignment. Experimental conditions include the use of vibrotactile feedback to make one conversation partner aware of the other's footsteps. Three modes of interaction are tested: reading a script, discussing a shared image and spontaneous conversation. The vibrotactile feedback loop on its own is sufficient to create synchronization, but there are complex interference effects when users converse spontaneously. Even without vibration crosstalk, synchronisation appeared for long periods in the spontaneous speech condition, indicating that users were aligning their walking behaviour from audible cues alone.

REFERENCES

• 1: Chartrand, T. L., and Bargh, J. A. The chameleon effect: The perception-behaviour link and social interaction. Journal of Personality and Social Psychology 76 (1999), 893--910.
• 2: Clark, H. H. Using language. New York: Cambridge University Press., 1996.
• 3: Condon, W., and Ogston, W. Speech and body motion synchrony of speaker-hearer The perception of language, D. Horton and J. Jenkins, Eds. Columbus, OH: Charles E. Merrill, 1971, 150--184.
• 4: Couper-Kuhlen, E. English speech rhythms. Amsterdam: John Benjamins, 1993.
• 5: Andrew Crossan , Roderick Murray-Smith , Stephen Brewster , James Kelly , Bojan Musizza, Gait phase effects in mobile interaction, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056904]
• 6: Fowler, C, A., Brown, J, M., Sabadini, L., and Weihing, J. Rapid access to speech gestures in perception: Evidence from choice and simple response time tasks. Journal of Memory and Language 49, 3 (2003), 396--413.
• 7: France, M. L. Posture mirroring and rapport Interaction Rhythms: Periodicity in communicative behaviour, M. Davis, Ed. New York: Human Sciences Press, 1982, 1--68.
• 8: Garrod, S., and Pickering, M. J. Why is conversation so easy? Trends in Cognitive Sciences 8, 1 (2004), 8--11.
• 9: Giles, H. Accent mobility: A model and some data. Anthropological Linguistics 15 (1973), 87--105.
• 10: Hughes, S., Oakley, I., and O'Modhrain, S. MESH: Supporting mobile multi-modal interfaces. ACM UIST'04. ACM (2004).
• 11: Jungers, M. K., Palmer, C., and Speer, S. R. Time after time: The coordinating influence of tempo in music and speech. Cognitive Processing 1--2 (2002), 21--35.
• 12: Vuokko Lantz , Roderick Murray-Smith, Rhythmic interaction with a mobile device, Proceedings of the third Nordic conference on Human-computer interaction, p.97-100, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028029]
• 13: McFarland, D. H. Respiratory markers of conversational interaction. Journal of Hearing and Language Research 44 (2001), 128--143.
• 14: Newtson, D. The perception and coupling of behaviour waves Dynamical systems in social psychology, R. Vallacher and A. Nowak, Eds. San Diego, CA: Academic Press, 1994, 139--167.
• 15: Pikovsky, A., Rosenblum, M., and Kurths, J. Synchronization: A universal concept in nonlinear sciences. Cambridge University Press, 2001.
• 16: Richardson, M. J., Marsh, K. L., and Schmidt, R. C. Effects of visual and verbal interaction on unintentional interpersonal coordination. Journal of Experimental Psychology: Human Perception and Performance 31, 1 (2005), 62--79.
• 17: Sellen, A. J. Remote conversations: The effects of mediating talk with technology. Human-Computer Interaction 10 (1995), 401--444.
• 18: Shockley, K., Santana, M.-V., and Fowler, C. A. Mutual interpersonal postural constraints are involved in cooperative conversation. Journal of Experimental Psychology: Human Perception and Performance 29, 2 (2003), 326--332.
• 19: ten Bosch, L., Oostdijk, N., and de Ruiter, J. P. Durational aspects of turn-taking in spontaneous face-to-face and telephone dialogues. TSD 2004. Springer-Verlag (2004), K. P. P. Sojka, I. Kopecek, Ed., LNAI 3206, 563--570.
• 20: Wilson, M., and Wilson, T. P. An oscillator model of the timing of turn-taking. Psychonomic Bulletin & Review 12, 6 (2005), 957--968.

INDEX TERMS

Keywords:
accelerometer, alignment, gait alignment, instrumented usability, mobile devices, rhythmic interaction, synchronization