Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Measuring a user's level of cognitive load while they are interacting with the system could offer another dimension to the development of adaptable user interfaces. High levels of cognitive load affect performance and efficiency. However, current methods of measuring cognitive load are physically intrusive and interrupt the task flow. Certain speech features have been shown to change under high levels of load and are good candidates for cognitive load indices for usability evaluation and automatic adaptation of an interface or work environment. A speech-based dual-task user study is presented in which we explore the behaviour of speech pause features in natural speech. The experiment yielded new results confirming that speech pauses are useful indicators of high load versus low load speech. We report an increase in the percentage of time spent pausing from low load to high load tasks. We interpret these results within the framework of Baddeley's modal model of working memory and detail how such a measure could be utilized in the cognitive load measurement.

REFERENCES

• 1: M. Asif Khawaja , Natalie Ruiz , Fang Chen, Potential speech features for cognitive load measurement, Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces, November 28-30, 2007, Adelaide, Australia [doi>10.1145/1324892.1324902]
• 2: Chandler, P. and Sweller, J. "Cognitive load theory and the format of instruction." Cognition and Instruction, Vol 8, pp. 293--332.
• 3: Paas, F., Tuovinen, J. E., Tabbers, H., and Gerven, P. W. M. V. "Cognitive Load Measurement as a Means to Advance Cognitive Load Theory." Educational Psychologist, 38, 1 (2003), 63--71.
• 4: Richard E. Mayer, Multimedia Learning, Cambridge University Press, New York, NY, 2001
• 5: André Berthold , Anthony Jameson, Interpreting symptoms of cognitive load in speech input, Proceedings of the seventh international conference on User modeling, p.235-244, June 1999, Banff, Canada
• 6: Schilperoord J.; "On the Cognitive Status of Pauses in Discourse Production" In T. Olive & C. M. Levy (Eds.), Contemporary tools and techniques for studying writing, Vol. 10, pp. 61--88. London: Kluwer Academic Publishers, 2001.
• 7: Christian Müller , Barbara Großmann-Hutter , Anthony Jameson , Ralf Rummer , Frank Wittig, Recognizing Time Pressure and Cognitive Load on the Basis of Speech: An Experimental Study, Proceedings of the 8th International Conference on User Modeling 2001, p.24-33, July 13-17, 2001
• 8: Kramer, A. F., "Physiological metrics of mental workload: a review of recent progress," in Multiple-task performance, Damos, D. L., Ed. London: Taylor and Francis, 1991, pp. 279--328.
• 9: Sharon Oviatt, Ten myths of multimodal interaction, Communications of the ACM, v.42 n.11, p.74-81, Nov. 1999 [doi>10.1145/319382.319398]
• 10: Sharon Oviatt , Antonella DeAngeli , Karen Kuhn, Integration and synchronization of input modes during multimodal human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258821]
• 11: Bo Yin , Natalie Ruiz , Fang Chen , M. Asif Khawaja, Automatic cognitive load detection from speech features, Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces, November 28-30, 2007, Adelaide, Australia [doi>10.1145/1324892.1324946]
• 12: Kahneman, D., "Attention and effort", U.S.A: Prentice Hall, 1973.
• 13: Lennon C. and Burdick H.; "The Lexile Framework as an Approach for Reading Measurement and Success"; A white paper from The Lexile Framework for Reading, April 2004; http://www.Lexile.com; Last accessed: July 2008.
• 14: Dechert, Hans W. & Raupach, M.; "Towards a Cross-Linguistic Assessment of Speech Production." Frankfurt: Lang. 1980.
• 15: Schilperoord, J.; "It's about time: Temporal aspects of cognitive processes in text production."; Amsterdam/Atlanta: Rodopi, 1996.
• 16: Baddeley A., "Working Memory", Science, Vol. 255, pp. 556--559, 1992.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Experimentation, Measurement, Performance

Keywords:
cognitive load, measurement, pauses, speech features