Using a low-cost electroencephalograph for task classification in HCI research

ABSTRACT

Modern brain sensing technologies provide a variety of methods for detecting specific forms of brain activity. In this paper, we present an initial step in exploring how these technologies may be used to perform task classification and applied in a relevant manner to HCI research. We describe two experiments showing successful classification between tasks using a low-cost off-the-shelf electroencephalograph (EEG) system. In the first study, we achieved a mean classification accuracy of 84.0% in subjects performing one of three cognitive tasks - rest, mental arithmetic, and mental rotation - while sitting in a controlled posture. In the second study, conducted in more ecologically valid setting for HCI research, we attained a mean classification accuracy of 92.4% using three tasks that included non-cognitive features: a relaxation task, playing a PC based game without opponents, and engaging opponents within the game. Throughout the paper, we provide lessons learned and discuss how HCI researchers may utilize these technologies in their work.

REFERENCES

• 1: Anderson, C. W., & Sijerččić, Z. (1996). Classification of EEG Signals from Four Subjects During Five Mental Tasks. Proceedings of the Conference on Engineering Applications in Neural Networks, 407--414.
• 2: Brainmaster. http://www.brainmaster.com.
• 3: Daniel Chen , Roel Vertegaal, Using mental load for managing interruptions in physiologically attentive user interfaces, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986103]
• 4: Coyle, S., Ward, T., & Markham, C. (2003). Brain-computer interfaces: A review. Interdisciplinary Science Reviews, 28(2), 112--118.
• 5: Cutmore, T. R. H, & James, D. A. (1999). Identifying and Reducing Noise in Physiological Recordings. International Journal of Psychophysiology, 32, 129--150.
• 6: Usama M. Fayyad , Keki B. Irani, On the Handling of Continuous-Valued Attributes in Decision Tree Generation, Machine Learning, v.8 n.1, p.87-102, Jan. 1992 [doi>10.1023/A:1022638503176]
• 7: Fisch, B. J. (2005). Fisch & Spehlmann's EEG primer: Basic principles of digital and analog EEG. Amsterdam: Elsevier.
• 8: Fitzgibbon, S. P., Pope, K. J., Mackenzie, L., Clark, C. R., & Willoughby, J. O. (2004). Cognitive tasks augment gamma EEG power. Clinical Neurophysiology, 115, 1802--1809.
• 9: James Fogarty , Andrew J. Ko , Htet Htet Aung , Elspeth Golden , Karen P. Tang , Scott E. Hudson, Examining task engagement in sensor-based statistical models of human interruptibility, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055018]
• 10: Gevins, A., Leong, H., Du, R., Smith, M. E., Le, J., DuRousseau, D., Zhang, J., & Libove, J. (1995). Towards measurement of brain function in operational environments. Biological Physiology, 40, 169--186.
• 11: Gevins, A. S., & Remond, A. (1987). Handbook of Electroencephalography and Clinical Neurophysiology: Methods of analysis of brain electrical and magnetic signals. Amsterdam: Elsevier.
• 12: Gevins, A. S., Zeitlin, J. C., Doyle, J. C., Schaffer, R. E., & Callaway, E. (1979). EEG patterns during 'cognitive' tasks. II. Methodology and analysis of complex behaviors. Electroencephalography and Clinical Neurophysiology, 47, 704--710.
• 13: Keirn, Z. A., & Aunon, J. I. (1990). A new mode of communication between man and his surroundings. IEEE Transactions on Biomedical Engineering, 37(12), 1209--1214.
• 14: Yoshifumi Kitamura , Yoshihisa Yamaguchi , Imamizu Hiroshi , Fumio Kishino , Mitsuo Kawato, Things happening in the brain while humans learn to use new tools, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642684]
• 15: Kramer, A. F. (1991). Physiological metrics of mental workload: A review of recent progress. In Multiple Task Performance (ed. Damos, D.L.), 279--328.
• 16: Mason, S. G., & Birch, G. E. (2003). A general framework for brain-computer interface design. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11(1), 70--85.
• 17: José del R. Millán, Adaptive brain interfaces, Communications of the ACM, v.46 n.3, p.74-80, March 2003 [doi>10.1145/636772.636773]
• 18: OpenEEG Project. http://openeeg.sourceforge.net.
• 19: Palaniappan, R. (2005). Brain computer interface design using band powers extracted during mental tasks. Proceedings of the 2nd International IEEE EMBS Conference on Neural Engineering, 321--324.
• 20: Picton, T. W., Bentin, P., Berg, P., Hillyard, S. A., Johnson, J. R., Miller, G. A., et al. (2000). Guidelines for using human event-related potentials to study cognition: Recording standards and publication criteria. Psychophysiology, 37, 127--152.
• 21: Smith, R. C. (2004). Electroencaphalograph based brain computer interfaces. Masters Dissertation, University College Dublin.
• 22: Boris M. Velichkovsky , John Paulin Hansen, New technological windows into mind: there is more in eyes and brains for human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.496-503, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238619]
• 23: van Boxtel, G. J. M. (1998). Computational and statistical methods for analyzing event-related potential data. Behavior Research Methods, Instruments, & Computers, 30(1), 87--102.
• 24: Witten, I. H., & Frank, E. (2005). Data mining: Practical machine learning tools and techniques (2nd Edition), San Francisco: Morgan Kaufmann.
• 25: Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughn, T. M. (2002). Brain-computer interfaces for communication and control. Clinical Neurophysiology, 113, 767--791.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems

Additional Classification:
  B. Hardware
  B.4 INPUT/OUTPUT AND DATA COMMUNICATIONS
      B.4.2 Input/Output Devices
          Subjects: Channels and controllers

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES

General Terms:
Experimentation, Human Factors

Keywords:
brain-computer interface, electroencephalogram (EEG), human cognition, physical artifacts, task classification