Adaptive personalisation for researcher-independent brain body interface usage

ABSTRACT

In this case study, we report what we believe to be the first prolonged in-situ use of a brain-body interface for rehabilitation of individuals with severe neurological impairment due to traumatic brain injury with no development researchers present. We attribute this success to the development of an adaptive cursor acceleration algorithm based on screen tiling, which we combined with an adaptable user interface to achieve inclusive design through personalisation for each individual. A successful evaluation of this approach encouraged us to leave our Brain-Body Interface in the care settings of our evaluation participants with traumatic brain injury, where it was used with support from health care professionals and other members of participants' care circles

REFERENCES

• 1: Akoumianakis, D., Savidis, A. and Stephanidis, C., 2000. Encapsulating Intelligent Interactive Behaviour in Unified User Interface Artefacts, Interacting with Computers, 12, 383--408.
• 2: Barea, R., Boquete, L., Mazo, M., López, E. and Bergasa, L.M., 2000. E.O.G. guidance of a wheel chair using neural networks, IEEE Computer Society, Vol.4, 668--671.
• 3: A. B. Barreto , S. D. Scargle , M Adjouadi, A real-time assistive computer interface for users with motor disabilities, ACM SIGCAPH Computers and the Physically Handicapped [doi>10.1145/569270.569272]
• 4: Bayliss, J. D., 2003. The use of the P3 evoked potential component for control in a virtual apartment, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11(2), June 2003.
• 5: Beverina, F., Palmas, G., Silvoni, S., Piccione, F., Glove, S., 2003. User Adaptive BCIs: SSVEP and P300 based Interfaces, 2003, PsychNology Journal, 1(4), 331 354.
• 6: Birbaumer, N., 2003a. The Thought Translation Device: A Brain-Computer Interface for Paralyzed, ISPRM - 2nd World Congress, May 2003, Prague, 117--121.
• 7: Birbaumer, N., Hinterberger, T., Kübler, A., Neumann, N., (2003b), The Thought Translation Device (TTD): Neurobehavioral Mechanisms and Clinical Outcome, IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. 11(2), June 2003.
• 8: Birbaumer, N., Hinterberger, T., Kübler, A., Neumann, N., (2003b), The Thought Translation Device (TTD): Neurobehavioral Mechanisms and Clinical Outcome, IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. 11(2), June 2003.
• 9: Brown, M., Communications via email, 9th August 2008.
• 10: Ashley Craig , Les Kirkup , Paul McIsaac , Andrew Searle, The Mind As A Reliable Switch: Challenges Of Rapidly Controlling Devices Without Prior Learning, Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.4-10, July 14-18, 1997
• 11: Craig, A., McIsaac P., Tran Y., Kirkup L. and Searle A. 1999. Alpha Wave Reactivity Following Eye Closure: A Potential Method of Remote Hands Free Control for the Disabled, Technology and Disability, Vol. 10, 1999, 187--194.
• 12: Eamon Doherty , Gilbert Cockton , Chris Bloor , Dennis Benigno, Improving the performance of the cyberlink mental interface with “yes / no program”, Proceedings of the SIGCHI conference on Human factors in computing systems, p.69-76, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365038]
• 13: Donchin, E., Spencer, K. M. and Wijesinghe, R., 2000. The Mental Prosthesis: Assessing the Speed of a P300-Based Brain-Computer Interface, IEEE Transactions on Rehabilitation Engineering, 8(2), June 2000, 174--179.
• 14: Einarsdottir, T., (2008), Communications via email, 11th September 2008.
• 15: Gnanayutham, P. 2008. Interaction Paradigms for Brain-Body Interfaces for Computer Users with Brain Injuries, PhD Thesis, University of Sunderland.
• 16: Paul Gnanayutham, Assistive technologies for traumatic brain injury, ACM SIGACCESS Accessibility and Computing [doi>10.1145/1055680.1055684]
• 17: Gnanayutham, P. 2004b. The State of Brain Body Interface Devices. UsabilityNews, http://www.usabilitynews.com/, accessed October 2008.
• 18: Gnanayutham, P. and George, J. 2007. Inclusive Design for Brain Body Interfaces. In Foundations of Augmented Cognition 3rd Edition -- Proceedings of the 3rd International Conference on Augmented Cognition in the context of HCI International 2007 Conference, eds. D. Schmorrow and L. Reeves, 102--111 (LNAI 4565). Berlin: Springer
• 19: Gnanayutham, P., Bloor, C. and Cockton, G. 2003. AI to enhance a brain computer interface. In Universal Access in HCI: Inclusive Design in the Information Society - Volume 4 of the Proceedings of the 10th International Conference on Human-Computer Interaction (HCI International 2003), ed. C. Stephanidis, 1397--1401. Mahwah, NJ: Lawrence Erlbaum Associates.
• 20: Paul Gnanayutham , Chris Bloor , Gilbert Cockton, Discrete acceleration and personalised tiling as brain?body interface paradigms for neurorehabilitation, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055009]
• 21: Harrison, R. R., Santhanam, G., Krishna, V., Shenoy, K., 2004. Local Field Potential Measurement with Low-Power Analogue Integrated Circuit, International Conference of the IEEE EMBS, September 2004, San Francisco, 4067--4070.
• 22: Hinterberger, T., Wilhelm, B., Mellinger, J. Kotchoubey, B. and Birbaumer, N., 2005. A device for the detection of cognitive brain functions in completely paralyzed or unresponsive patients, Biomedical Engineering, IEEE Transactions, 52(2), February 2005, 211--220.
• 23: J. Kalcher , D. Flotzinger , S. Gölly , Ch. Neuper , G. Pfurtscheller, Graz Brain-Computer Interface (BCI) II, Proceedings of the 4th international conference on Computers for handicapped persons, p.170-176, September 1994, Vienna, Austria
• 24: Keirn, A. and Aunon, J. 1990. Man-Machine Communication Through Brainwave Processing. IEEE Engineering in Medicine and Biology Magazine 9(1): 55--57.
• 25: Kennedy, J. 1999. Preparing Your Laboratory Report, http://www.psywww.com/tipsheet/labrep.htm, accessed 1st June 2007.
• 26: Kennedy, P. R., Adams K., Bakay R. A. E., Goldwaithe J. and Moore M. 2000. Direct Control of a computer from the Human Central Nervous System. IEEE Transactions on Rehabilitation Engineering 8(2): 198--202.
• 27: Kennedy, P., Adams K., Bakay R., Goldwaithe J., Montgomery G. and Moore M. 1999. Direct Control of a computer from the Human Central Nervous System, Brain Computer Interface Technology Theory and Practice First International Meeting Program and Papers, June 16-20, 1999, Renselaerville, New York, 65--70.
• 28: Kostov, A. and Polak, M. 2000. Parallel Man-Machine Training in Development of EEG-based Cursor Control, IEEE Transactions on Rehabilitation Engineering, 8(2), June 2000, 203--205.
• 29: Kostov A. and Polak M. 1997a. Brain-Computer Interface: Development of Experimental Setup, Resna 97 Proceedings, June 1997, 54--56.
• 30: Kostov A. and Polak M. 1997b. Prospects of Computer Access Using Voluntary Modulated EEG Signal, Brain & Consciousness Proceedings EPCD Symposium, Belgrade, Yugoslavia, 22-23, September 1997, 233--236.
• 31: Lal, T.N., Hinterberger, T., Widman, G., Schröder, M., Hill, N.J., Rosenstiel, W., Elger, C.E., Schölkopf, B. and Birbaumer, N. 2005. Saul, L.K., Weiss, Y., Bottou, L., (Eds.), Methods Towards Invasive Human Brain Computer Interfaces. Advances in Neural Information Processing Systems 17, MIT Press, Cambridge, MA, USA (2005), 737--744.
• 32: Levine, S.P., Huggins, J. E., BeMent, S. L., Rohde, M. M., Passaro, E. A., Kushwaha, R.K., Schuh, L.A., Ross, D. A., Elisevich, K. V. and Smith, B.J. 1999. A direct brain interface based on event related potential, IEEE Transaction Rehabilitation Engineering, 8(2), 180--185.
• 33: Lusted, H. and Knapp R. 1996. Controlling Computers with Neural Signals, Scientific American, October 1996, 58--63.
• 34: Miner, L. A., McFarland D. J. and Wolpaw J. R. 1998. Answering Questions With an Electroencephalogram-Based Brain-Computer Interface, Archives of Physical Medical and Rehabilitation, 79(9), September 1998, 1029--33.
• 35: Maurice R. Masliah , Paul Milgram, Measuring the allocation of control in a 6 degree-of-freedom docking experiment, Proceedings of the SIGCHI conference on Human factors in computing systems, p.25-32, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332403]
• 36: Musallam, S., Corneil, B.D., Greger, B., Scherberger, H. and Anderson, R.A. 2004. Cognitive Control Signals for Neural Prosthetics, Science, Vol.305, July 2004, 258--262.
• 37: Karla Felix Navarro, Wearable, Wireless Brain Computer Interfaces In Augmented Reality Environments, Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'04) Volume 2, p.643, April 05-07, 2004
• 38: Neuper, C., Schlögl, A. and Pfurtscheller, G. 1999. Enhancement of Left-Right Sensorimotor EEG Differences During Feedback-Regulated Motor Imagery, Journal of Clinical Neurophysiology, 16(4), Lippincott Williams & Wilkins, Philadelphia,
• 39: Pfurtscheller, G. and Neuper, C. 2001. Motor Imagery and Direct Brain-Computer Communication, Proceedings of the IEEE, 89(7), July 2001, 1123--1134.
• 40: Reinhold S, R., Schloegl, A., Lee, F., Bischof, H., Jan Çsa, J., Pfurtscheller, G., (2007), The Self-Paced Graz Brain-Computer Interface: Methods and Applications, Computational Intelligence and Neuroscience Volume 2007, Article ID 79826.
• 41: Schalk, G., McFarland, D.J., Hinterberger, T., Birbaumer, N. and Wolpaw, J.R. 2004. BCI2000: A General-Purpose Brain-Computer Interface (BCI) System, IEEE Transactions on Biomedical Engineering, 51(6), June 2004, 1034--1043.
• 42: Egbert Schlungbaum, Individual user interfaces and model-based user interface software tools, Proceedings of the 2nd international conference on Intelligent user interfaces, p.229-232, January 06-09, 1997, Orlando, Florida, United States [doi>10.1145/238218.238330]
• 43: Schneider-Hufschmidt, M., Kuhme, T., Malinowski, U., (Eds.), (1993), Adaptive User Interfaces: Principles and Practice, Elsevier Science Publishers, Netherlands, 1-9, 149--165, 331--336.
• 44: Vaughan, M. T., Heetderks, W. J., Trejo, L. J., Rymer, W. Z., Weinrich, M., Moore, M., Kübler, A., Dobkin, B. H., Birbaumer, N., Donchin, E., Wolpaw, E. W., Wolpaw, J., (2003), Brain-Computer Interface Technology: A Review of the Second International Meeting, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11(2), June 2003, 94--109.
• 45: Weiskopf, N., Veit, R., Mathiak, K., Grodd, W., Goebel, R. and Birbaumer, N. 2003. Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data, NeuroImage, Vol.19, 2003, 577--586.
• 46: Wolpaw, J. R., Flotzinger, D., Pfurtscheller, G. and McFarland, D. 1997. Timing of EEG Based Cursor Control. Journal of Clinical Neurophysiology 14(6): 529--538.
• 47: Wolpaw J. R. and McFarland D. J. 1994. Multi-channel EEG-Based Brain-Computer Communication, Electroencephalography and Clinical Neurophysiology, Vol. 90, 1994, Elsevier Scientific Publishers, 444--449.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Auditory (non-speech) feedback

  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES

General Terms:
Algorithms, Human Factors

Keywords:
assistive technology., brain-body interfaces, brain-computer interfaces, cyberlink?, neurorehabilitation