A real-time assistive computer interface for users with motor disabilities

ABSTRACT

This study introduces the design of an integrated assistive real-time system developed as an alternate input device to computers that can be used by individuals with severe motor disabilities. An assistive technology device as defined by the Assistive Technology Act of 1998 is "any item, piece of equipment, or product system, whether acquired commercially, modified, or customized, that is used to increase, maintain, or improve the functional capabilities of individuals with disabilities". The proposed real-time system design utilizes electromyographic (EMG) biosignals from cranial muscles and electroencephalographic (EEG) biosignals from the cerebrum's occipital lobe, which are transformed into controls for two-dimensional (2-D) cursor movement, the Left-Click (Enter) command, and an ON/OFF switch for the cursor-control functions. This HCI system classifies biosignals into "mouse" functions by applying amplitude thresholds and performing power spectral density (PSD) estimations on discrete windows of data, Spectral power summations are aggregated over several frequency bands between 8 and 500 Hz and then compared to produce the correct classification. The result is an affordable DSP-based system that, when combined with an on-screen keyboard, enables the user to fully operate a computer without using any extremities.

REFERENCES

• 1: Assistive Technology Act of 1998, Public Law 105-394, 105th Congress, November 13, 1998.
• 2: Electronic Industries Assoc. Standards Publication "EIA 232E---Interface Between Data Terminal Equipment and Data Circuit-Terminating Equipment Employing Serial Binary Data Interchange".
• 3: Foulds R., Arthur J., and Khan A., "Human Factors Studies in Eye Movements Related to AAC Head Movement Studies", Rehab. R&D 1996 Progress reports, Vol. 34, pp. 155-156, May 1997.
• 4: Gaarder, K. R., "Eye Movements, Vision and Behavior", Hemisphere Publishing Corporation, Washington, D. C., 1975.
• 5: Robert J. K. Jacob, The use of eye movements in human-computer interaction techniques: what you look at is what you get, ACM Transactions on Information Systems (TOIS), v.9 n.2, p.152-169, April 1991 [doi>10.1145/123078.128728]
• 6: Jasper H. H., Penfield W., "Electrocorticograms in Man: Effect of the Voluntary Movement upon the Electrical Activity of the Precentral Gyrus", Archives Psychiat. Z. Neurol., Vol. 183, 1949.
• 7: Jasper H., "The Ten --- Twenty Electrode System of the International Federation", Electroencephalography and Clinical Neurophysiology, EEG Journal, Vol. 10, (Appendix), 1958.
• 8: Junker Andrew, "Brain-Body Actuated System", United States Patent, 5,474,082, December 12, 1995.
• 9: LeVeau B. and Andersson G., "Output Forms: Data Analysis and Applications. Interpretation of the Electromyographic Signal", Selected Topics in Surface Electromyography for Use in the Occupational Setting: Expert Perspectives, U.S, Department of Health and Human Services, NIOSH Pub. No. 91-100, March 1992.
• 10: Lynch, W. J., "Hardware update: The Eyegaze Computer System™", Journal of Head Trauma Rehabilitation, 9(4): 77-80, 1994.
• 11: National Spinal Cord Injury Association, "Factsheet #2: Spinal Cord Injury Statistics", 1995-98.
• 12: Gert Pfurtscheller , Doris Flotzinger , Joachim Kalcher, Brain-computer interface: a new communication device for handicapped persons, Journal of Microcomputer Applications, v.16 n.3, p.293-299, July 1993 [doi>10.1006/jmca.1993.1030]
• 13: Pfurtscheller G., Flotzinger D., Pregenzer M., Wolpaw J. R., McFarland D., "EEG-based Brain Computer Interface (BCI)", Medical Progress through technology, Vol. 21, 1996.
• 14: Riviere, C. N. and Thakor, N. V., "Effects of Age and Disability on tracking tasks with a computer mouse: accuracy and linearity", Journal of Rehabilitation Research and Development, Vol. 33, No. 1, pp. 6-15, February 1996.
• 15: Chris Salem , Shumin Zhai, An isometric tongue pointing device, Proceedings of the SIGCHI conference on Human factors in computing systems, p.538-539, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.259021]
• 16: Sax C., Fisher D., and Pumpian I., "Outcomes of Students with Severe Disabilities: Case Studies on the Use of Assistive Tech. in Inclusive Classrooms", Technol Disabil, Vol. 5, pp. 327-334, 1996.
• 17: Scargle, S., "EMG/EEG HCI System for Computer-Cursor Control", Masters Thesis, Florida International University, 1998.
• 18: Taberner, A, M. and Barreto, A. B., "Real-Time Signal Processing Towards an EEG-Based Human-Computer Interface", Proceedings of the 1997 Florida Conference on Recent Advances in Robotics, 1997, Miami, FL, pp. 56 - 60.
• 19: Webster John G., Editor, Medical Instrumentation: Application and Design, 3rd Ed., Houghton Mifflin Company, Boston: 1998.
• 20: A. M. Taberner and A. B. Barreto, "Real-Time Signal Processing Towards an EEG-Based Human-Computer Interface", Proceedings of the 1997 Florida Conference on Recent Advances in Robotics, 1997, Miami, FL, pp. 56 - 60.
• 21: Wolpaw J. R., McFarland D., Neat G. W., Forneris C. A., "Multichannel EEG-based Brain --- Computer Communication", Electroencephalography & Clinical Neurophysiology, Vol. 78, 1991.