An architecture to improve the generalization of interacting device developments for accessibility

ABSTRACT

When used to support users with motor impairment, sensor-based interaction devices rely heavily on exploiting the available user movements to work properly. This implies that the design of sensor-based interaction devices depend on proper attending requirements associated with many possible disabilities. As a result, it may be necessary, for a given device, to carry out detailed personalization with respect to adjusting sensors, interaction primitives and mapping to software applications. We propose an architectural approach to support the flexible customization of sensor-based input devices so as to provide a systematic procedure to personalize input devices according to user needs. The architecture defines a model that exploits discrete and continuous input dimensions associated with sensors and allows designing novel input devices. We illustrate the use of the architecture with implementations that exploits accelerometers and gyro sensors in two input devices.

REFERENCES

• 1: A. B. Barreto , S. D. Scargle , M Adjouadi, A real-time assistive computer interface for users with motor disabilities, ACM SIGCAPH Computers and the Physically Handicapped [doi>10.1145/569270.569272]
• 2: Richard Bates , Howell Istance, Zooming interfaces!: enhancing the performance of eye controlled pointing devices, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638272]
• 3: Y.-L. Chen. Application of tilt sensors in human-computer mouse interface for people with disabilities. IEEE Trans. on Neural Systems and Rehabilitation Engineering, 9(3):289--294, 2001.
• 4: F. Corno, L. Farinetti, and I. Signorile. A cost-effective solution for eye-gaze assistive technology. In IEEE 2002 International Conference on Multimedia and Expo, pages 433--436, 2002.
• 5: Adriane B. Davis , Melody M. Moore , Veda C. Storey, Context-aware communication for severely disabled users, Proceedings of the 2003 conference on Universal usability, November 10-11, 2003, Vancouver, British Columbia, Canada
• 6: Lei Dong , Carolyn Watters , Jack Duffy, Comparing two one-handed access methods on a PDA, Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, September 19-22, 2005, Salzburg, Austria [doi>10.1145/1085777.1085819]
• 7: D. G. Evans, R. Drew, and P. Blenkhorn. Controlling mouse pointer position using and infrared head-operated joystick. IEEE Trans. on Neural Systems and Rehabilitation Engineering, 8(1):107--117, 2000.
• 8: Julie Fraser , Carl Gutwin, A framework of assistive pointers for low vision users, Proceedings of the fourth international ACM conference on Assistive technologies, p.9-16, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354329]
• 9: M. Gandy, D. Ross, and T. E. Starner. Universal design: Lessons for wearable computing. IEEE Pervasive Computing, 2(3): 19--23, 2003.
• 10: Nestor Garay-Vitoria , Julio González-Abascal, Intelligent word-prediction to enhance text input rate (a syntactic analysis-based word-prediction aid for people with severe motor and speech disability), Proceedings of the 2nd international conference on Intelligent user interfaces, p.241-244, January 06-09, 1997, Orlando, Florida, United States [doi>10.1145/238218.238333]
• 11: Paul Gnanayutham , Chris Bloor , Gilbert Cockton, Discrete acceleration and personalised tiling as brain?body interface paradigms for neurorehabilitation, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055009]
• 12: Saul Greenberg , Chester Fitchett, Phidgets: easy development of physical interfaces through physical widgets, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502388]
• 13: J. Guan, Y. Chen, and J. Lin. Designing a dual page virtual keyboard for mental speller. In Proceedings of the First International Conference on Neural Interface and Control, pages 55--59, 2005.
• 14: Simon Harper , Carole Goble , Robert Stevens , Yeliz Yesilada, Middleware to expand context and preview in hypertext, Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility, October 18-20, 2004, Atlanta, GA, USA
• 15: Ken Hinckley , Jeff Pierce , Mike Sinclair , Eric Horvitz, Sensing techniques for mobile interaction, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.91-100, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354417]
• 16: Anthony J. Hornof , Anna Cavender, EyeDraw: enabling children with severe motor impairments to draw with their eyes, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1054995]
• 17: Sanem Kabadayi , Adam Pridgen , Christine Julien, Virtual Sensors: Abstracting Data from Physical Sensors, Proceedings of the 2006 International Symposium on on World of Wireless, Mobile and Multimedia Networks, p.587-592, June 26-29, 2006 [doi>10.1109/WOWMOM.2006.115]
• 18: Simeon Keates , Faustina Hwang , Patrick Langdon , P. John Clarkson , Peter Robinson, Cursor measures for motion-impaired computer users, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638274]
• 19: Simeon Keates , Shari Trewin, Effect of age and Parkinson's disease on cursor positioning using a mouse, Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility, October 09-12, 2005, Baltimore, MD, USA [doi>10.1145/1090785.1090800]
• 20: K. Grauman, M. Betke, J. Gips, and G. Bradski. Communication via eye blinks detection and duration in real time. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1010--1017, 2001.
• 21: Scott R. Klemmer , Jack Li , James Lin , James A. Landay, Papier-Mache: toolkit support for tangible input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.399-406, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985743]
• 22: Heidi Horstmann Koester , Edmund LoPresti , Richard C. Simpson, Toward Goldilocks' pointing device: determining a "just right" gain setting for users with physical impairments, Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility, October 09-12, 2005, Baltimore, MD, USA [doi>10.1145/1090785.1090802]
• 23: Chris Law , Gregg Vanderheiden, The development of a simple, low cost set of universal access features for electronic devices, Proceedings on the 2000 conference on Universal Usability, p.118-123, November 16-17, 2000, Arlington, Virginia, United States [doi>10.1145/355460.355545]
• 24: E. LoPresti and D. M. Brienza. Adaptive sofware for head-operated computer controls. IEEE Trans. on Neural Systems and Rehabilitation Engineering, 12(1):102--111, 2004.
• 25: Edmund LoPresti , David M. Brienza , Jennifer Angelo, Computer head control software to compensate for neck movement limitations, Proceedings on the 2000 conference on Universal Usability, p.147-148, November 16-17, 2000, Arlington, Virginia, United States [doi>10.1145/355460.355551]
• 26: J. Lynds. Darci too-a computer input device for people with disabilities. In Proceedings of the Johns Hopkins National Search for Computing Applications to Assist Persons with Disabilities, pages 110--112, 1992.
• 27: Yoshiyuki Mihara , Etsuya Shibayama , Shin Takahashi, The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations, Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility, October 09-12, 2005, Baltimore, MD, USA [doi>10.1145/1090785.1090801]
• 28: Brad A. Myers , Jacob O. Wobbrock , Sunny Yang , Brian Yeung , Jeffrey Nichols , Robert Miller, Using handhelds to help people with motor impairments, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638266]
• 29: Elizabeth D. Mynatt , Irfan Essa , Wendy Rogers, Increasing the opportunities for aging in place, Proceedings on the 2000 conference on Universal Usability, p.65-71, November 16-17, 2000, Arlington, Virginia, United States [doi>10.1145/355460.355475]
• 30: Tatsuo Nakajima, How to reuse exisiting interactive applications in ubiquitous computing environments?, Proceedings of the 2006 ACM symposium on Applied computing, April 23-27, 2006, Dijon, France [doi>10.1145/1141277.1141546]
• 31: Alex Olwal , Steven Feiner, Unit: modular development of distributed interaction techniques for highly interactive user interfaces, Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia, June 15-18, 2004, Singapore [doi>10.1145/988834.988857]
• 32: F. S. Santos, M. G. Pimentel, and C. A. Teixeira. Customizationg of sensor-based input devices. In IHC'2006: Proceedings of the Brazilian Symposium on Human Factors in Computing Systems, page (short paper to appear: 4 pages), 2006.
• 33: Constantine E. Steriadis , Philip Constantinou, Designing human-computer interfaces for quadriplegic people, ACM Transactions on Computer-Human Interaction (TOCHI), v.10 n.2, p.87-118, June 2003 [doi>10.1145/772047.772049]
• 34: Shari Trewin, A study of input device manipulation difficulties, Proceedings of the second annual ACM conference on Assistive technologies, p.15-22, April 11-12, 1996, Vancouver, British Columbia, Canada [doi>10.1145/228347.228351]
• 35: Shari Trewin, An invisible keyguard, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638275]
• 36: Shari Trewin , Helen Pain, A model of keyboard configuration requirements, Proceedings of the third international ACM conference on Assistive technologies, p.173-181, April 15-17, 1998, Marina del Rey, California, United States [doi>10.1145/274497.274530]
• 37: Steven Wall , Stephen Brewster, Feeling what you hear: tactile feedback for navigation of audio graphs, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124941]
• 38: Jingtao Wang , Jennifer Mankoff, Theoretical and architectural support for input device adaptation, Proceedings of the 2003 conference on Universal usability, November 10-11, 2003, Vancouver, British Columbia, Canada
• 39: Kevin R. Wheeler , Charles C. Jorgensen, Gestures as Input: Neuroelectric Joysticks and Keyboards, IEEE Pervasive Computing, v.2 n.2, p.56-61, April 2003 [doi>10.1109/MPRV.2003.1203754]
• 40: Daniel Wigdor , Ravin Balakrishnan, TiltText: using tilt for text input to mobile phones, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.81-90, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964705]
• 41: Jacob Wobbrock , Brad Myers, Trackball text entry for people with motor impairments, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124845]
• 42: Y. wook Kim and J. hyun Cho. A novel development of head-set type computer mouse using gyro sensors for the handicapped. In 2nd Annual International IEEE-EMBS Special Topic Conference on Microtechnologies in Medicine & Biology, pages 356--359, 2002.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Design, Human Factors

Keywords:
input adaptation, input devices, input transformation