Automatically generating user interfaces adapted to users' motor and vision capabilities

ABSTRACT

Most of today's GUIs are designed for the typical, able-bodied user; atypical users are, for the most part, left to adapt as best they can, perhaps using specialized assistive technologies as an aid. In this paper, we present an alternative approach: SUPPLE++ automatically generates interfaces which are tailored to an individual's motor capabilities and can be easily adjusted to accommodate varying vision capabilities. SUPPLE++ models users. motor capabilities based on a onetime motor performance test and uses this model in an optimization process, generating a personalized interface. A preliminary study indicates that while there is still room for improvement, SUPPLE++ allowed one user to complete tasks that she could not perform using a standard interface, while for the remaining users it resulted in an average time savings of 20%, ranging from an slowdown of 3% to a speedup of 43%.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, Refining Fitts' law models for bivariate pointing, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642646]
• 2: Denis K. Anson, Alternative Computer Access: A Guide to Selection, Davis F A, 1996
• 3: Eric Bergman , Earl Johnson, Toward accessible human-computer interaction, Advances in human-computer interaction (vol. 5), Ablex Publishing Corp., Norwood, NJ, 1995
• 4: Scott Carter , Amy Hurst , Jennifer Mankoff , Jack Li, Dynamically adapting GUIs to diverse input devices, Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility, October 23-25, 2006, Portland, Oregon, USA [doi>10.1145/1168987.1169000]
• 5: Chicowski, E. It's all about access. Alaska Airlines Magazine, 28(12):26--31, 80--82, 2004.
• 6: Melissa Dawe, Desperately seeking simplicity: how young adults with cognitive disabilities and their families adopt assistive technologies, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124943]
• 7: Fichten, C., M. Barile, J. Asuncion, and M. Fossey. What government, agencies, and organizations can do to improve access to computers for postsecondary students with disabilities: recommendations based on Canadian empirical data. Int J Rehabil Res, 23(3):191--9, 2000.
• 8: Krzysztof Gajos , Daniel S. Weld, SUPPLE: automatically generating user interfaces, Proceedings of the 9th international conference on Intelligent user interfaces, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964461]
• 9: Krzysztof Gajos , Daniel S. Weld, Preference elicitation for interface optimization, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095063]
• 10: Gajos, K., A. Wu, and D. S. Weld. Cross-device consistency in automatically generated user interfaces. In Proceedings of Workshop on Multi-User and Ubiquitous User Interfaces (MU3I'05), 2005.
• 11: Peter Gregor , Alan F. Newell , Mary Zajicek, Designing for dynamic diversity: interfaces for older people, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638277]
• 12: Tovi Grossman , Ravin Balakrishnan, A probabilistic approach to modeling two-dimensional pointing, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.3, p.435-459, September 2005 [doi>10.1145/1096737.1096741]
• 13: Gump, A., M. LeGare, and D. L. Hunt. Application of fitts' law to individuals with cerebral palsy. Percept Mot Skills, 94(3 Pt 1):883--895, June 2002.
• 14: Susumu Harada , James A. Landay , Jonathan Malkin , Xiao Li , Jeff A. Bilmes, The vocal joystick:: evaluation of voice-based cursor control techniques, Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility, October 23-25, 2006, Portland, Oregon, USA [doi>10.1145/1168987.1169021]
• 15: Hastie, T., R. Tibshirani, and J. H. Friedman. The Elements of Statistical Learning. Springer, August 2001.
• 16: Anthony Hornof , Anna Cavender , Rob Hoselton, Eyedraw: a system for drawing pictures with eye movements, Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility, October 18-20, 2004, Atlanta, GA, USA
• 17: Faustina Hwang , Simeon Keates , Patrick Langdon , John Clarkson, Mouse movements of motion-impaired users: a submovement analysis, Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility, October 18-20, 2004, Atlanta, GA, USA
• 18: International Organization for Standardization. 9241-9 Ergonomic requirements for office work with visual display terminals (VDTs)-Part 9: Requirements for non-keyboard input devices, 2000.
• 19: Keates, S., P. Clarkson, L. Harrison, and P. Robinson. Towards a practical inclusive design approach. ACM Press New York, NY, USA, 2000.
• 20: Koester, H. Abandonment of speech recognition by new users. Proc. RESNA'03, 2003.
• 21: Sri Kurniawan , Alasdair King , David Gareth Evans , Paul Blenkhorn, Design and user evaluation of a joystick-operated full-screen magnifier, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642618]
• 22: Law, C., A. Sears, and K. Price. Issues in the categorization of disabilities for user testing. Proc. HCI Intl., 2005.
• 23: Mace, R., G. Hardie, P. Jaine, and N. C. S. U. C. for Universal Design. Accessible Environments: Toward Universal Design. Center for Accessible Housing, North Carolina State University, 1990.
• 24: I. Scott MacKenzie , William Buxton, Extending Fitts' law to two-dimensional tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, p.219-226, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142794]
• 25: Jeffrey Nichols , Brad A. Myers , Michael Higgins , Joseph Hughes , Thomas K. Harris , Roni Rosenfeld , Mathilde Pignol, Generating remote control interfaces for complex appliances, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572008]
• 26: Phillips, B. and H. Zhao. Predictors of assistive technology abandonment. Assist Technol, 5(1):36--45, 1993.
• 27: Scott, I. U., W. J. Feuer, and J. A. Jacko. Impact of graphical user interface screen features on computer task accuracy and speed in a cohort of patients with age-related macular degeneration. Am. J. of Ophthalmology, 134(6):857--862, December 2002.
• 28: A. Sears, Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout, IEEE Transactions on Software Engineering, v.19 n.7, p.707-719, July 1993 [doi>10.1109/32.238571]
• 29: Smits-Engelsman, B., Rameckers, E., Duysens, and J. Children with congenital spastic hemiplegia obey fitts law in a visually guided tapping task. Experimental Brain Research, 177(4):431--439, March 2007.
• 30: Constantine Stephanidis, Towards the Next Generation of UIST: Developing for all Users, Proceedings of the Seventh International Conference on Human-Computer Interaction-Volume 1, p.473-476, August 24-29, 1997

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Additional Classification:
  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

General Terms:
Algorithms, Human Factors

Keywords:
decision theory, motor impairments, multiple impairments, optimization, supple, vision impairments