Enriched human-centered multimedia computing through inspirations from disabilities and deficit-centered computing solutions

ABSTRACT

The paradigm of human-centered multimedia computing (HCMC) has emerged recently as a result of the increasing emphasis on integrating the concept of human-centeredness in various aspects of multimedia computing. While many theories have been proposed to advance this paradigm, it is our belief that a complete understanding of the issues surrounding HCMC requires capturing a complementary (yet enriching) perspective through inspirations drawn from studying human disabilities and deficits. In this paper, we present the need for understanding human deficiencies in sensory, neural, and cognitive sensing/actuations which could reveal innate components of human interaction that benefits researchers, designers and developers of new multimedia solutions. We illustrate how technologies that were started with assistive and rehabilitative goals have broader impacts to the general population. More importantly, this opens up new research issues that would otherwise not have been seen when the focus is only on the 'able' population. The study and understanding of the disabilities and deficits leads to a better understanding of human requirements in any human machine interaction which is important in advancing the vision and core principles of HCMC.

REFERENCES

• 1: Judith R. Brown , Andy van Dam , Rae Earnshaw , José Encarnação , Richard Guedj , Jennifer Preece , Ben Shneiderman , John Vince, Human-Centered Computing, Online Communities, and Virtual Environments, IEEE Computer Graphics and Applications, v.19 n.6, p.70-74, November 1999 [doi>10.1109/38.799742]
• 2: Alejandro Jaimes, Human-Centered Multimedia: Culture, Deployment, and Access, IEEE MultiMedia, v.13 n.1, p.12-19, January 2006 [doi>10.1109/MMUL.2006.8]
• 3: Alejandro Jaimes , Nicu Sebe , Daniel Gatica-Perez, Human-centered computing: a multimedia perspective, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180829]
• 4: Ahmed Elgammal, Human-centered multimedia: representations and challenges, Proceedings of the 1st ACM international workshop on Human-centered multimedia, October 27-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178745.1178751]
• 5: Alejandro Jaimes , Nicu Sebe, Multimodal human-computer interaction: A survey, Computer Vision and Image Understanding, v.108 n.1-2, p.116-134, October, 2007 [doi>10.1016/j.cviu.2006.10.019]
• 6: Joo-Ho Lee, "Human Centered Ubiquitous Display in Intelligent Space," Industrial Electronics Society, 2007. IECON 2007. 33rd Annual Conference of the IEEE, 2007, pp. 22--27.
• 7: M. Datcu and K. Seidel, "Human-centered concepts for exploration and understanding of Earth observation images," Geoscience and Remote Sensing, IEEE Transactions on, vol. 43, 2005, pp. 601--609.
• 8: Susan Rinkus , Muhammad Walji , Kathy A. Johnson-Throop , Jane T. Malin , James P. Turley , Jack W. Smith , Jiajie Zhang, Human-centered design of a distributed knowledge management system, Journal of Biomedical Informatics, v.38 n.1, p.4-17, February 2005 [doi>10.1016/j.jbi.2004.11.014]
• 9: Konstantinos Kotis , A. Vouros, Human-centered ontology engineering: The HCOME methodology, Knowledge and Information Systems, v.10 n.1, p.109-131, July 2006 [doi>10.1007/s10115-005-0227-4]
• 10: R. Riener, L. Lünenburger, and G. Colombo, "Human-centered robotics applied to gait training and assessment," Journal of Rehabilitation Research and Development, vol. 43, pp. 679--94.
• 11: A. Jaimes. Human factors in automatic image retrieval system design and evaluation. In IS&T SPIE Proceedings of SPIE, volume 6061, Internet Imaging VII, 2006.
• 12: Michele Merler, Carolina Galleguillos and Serge Belongie "Recognizing Groceries in situ Using in vitro Training Data", IEEE conf. on Computer Vision and Pattern Recognition 2007, Pages: 1--8.
• 13: Sreekar Krishna , Vineeth Balasubramanian , Narayanan Chatapuram Krishnan , Colin Juillard , Terri Hedgpeth , Sethuraman Panchanathan, A wearable wireless RFID system for accessible shopping environments, Proceedings of the ICST 3rd international conference on Body area networks, March 13-17, 2008, Tempe, Arizona
• 14: Panchanathan, S., Krishna, S., Black Jr, J.A., and Balasubramanian, V. 2008. Human centered multimedia computing: a new paradigm for the design of assistive and rehabilitative environments. In Proceedings of the IEEE International Conference on Signal Processing, Communications and Networking (Chennai, India, January 04-06, 2008). ICSCN'08. 1--7.
• 15: Russell Beale, Supporting Social Interaction with Smart Phones, IEEE Pervasive Computing, v.4 n.2, p.35-41, April 2005 [doi>10.1109/MPRV.2005.38]
• 16: Kanav Kahol , Jamieson French , Laura Bratton , Sethuraman Panchanathan, Learning and perceiving colors haptically, Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility, October 23-25, 2006, Portland, Oregon, USA [doi>10.1145/1168987.1169017]
• 17: Kanav Kahol , Priyamvada Tripathi , Troy Mcdaniel , Laura Bratton , Sethuraman Panchanathan, Modeling context in haptic perception, rendering, and visualization, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.2 n.3, p.219-240, August 06 [doi>10.1145/1152149.1152153]
• 18: K. Kahol, J. French, T. McDaniel, S. Panchanathan and M. Smith, "Augmented reality for laparoscopic surgical tool training", K. Kahol, J. French, T. McDaniel, S. Panchanathan and M. Smith, "Augmented reality for laparoscopic surgical tool training", published at HCI International Conference-Augmented Cognition, Beijing China, July 2007. pp 459--467.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design

  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

General Terms:
Design, Human Factors

Keywords:
assistive technology, human centered computing, human centered multimedia computing, rehabilitative technology