A user evaluation of the SADIe transcoder

ABSTRACT

The World Wide Web (Web) is a visually complex, dynamic, multimedia system that can be inaccessible to people with visual impairments. SADIe addresses this problem by using Semantic Web technologies to explicate implicit visual structures through a combination of an upper and lower ontology. This is then used to apply transcoding to a range of Websites. This paper describes a user evaluation that was performed using the SADIe system. Four users were presented with a series of Web pages, some having been adapted using SADIe's transcoding functionality and others retaining in their original state. The results of the evaluation showed that providing answers to a fact based question could be achieved more quickly when the information on the page was exposed via SADIe's transcoding. The data obtained during the experiment was analysed and shown to be statistically significant. This suggests that the transcoding techniques offered by SADIe can assist visually impaired users accessing content on the Web.

REFERENCES

• 1: Chieko Asakawa , Hironobu Takagi, Annotation-based transcoding for nonvisual web access, Proceedings of the fourth international ACM conference on Assistive technologies, p.172-179, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354588]
• 2: S. Bechhofer, S. Harper, and D. Lunn. Sadie: Semantic annotation for accessibility. In ISWC '06: Proceedings of The 5th International Semantic Web Conference, pages 101--115, 2006.
• 3: Jinlin Chen , Baoyao Zhou , Jin Shi , Hongjiang Zhang , Qiu Fengwu, Function-based object model towards website adaptation, Proceedings of the 10th international conference on World Wide Web, p.587-596, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372161]
• 4: W. Chisholm, G. Vanderheiden, and I. Jacobs. Core Techniques for Web Content Accessibility Guidelines 1.0. W3C, November 2002.
• 5: Suhit Gupta , Gail Kaiser , David Neistadt , Peter Grimm, DOM-based content extraction of HTML documents, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775182]
• 6: Simon Harper , Sean Bechhofer , Darren Lunn, Taming the inaccessible web, Proceedings of the 24th annual ACM international conference on Design of communication, October 18-20, 2006, Myrtle Beach, SC, USA [doi>10.1145/1166324.1166340]
• 7: S. Harper, C. Goble, R. Stevens, and Y. Yesilada. Towel: Experiences of augmenting the web with journey knowledge. In Proceedings of the The Twelfth International World Wide Web Conference, 2003.
• 8: Masahiro Hori , Goh Kondoh , Kouichi Ono , Shin-ichi Hirose , Sandeep Singhal, Annotation-based Web content transcoding, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.197-211, June 2000, Amsterdam, The Netherlands
• 9: Anita W. Huang , Neel Sundaresan, A semantic transcoding system to adapt Web services for users with disabilities, Proceedings of the fourth international ACM conference on Assistive technologies, p.156-163, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354363]
• 10: S. C. Ihde , P. P. Maglio , J. Meyer , R. Barrett, Intermediary-based transcoding framework, IBM Systems Journal, v.40 n.1, p.179-192, January 2001
• 11: Frankie James, Presenting HTML Structure in Audio: User Satisfaction with Audio Hypertext, Stanford University, Stanford, CA, 1998
• 12: M. Jang, J. Kim, and J.-C. Sohn. Web content adaptation and transcoding based on cc/pp and semantic templates. In WWW '03: Proceedings of the 12th international conference on World Wide Web, page 195, 2003.
• 13: Brian Kelly , David Sloan , Lawrie Phipps , Helen Petrie , Fraser Hamilton, Forcing standardization or accommodating diversity?: a framework for applying the WCAG in the real world, Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A), May 10-10, 2005, Chiba, Japan [doi>10.1145/1061811.1061820]
• 14: D. Lunn. A quantitative evaluation of the sadie transcoder: Measuring time to task completion. SADIe Technical Report 9, The University of Manchester, School of Computer Science, July 2008, http://hcw-eprints.cs.manchester.ac.uk/54/.
• 15: S. Mukherjee, G. Yang, and I. Ramakrishnan. Automatic annotation of content-rich html documents: Structural and semantic analysis. In Lecture Notes in Computer Science, pages 533--549, January 2003.
• 16: K. Nagao. Semantic transcoding: Making the world wide web more understandable and usable with external annotations. In SSGRR 2000: Proceedings of the International Conference on Advances in Infrastructure for E-Business, Science, and Education on the Internet, August 2000.
• 17: Bambang Parmanto , Reza Ferrydiansyah , Andi Saptono , Lijing Song , I Wayan Sugiantara , Stephanie Hackett, AcceSS: accessibility through simplification & summarization, Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A), May 10-10, 2005, Chiba, Japan [doi>10.1145/1061811.1061815]
• 18: Helen Petrie , Fraser Hamilton , Neil King, Tension, what tension?: Website accessibility and visual design, Proceedings of the 2004 international cross-disciplinary workshop on Web accessibility (W4A), May 18, 2004, New York City, New York [doi>10.1145/990657.990660]
• 19: F. G. Smith and J. E. Smith. Key Topics In Clinical Research: A User Guide To Researching, Analyzing, And Publishing Clinical Data. The key topics series. Taylor & Francis, Mortimer House, 37--41 Mortimer Street, London, W1T 3JH, UK, 1st edition, 2003.
• 20: Hironobu Takagi , Chieko Asakawa, Transcoding proxy for nonvisual web access, Proceedings of the fourth international ACM conference on Assistive technologies, p.164-171, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354371]
• 21: Hironobu Takagi , Chieko Asakawa , Kentarou Fukuda , Junji Maeda, Site-wide annotation: reconstructing existing pages to be accessible, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638265]
• 22: Hironobu Takagi , Shin Saito , Kentarou Fukuda , Chieko Asakawa, Analysis of navigability of Web applications for improving blind usability, ACM Transactions on Computer-Human Interaction (TOCHI), v.14 n.3, p.13-es, September 2007 [doi>10.1145/1279700.1279703]
• 23: Yeliz Yesilada , Robert Stevens , Simon Harper , Carole Goble, Evaluating DANTE: Semantic transcoding for visually disabled users, ACM Transactions on Computer-Human Interaction (TOCHI), v.14 n.3, p.14-es, September 2007 [doi>10.1145/1279700.1279704]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Web-based interaction

General Terms:
Experimentation, Human Factors, Measurement

Keywords:
accessibility, sadie, semantic transcoding, visually impaired users, web