Improving accessibility to statistical graphs: the iGraph-Lite system

ABSTRACT

Information is often presented in graphical form. Unfortunately, current assistive technologies such as screen readers are not well-equipped to handle these representations. To provide accessibility to graphs published in ``The Daily" (Statistics Canada's main dissemination venue), we have developed iGraph-Lite, a system that provides short verbal descriptions of the information depicted in graphs and a way to also interact with this information.

REFERENCES

• 1: L. Brown and S. Brewster. Drawing by ear: Interpreting sonified line graphs. In Proceedings of ICAD 2003, pages 152--156. ICAD, 2003.
• 2: L. Brown, S. Brewster, R. Ramloll, M. Burton, and B. Riedel. Design guide-lines for audio presentation of graphs and tables. In Proceedings of ICAD 2003 Workshop on Auditory Displays In Assistive Technologies. University of Boston, 2003.
• 3: D. Chester and S. Elzer. Getting computers to see information graphics so users do not have to. In ISMIS, pages 660--668, 2005.
• 4: Robert F. Cohen , Rui Yu , Arthur Meacham , Joelle Skaff, PLUMB: displaying graphs to the blind using an active auditory interface, Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility, October 09-12, 2005, Baltimore, MD, USA [doi>10.1145/1090785.1090820]
• 5: M. Corio and G. Lapalme. Generation of texts for information graphics. In P. Saint-Dizier, editor, Proceedings of the 7th. European Workshop on Natural Language Generation (EWNLG'99), pages 49--58, Toulouse, 1999.
• 6: Kees Van Deemter , Emiel Krahmer , Mariët Theune, Real versus Template-Based Natural Language Generation: A False Opposition?, Computational Linguistics, v.31 n.1, p.15-24, March 2005 [doi>10.1162/0891201053630291]
• 7: S. Elzer, E. Schwartz, S. Carberry, D. Chester, S. Demir, and P. Wu. A browser extension for providing visually impaired users access to the content of bar charts on the web. In Proceedings of International Conference on Web Information Systems (WEBIST), 2007.
• 8: M. Fasciano and G. Lapalme. Postgraphe: a system for the generation of statistical graphics and text. In Proceedings of the 8th International Workshop on Natural Language Generation (INLG-96), 1996.
• 9: L. Ferres, A. Parush, Z. Li, Y. Oppacher, and G. Lindgaard. Representing and querying line graphs in natural language: The iGraph system. In SmartGraphics 2006, number 4073 in Lecture Notes in Computer Science, pages 248--253, Berlin Heidelberg, 2006. Springer-Verlag.
• 10: L. Ferres, A. Parush, S. Roberts, and G. Lindgaard. Helping people with visual impairments gain access to graphical information through natural language: The igraph system. In Proceedings of the 10thICCHP, Lecture Notes in Computer Science. Springer-Verlag, 2006.
• 11: L. Ferres, L. Sumegi, G. Lindgaard, and A. Parush. Design and testing of a graph accessibility system: The iGraph navigation tool. Submitted.
• 12: L. Ferres, L. Sumegi, A. Parush, P. Verkhogliad, and G. Lindgaard. Natural language interaction with graphical information: the iGraph-Lite navigation tool. Submitted.
• 13: L. Ferres and P. Verkhogliad. Algorithms to describe graphs qualitatively. In Preparation.
• 14: J. Flowers. Thirteen years of reflection on auditory graphing: Promises, pitfalls, and potential new directions. In Proceedings of ICAD 05-Eleventh Meeting of the International Conference on Auditory Display, pages 1--5, 2005.
• 15: M. E. Foster. Automatically generating text to accompany information graphics. Master's thesis, Department of Computer Science, University of Toronto, September 1999. Also published as technical report CSRI-397.
• 16: M. E. Foster and M. White. Techniques for text planning with XSLT. In Proceedings of the 4th Workshop on NLP and XML (NLPXML 2004), Barcelona, July 2004.
• 17: Andrea R. Kennel, Audiograf: a diagram-reader for the blind, Proceedings of the second annual ACM conference on Assistive technologies, p.51-56, April 11-12, 1996, Vancouver, British Columbia, Canada [doi>10.1145/228347.228357]
• 18: Karen Kukich, Design of a knowledge-based report generator, Proceedings of the 21st annual meeting on Association for Computational Linguistics, June 15-17, 1983, Cambridge, Massachusetts [doi>10.3115/981311.981340]
• 19: M. Kurze. Giving blind people access to graphics (example: Business graphics). In Proc. Software-Ergonomie 95 Workshop Nicht-visuelle graphische Benutzungsoberüchen, Darmstadt, Germany, 1995.
• 20: David K. McGookin , Stephen A. Brewster, SoundBar: exploiting multiple views in multimodal graph browsing, Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, p.145-154, October 14-18, 2006, Oslo, Norway [doi>10.1145/1182475.1182491]
• 21: Vibhu O. Mittal , Giuseppe Carenini , Johanna D. Moore , Steven Roth, Describing complex charts in natural language: a caption generation system, Computational Linguistics, v.24 n.3, September 1998
• 22: A. Paivio and H. W. Okovita. Word imagery modalities and associative learning in blind and sighted subjects. Journal of Verbal Learning And Verbal Behavior, 10:506--510, 1971.
• 23: A. Parush, L. Ferres, M. Rasouli, and G. Lindgaard. Impact of external representation and task on graph comprehension. In R. Sun, editor, Proceedings of the 28th Annual Conference of the Cognitive Society, pages 1932--1938, Mahwah, New Jersey, 2006. Lawrence Erlbaum Associates, Inc.
• 24: Sandeep R Patil, Accessible image file formats: the need and the way (position paper), Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), May 07-08, 2007, Banff, Canada [doi>10.1145/1243441.1243455]
• 25: S. Pinker. A theory of graph comprehension. In R. Freedle, editor, Artificial intelligence and the future of testing, pages 73--126. L. Erlbaum, Hillsdale, NJ, 1990.
• 26: E. Reiter. NLG vs. templates. In Proceedings of the 5th European Workshop in Natural Language Generation, pages 95--105, Leiden, NL, May 1995.
• 27: E. Reiter. An architecture for data-to-text systems. In Proceedings of ENLG-2007, 2007.
• 28: Ehud Reiter , Robert Dale, Building natural language generation systems, Cambridge University Press, New York, NY, 2000
• 29: S. Sripada and F. Gao. Summarizing dive computer data: A case study in integrating textual and graphical presentations of numerical data. In Proceedings of Workshop on Multimodal Output Generation, volume CTIT Proceedings of the Workshop on Multimodal Output Generation, pages 149--157, 2007.
• 30: S. Sripada, E. Reiter, and I. Davy. Sumtime-mousam: Configurable marine weather forecast generator. Expert Update, 6:4--10, 2003.
• 31: G. Wilcock. Pipelines, templates and transformations: XML for natural language generation. In Proceedings of the 1st NLP and XML Workshop, pages 1--8, Tokyo, Japan, 2001.
• 32: Jin Yu , Ehud Reiter , Jim Hunter , Chris Mellish, Choosing the content of textual summaries of large time-series data sets, Natural Language Engineering, v.13 n.1, p.25-49, March 2007 [doi>10.1017/S1351324905004031]
• 33: Jin Yu , Ehud Reiter , Jim Hunter , Somayajulu Sripada, SumTime-turbine: a knowledge-based system to communicate gas turbine time-series data, Proceedings of the 16th international conference on Developments in applied artificial intelligence, p.379-384, June 23-26, 2003, Laughborough, UK
• 34: W. Yu and S. A. Brewster. Evaluation of multimodal graphs for blind people. Universal Access in the Information Society, 2(2):105--124, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Natural language

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.1 Applications and Expert Systems
          Subjects: Natural language interfaces

General Terms:
Human Factors

Keywords:
accessibility (blind and visually impaired), natural language interaction, statistical graphs