A multimodal interactive system to create and explore graph structures

ABSTRACT

This work introduces a multimodal interactive system to create, edit and explore graph structures through direct manipulation operations. The system being designed is based on audio-haptic interaction, supported by visual feedback. A star life design and development cycle was undertaken. The main design choices and early implementation and evaluation results are illustrated.

REFERENCES

• 1: Andy Brown , Steve Pettifer , Robert Stevens, Evaluation of a non-visual molecule browser, ACM SIGACCESS Accessibility and Computing
• 2: Fogli, D., Marcante, A., Mussio, P., Parasiliti Provenza, L., and Piccinno, A. Multi-facet Design of Interactive System through Visual Languages, in F. Ferri (Ed.) "Visual Languages for Interactive Computing: Definitions and Formalizations", ISBN: 978--1--59904--534--4. HERSHEY PA: IGI Global, 2007, 174--204.
• 3: Fritz, J. P., Way, T. P., and Barner, K. E. Haptic Representation of Scientific Data for Visually Impaired or Blind Persons. In Proc. CSUN Conference on Technology and Disability, 12 IEEE Trans on Rehabilitation Engineering, 1996.
• 4: David K. McGookin , Stephen A. Brewster, MultiVis: improving access to visualisations for visually impaired people, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125509]
• 5: McGookin, D. K. and Brewster, S. A. 2006. Graph builder: Constructing non-visual visualizations. In ICAD 2006 (London, UK).
• 6: McGookin, D. K. and Brewster, S. A. 2006. Contextual Audio in Haptic Graph Browsing. In Proc. ICAD 2006 (London, UK), ICAD, 91--94
• 7: Konstantinos Moustakas , Georgios Nikolakis , Konstantinos Kostopoulos , Dimitrios Tzovaras , Michael G. Strintzis, Haptic Rendering of Visual Data for the Visually Impaired, IEEE MultiMedia, v.14 n.1, p.62-72, January 2007 [doi>10.1109/MMUL.2007.10]
• 8: Jenny Preece , Yvonne Rogers , Helen Sharp , David Benyon , Simon Holland , Tom Carey, Human-Computer Interaction, Addison-Wesley Longman Ltd., Essex, UK, 1994
• 9: Helen Petrie , Christoph Schlieder , Paul Blenkhorn , David Gareth Evans , Alasdair King , Anne-Marie O'Neill , George T. Ioannidis , Blaithin Gallagher , David Crombie , Rolf Mager , Maurizio Alafaci, TeDUB: A System for Presenting and Exploring Technical Drawings for Blind People, Proceedings of the 8th International Conference on Computers Helping People with Special Needs, p.537-539, July 15-20, 2002
• 10: Vanderheiden, G. C. Nonvisual alternative display techniques for output from graphics-based computers. Journal of Visual Impairment and Blindness 83, 8 (1989), 383--390.
• 11: Way, T. P., and Barner, K. E. Automatic Visual to Tactile Translation, Part I: Human Factors, Access Methods and Image Manipulation. IEEE Trans. on Rehabilitation Engineering, 5, 1 (1997).

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Human Factors

Keywords:
blind users, haptic, multimodal interactive systems