Clique: a conversant, task-based audio display for GUI applications

ABSTRACT

The purpose of the Clique project is to explore a new way of adapting applications with graphical user interfaces (GUIs) for use in audio. Existing adaptation methods retain the components and metaphors of visual interfaces in the audio displays they produce. Clique, on the other hand, presents the user with a conversational audio display based on the tasks supported by programs, not their visual representations. The user interacts solely with this audio display while Clique takes charge of inspecting and controlling the underlying programs via their GUIs. In effect, the graphical nature of program interfaces is hidden from the listening user who is free to concentrate on his or her tasks in audio. We hypothesize that audio displays produced in this manner will prove more effective and satisfying for common tasks than current solutions.

REFERENCES

• 1: A. Edwards. "Evaluation of Outspoken software for blind users." Technical report. University of York, Department of Computer Science. 1991.
• 2: Kitch Barnicle, Usability testing with screen reading technology in a Windows environment, Proceedings on the 2000 conference on Universal Usability, p.102-109, November 16-17, 2000, Arlington, Virginia, United States [doi>10.1145/355460.355543]
• 3: E. Mynatt. "Transforming graphical interfaces into auditory interfaces for blind users." Human-Computer Interaction. 12. pp 7--45. 1997.
• 4: C. Frauenberger, R. Höldrich, and A. de Campo. "A generic, semantically based design approach for spatial auditory computer displays." in Proceedings of the international conference on Auditory Display. 2004.
• 5: Paul Martin , Frederick Crabbe , Stuart Adams , Eric Baatz , Nicole Yankelovich, SpeechActs: A Spoken-Language Framework, Computer, v.29 n.7, p.33-40, July 1996 [doi>10.1109/2.511966]
• 6: E. Ly and C. Schmandt. "Chatter: A conversational learning speech interface." in Symposium on Multi-Media Multi-Modal Systems. 1994.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology; Audio input/output
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O

General Terms:
Design