Automation of repetitive web browsing tasks with voice-enabled macros

ABSTRACT

Non-visual aural web browsing remains inefficient as compared to regular browsing with visual modalities. This paper proposes an approach for automation of repetitive browsing tasks by using personalized macros, which are easy to record and replay with a speech-enabled interface. The prototype system is implemented in the framework of the HearSay non-visual web browser.

REFERENCES

• 1: WindowEyes, 2008: http://www.gwmicro.com/Window-Eyes/
• 2: JAWS 9.0, May 2008: http://www.freedomscientific.com.
• 3: Arun Kumar , Nitendra Rajput , Dipanjan Chakraborty , Sheetal K. Agarwal , Amit A. Nanavati, WWTW: the world wide telecom web, Proceedings of the 2007 workshop on Networked systems for developing regions, August 27-27, 2007, Kyoto, Japan [doi>10.1145/1326571.1326582]
• 4: P. Kotkar, et al., An Audio Wiki for Building Local Repositories of Knowledge in the Developing World, in Wireless Systems: Advanced Research and Development (Poster Session). 2008: Bangalore, India.
• 5: A. Gandhre, et al., Creating and managing personal information assistants via a web browser: The WinAgent experience., in Workshop on Information Integration on the Web. 2004: Toronto, Canada.
• 6: iMacros, May 2008: http://www.iopus.com/imacros/firefox/.
• 7: Gilly Leshed , Eben M. Haber , Tara Matthews , Tessa Lau, CoScripter: automating & sharing how-to knowledge in the enterprise, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357323]
• 8: Yevgen, B., et al., Towards one world web with HearSay3, in W4A. 2008, ACM: Beijing, China.
• 9: Shinya Kawanaka , Yevgen Borodin , Jeffrey P. Bigham , Darren Lunn , Hironobu Takagi , Chieko Asakawa, Accessibility commons: a metadata infrastructure for web accessibility, Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, October 13-15, 2008, Halifax, Nova Scotia, Canada [doi>10.1145/1414471.1414500]
• 10: XPath 2.0, May 2008: http://www.w3.org/TR/xpath20/.
• 11: Hironobu Takagi , Shinya Kawanaka , Masatomo Kobayashi , Takashi Itoh , Chieko Asakawa, Social accessibility: achieving accessibility through collaborative metadata authoring, Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, October 13-15, 2008, Halifax, Nova Scotia, Canada [doi>10.1145/1414471.1414507]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Auditory (non-speech) feedback

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O; User-centered design; Interaction styles (e.g., commands, menus, forms, direct manipulation)
      H.5.4 Hypertext/Hypermedia
          Subjects: Theory; Navigation

General Terms:
Design, Human Factors

Keywords:
audio interface, blind users, hearsay, macro player, macro recorder, non-visual, screen reader, web browser