An empirical investigation of multimodal interfaces for browsing internet search results

ABSTRACT

An empirical investigation, comparing the level of usability between multimodal and nonmultimodal interfaces within Internet search engines is presented. The experiment was based on Internet search activities through the use of five different interfaces provided by AVBro2, an experimental platform developed for this investigation. A total of fifty users participated in this experiment. Each user performed three tasks with every interface. The evaluation of the obtained results according to different usability criteria showed a higher degree of usability in multimodal interfaces when compared with a traditional text-based interface for browsing Internet search results. In addition a detailed analysis of the level of functionality of visual and audio metaphors implemented in these interfaces is discussed.

REFERENCES

• 1: [1] Wiza, W., Walczak, W., Cellary, W., Periscope: A System for Adaptive 3D Visualization of Search Results, In Proceedings of the Ninth International Conference on 3D Web Technology. ACM Press, 2004.
• 2: [2] Wiza, W., Walczak, W., Cellary, W., AVE-Method for 3D Visualization Of Search Results, In Lecture Notes in Computer Science. Springer-Verlag, 2003.
• 3: [3] Cugini, J., Laskowski, S., Sebrechts, M., Design of 3D Visualization of Search Results: Evolution and Evaluation, In Proceedings of IST/SPIE, 2000.
• 4: [4] ViOS, http://computer.howstuffworks.com/vios.html.
• 5: [5] Bonnel, N., Cotarmanac'h, Morin, A., Meaning Metaphor for Visualizing Search Results, In Proceedings of International Conference on Information Visualisation, IEEE Computer Society, 2005.
• 6: [6] Kartoo, http://www.kartoo.com.
• 7: [7] Ujiko, http://www.ujiko.com.
• 8: [8] Grokker, http://www.grokker.com/grokker.html.
• 9: [9] Klein, P., Reiterer, H., Muller, F., Limbach, T., Metadata Visualization with VisMeb, In Proceedings of the International Conference on Information Visualization, IEEE Computer Society, 2003.
• 10: [10] Reiterer, H., Tullius, G., Mann, T., INSYDER: a content-based visual-information-seeking system for the Web, in International Journal on Digital Libraries, Berlin-Heidelberg, pp. 25-41, 2005.
• 11: [11] Gaver, W. W., Auditory Icons: Using Sound in Computer Interfaces. Human Computer Interaction. 2, 1986, 167-177.
• 12: William W. Gaver, Synthesizing auditory icons, Proceedings of the INTERACT '93 and CHI '93 conference on Human factors in computing systems, p.228-235, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169184]
• 13: Stephen A. Brewster , Peter C. Wright , Alistair D. N. Edwards, An evaluation of earcons for use in auditory human-computer interfaces, Proceedings of the INTERACT '93 and CHI '93 conference on Human factors in computing systems, p.222-227, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169179]
• 14: [14] Brewster, S. A., Providing a Structured Method for Integrating Non-Speech Audio into Human-Computer Interfaces, PhD Thesis, University of York, UK, 1994.
• 15: [15] Rigas, D., Guidelines for Auditory Interface Design: An Empirical Investigation, PhD Thesis, University of Loughborough, UK, 1996.
• 16: [16] Edwards, A. D. N., Adapting User Interfaces for Visually Disabled Users, PhD Thesis, the Open University, UK, 1987.
• 17: Dimitrios I. Rigas , James L. Alty, The Use of Music in a Graphical Interface for the Visually Impaired, Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.228-235, July 14-18, 1997
• 18: [18] Rigas, D., Alty, J. L., the Rising Pitch Metaphor: An Empirical Study, In International Journal of Human Computer Studies. Elsevier, 2005.
• 19: [19] Alty, J. L., Rigas, D., Exploring the Use of Structured Musical Stimuli to Communicate Simple Diagrams: The Role of Context, In International Journal of Human-Computer Studies, Elsevier, 2005.
• 20: [20] Duggan, B., Deegan, M., Consideration In The Usage Of Text To Speech (TTS) In The creation Of Natural Sounding Voice Enabled Web Systems, In Proceedings of the 1st International Symposium on Information and Communication Technologies ISICT '03, Trinity College Dublin, 2003.
• 21: [21] Rigas, D., Ciuffreda, A., Multi-Modal Web-Browsing - An Empirical Approach to Improve the Browsing Process of Internet Retrieved Results, In Proceedings of the International Conference on Signal Processing and Multimedia Applications, 2006.
• 22: [22] Google Web API, http://www.google.com/apis.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)
      H.3.5 On-line Information Services
          Subjects: Web-based services
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Information browsers

General Terms:
Design, Management, Performance

Keywords:
audio metaphors, earcons, internet browsing, multimodality, visual metaphors