Data collection and analysis techniques for evaluating the perceptual qualities of auditory stimuli

ABSTRACT

This paper describes a general methodological framework for evaluating the perceptual properties of auditory stimuli. The framework provides analysis techniques that can ensure the effective use of sound for a variety of applications, including virtual reality and data sonification systems. Specifically, we discuss data collection techniques for the perceptual qualities of single auditory stimuli including identification tasks, context-based ratings, and attribute ratings. In addition, we present methods for comparing auditory stimuli, such as discrimination tasks, similarity ratings, and sorting tasks. Finally, we discuss statistical techniques that focus on the perceptual relations among stimuli, such as Multidimensional Scaling (MDS) and Pathfinder Analysis. These methods are presented as a starting point for an organized and systematic approach for nonexperts in perceptual experimental methods, rather than as a complete manual for performing the statistical techniques and data collection methods. It is our hope that this paper will help foster further interdisciplinary collaboration among perceptual researchers, designers, engineers, and others in the development of effective auditory displays.

REFERENCES

• 1: Ballas J. A. 1993. Common factors in the identification of an assortment of everyday sounds. Journal of Experimental Psychology: Human perception and Performance 19, 250--267.
• 2: Bonebright, T. L. 1996. An investigation of data collection methods for auditory stimuli: Paired comparisons versus a computer sorting task. Behavior Research Methods, Instruments, & Computers 28, 275--278.
• 3: Bonebright, T. L. 1997. Vocal affect expression: A comparison of multidimensional scaling solutions for paired comparisons and computer sorting tasks using perceptual and acoustic measures. Dissertation Abstracts International: Section B: The Sciences and Engineering 57, 12-B, 7762.
• 4: Davison, M. L. 1983. Multidimensional Scaling. Wiley, New York.
• 5: Dillon, W. R. and Goldstein, M. 1984. Multivariate Analysis: Methods and Applications. Wiley, New York.
• 6: Joseph F. Dumas , Janice C. Redish, A Practical Guide to Usability Testing, Greenwood Publishing Group Inc., Westport, CT, 1993
• 7: Garbin, C. P. 1988. Visual-haptic perceptual nonequivalence for shape information and its impact upon cross-modal performance. Journal of Experimental Psychology: Human Perception and Performance 14, 547--553.
• 8: Garbin, C. P. and Bernstein, I. H. 1984. Visual and haptic perception of three-dimensional solid forms. Perception and Psychophysics 36, 101--110.
• 9: Goldsmith, T. E., Johnson, P. J., and Acton, W. H. 1991. Assessing structural knowledge. Journal of Educational Psychology 83, 88--96.
• 10: Harrison, B. L. 1991. Video annotation and multimedia interfaces: From theory to practice. In Proceedings of Human Factors Society 35th Annual Meeting. 319--322.
• 11: Hollins, M., Faldowski, R., Rao, S., and Young, F. 1993. Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis. Perception & Psychophysics 54, 697--705.
• 12: Kruskal, J. B. and Wish, M. 1978. Multidimensional Scaling. Sage, Beverly Hills, CA.
• 13: Maxwell, S. E. and Delaney, H. D. 1990. Designing Experiments and Analyzing Data: A Model Comparison Perspective. Wadsworth, Belmont, CA.
• 14: Miller, G. A. 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 63, 81--97.
• 15: Nadine Elizabeth Miner , Thomas P. Caudell, Creating wavelet-based models for real-time synthesis of perceptually convincing environmental sounds, 1998
• 16: Mynatt, E. D. 1994. Designing with auditory icons. In Proceedings of the Second International Conference on Auditory Display (ICAD). Santa Fe, NM. 109--119.
• 17: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 18: Nunnally, J. C. and Bernstein, I. H. 1994. Psychometric Theory. McGraw-Hill, New York.
• 19: Oppenheim, A. N. 1992. Questionnaire design, Interviewing, and Attitude Measurement. Pinter, New York.
• 20: Schiffman, S. S., Reynolds, M. L. and Young, F. W. 1981. Introduction to Multidimensional Scaling: Theory, Methods and Applications. Academic Press, New York.
• 21: Ben Shneiderman, Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1997
• 22: Roger W. Schvaneveldt, Pathfinder associative networks: studies in knowledge organization, Ablex Publishing Corp., Norwood, NJ, 1990
• 23: Tabachnick, B. G. and Fidell, L. S. 1989. Using Multivariate Statistics. Harper & Row, New York.
• 24: Turnage, K. D., Bonebright, T. L., Buhman, D. C., and Flowers, J. H. 1996. The effects of task demands on the equivalence of visual and auditory representations of periodic numerical data. Behavior Research Methods, Instruments, & Computers 28, 270--274.
• 25: Young, F. W. and Lewycky, J. R. 1979. ALSCAL-4 User's Guide (2nd ed.). Data Analysis and Theory Associates, Carrboro, NC.

INDEX TERMS

General Terms:
Experimentation, Human Factors, Measurement, Performance

Keywords:
Sonification, data collection, statistics