Working-memory failure in phone-based interaction

ABSTRACT

This article investigates working-memory (WM) failure in phone-based interaction (PBI). We used a computational model of phone-based interaction (PBI USER) to generate predictions about the impact of three factors on WM failure:PBI features (i.e. menu structure), individual differences (i.e., WM capacity), and task characteristics (i.e., number of tasks). Our computational model stipulates that both the storage and the processing of information contribute to WM failure. In practical terms the model and the empirical results indicate that, contrary to guidelines for the design of phone-based interfaces, deep menu hierarchies (no more than three options per menu) do not reduce WM error rates in PBI. At a more theoretical level, the study shows that the use of a computational model in HCI research provides a systematic approach for explaining complex empirical results.

REFERENCES

• 1: AGRESTI, A. 1990. Categorical Data Analysis. Wiley, New York.
• 2: John R. Anderson, The Architecture of Cognition, Harvard University Press, Cambridge, MA, 1983
• 3: ANDERSON, J.R. 1990. The Adaptive Character of Thought. Lawrence Erlbaum, Hillsdale, N.J.
• 4: ANDERSON, J. R. AND JEFFRIES, R. 1985. Novice LISP errors: Undetected losses of information from working memory. Human-Comput. Inter. 1, 2, 133-161.
• 5: ATKINSON, R. C. AND SHIFFRIN, R. M. 1968. Human memory: A proposed system and its control processes. In The Psychology of Learning and Motivation. Vol. 2. Academic Press, New York.
• 6: BADDELEY, A.D. 1986. Working Memory. Clarendon Press, Oxford, U.K.
• 7: BADDELEY, A. D. AND HITCH, G.J. 1974. Working memory. In The Psychology of Learning and Motivation, G. H. Bower, Ed. Vol. 8. Academic Press, New York.
• 8: BROADBENT, D.E. 1958. Perception and Communication. Pergamon Press, London, U.K.
• 9: Stuart K. Card, Models of working memory, Human performance models for computer-aided engineering, National Academy Press, Washington, DC, 1989
• 10: CARLIN, B. P., KASS, R. E., LERCH, F. J., AND HUGUENARD, B.R. 1992. Predicting working memory failure: A subjective Bayesian approach to model selection. J. Am. Stat. Assoc. 87, 319-327.
• 11: CARPENTER, P. A. AND JUST, M.A. 1989. The role of working memory in language comprehension. In Complex Information Processing, D. Klahr and K. Kotovsky, Eds. Lawrence Erlbaum, Hillsdale, N.J., 31-68.
• 12: COLLINS, A. M. AND LOFTUS, E.F. 1975. A spreading-activation theory of semantic processing. Psych. Rev. 82, 407-428.
• 13: COLLINS, A. M. AND QUmLIAN, M.R. 1969. Retrieval time from semantic memory. J. Verbal Learn. Verbal Behav. 8, 240-247.
• 14: DANEMAN, M. AND CARPENTER, P.A. 1980. Individual differences in working memory and reading. J. Verbal Learn. Verbal Behav. 19, 450-466.
• 15: DUMAIS, S. T. AND LANDAUER, T.K. 1984. Describing categories of objects for menu retrieval systems. Behav. Res. Methods Instrum. Comput. 16, 2, 242-248.
• 16: ENGELBECK, G. AND ROBERTS, T. 1989. The effects of several voice-menu characteristics on menu selection performance. Tech. Rep. ST0401, US West Advanced Technologies, Englewood, Colo.
• 17: FISCHER, G. H. AND PARZER, P. 1991. An extension of the rating scale model with an application to the measurement of change. Psychometrika 56, 637-651.
• 18: GLAS, C. A. W. AND VERHELST, N. D. 1989. Extensions of the partial credit model. Psychometrika 54, 635-659.
• 19: John D. Gould , Stephen J. Boies, Human factors challenges in creating a principal support office system—the speech filing system approach, ACM Transactions on Information Systems (TOIS), v.1 n.4, p.273-298, Oct. 1983 [doi>10.1145/357442.357443]
• 20: HABERMAN, S. J. 1977. Log-linear models and frequency tables with small expected cell counts. Ann. Stat. 5, 1148-1169.
• 21: Brian R. Huguenard, Working memory failure in human-computer interaction: modeling and testing simultaneous demands for information storage and processing, Carnegie Mellon University, Pittsburgh, PA, 1993
• 22: JUST, M. A. AND CARPENTER, P.A. 1985. Cognitive coordinate systems: Accounts of mental rotation and individual differences in spatial ability. Psych. Rev. 92, 2, 137-171.
• 23: JUST, M. A. AND CARPENTER, P.A. 1992. A capacity theory of comprehension: Individual differences in working memory. Psych. Rev. 99, 1, 122-149.
• 24: KESSLER, C. M. AND ANDERSON, J.R. 1986. Learning flow of control: Recursive and iterative procedures. Human-Comput. Inter. 2, 135-166.
• 25: John I. Kiger, The depth/breadth trade-off in the design of menu-driven user interfaces, International Journal of Man-Machine Studies, v.20 n.2, p.201-213, Feb. 1984 [doi>10.1016/S0020-7373(84)80018-8]
• 26: KOEHLER, K. J. AND LARNTZ, K. 1980. An empirical investigation of goodness-of-fit statistics for sparse multinomials. J. Am. Stat. Assoc. 75, 336-344.
• 27: LERCH, F.J. 1994. Error behavior in model building. Working paper, Graduate School of Industrial Administration, Carnegie Mellon Univ., Pittsburgh, Pa.
• 28: F. J. Lerch , M. M. Mantei , J. R. Olson, Skilled financial planning: the cost of translating ideas into action, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.121-126, March 1989
• 29: LONGFORD, N. T. 1995. Models for Uncertainty in Educational Testing. Springer-Verlag, New York.
• 30: J MacGregor , E Lee , N Lam, Optimizing the structure of database menu indexes: a decision model of menu search, Human Factors, v.28 n.4, p.387-399, Aug. 1986
• 31: MCFADDEN, D. 1984. Econometric analysis of qualitative response models. In Handbook of Econometrics, Z. Griliches and M. D. Intriligator, Eds. Vol. 2. Elsevier Science Publishers, New York, 1395-1457.
• 32: MILLER, G.A. 1956. The magical number seven plus or minus two: Some limits on our capacity for processing information. Psych. Rev. 63, 81-97.
• 33: MORRISON, D.F. 1990. Multivariate Statistical Models. McGraw Hill, New York.
• 34: S. R. Parkinson , M. D. Hill , N. Sisson , C. Viera, Effects of breadth, depth and number responses on computer menu search performance, International Journal of Man-Machine Studies, v.28 n.6, p.683-692, June 1988 [doi>10.1016/S0020-7373(88)80068-3]
• 35: PATZ, R. J., JUNKER, B. W., LERCH, F. J., AND HUGUENARD, B. R. 1994. Analyzing small psychological experiments with item response models. Working paper, Dept. of Statistics, Carnegie Mellon Univ., Pittsburgh, Pa.
• 36: PAYNE, J. W., BETTMAN, J. R., AND JOHNSON, E. J. 1988. Adaptive strategy selection in decision making. J. Exp. Psych. 14, 534-552.
• 37: PAYNE, J. W., BETTMAN, J. R., AND JOHNSON, E.J. 1990. The adaptive decision maker: Effort and accuracy in choice. In Insights in Decision Making, R. M. Hogarth, Ed. University of Chicago Press, Chicago, Ill., 129-153.
• 38: PAYNE, J. W., BETTMAN, J. R., AND JOHNSON, E. J. 1993. The Adaptive Decision Maker. Cambridge University Press, New York.
• 39: PELTON, G. E. 1989. Designing the telephone interface for voice processing applications. Speech Tech. 5, I (Oct./Nov.), 18-21.
• 40: PETERSON, L. R. AND PETERSON, M.J. 1959. Short-term retention of individual verbal items. J. Exp. Psych. 58, 193-198.
• 41: Byron J. Pierce , Stanley R. Parkinson , Norwood Sisson, Effects of semantic similarity, omission probability and number of alternatives in computer menu search, International Journal of Man-Machine Studies, v.37 n.5, p.653-677, Nov. 1992 [doi>10.1016/0020-7373(92)90027-I]
• 42: Peter Pirolli , Mark Wilson, Measuring Learning Strategies and Understanding: A Research Framework, Proceedings of the Second International Conference on Intelligent Tutoring Systems, p.539-558, June 10-12, 1992
• 43: RASCH, G. 1980. Probabilistic Models for Some Intelligence and Attainment Tests. University of Chicago Press, Chicago, Ill.
• 44: SAS INSTITUTE. 1987. SAS User's Guide: Statistics. SAS Institute Inc., Cary, N. Carol.
• 45: SCHNEIDER, W. AND DETWEILER, M. 1988. A control architecture for working memory. In The Psychology of Learning and Motivation: Advances in Research and Theory, G. Bower, Ed. Academic Press, San Diego, Calif.
• 46: J. B. Smelcer, Understanding user errors in database query, University of Michigan, Ann Arbor, MI, 1990
• 47: THIBADEAU, R., JUST, M. A., AND CARPENTER, P.A. 1982. A model of the time course and content of reading. Cogn. Sci. 6, 157-203.
• 48: THISSEN, D. 1986. MULTILOG User's Manual. Scientific Software, Mooresville, Ind.
• 49: WAUGH, N. C. AND NORMAN, D.A. 1965. Primary memory. Psych. Rev. 72, 89-104.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods; Evaluation/methodology

General Terms:
Experimentation, Human Factors, Performance

Keywords:
auditory menu, cognitive model, individual differences, user error, working memory