Systems, interactions, and macrotheory

ABSTRACT

A significant proportion of early HCI research was guided by one very clear vision: that the existing theory base in psychology and cognitive science could be developed to yield engineering tools for use in the interdisciplinary context of HCI design. While interface technologies and heuristic methods for behavioral evaluation have rapidly advanced in both capability and breadth of application, progress toward deeper theory has been modest, and some now believe it to be unnecessary. A case is presented for developing new forms of theory, based around generic “systems of interactors.” An overlapping, layered structure of macro- and microtheories could then serve an explanatory role, and could also bind together contributions from the different disciplines. Novel routes to formalizing and applying such theories provide a host of interesting and tractable problems for future basic research in HCI.

REFERENCES

• 1: ANDERSON, J. R. 1993. Rules of the Mind. Lawrence Erlbaum Associates, Inc., Mahwah, NJ.
• 2: BARNARD, P.J. 1985. Interacting cognitive subsystems: A psycholinguistic approach to short term memory. In Progress in the psychology of language, A. Ellis, Ed. Lawrence Erlbaum Associates Inc., Hillsdale, NJ, 197-258.
• 3: Philip J. Barnard, Cognitive resources and the learning of human-computer dialogs, Interfacing thought: cognitive aspects of human-computer interaction, MIT Press, Cambridge, MA, 1987
• 4: Phil Barnard, Bridging between basic theories and the artifacts of human-computer interaction, Designing interaction: psychology at the human-computer interface, Cambridge University Press, New York, NY, 1991
• 5: BARNARD, P. 1999. Interacting Cognitive Subsystems: Modeling working memory phenomena within a multi-processor architecture. In Models of Working Memory: Mechanisms of active maintenance and executive control, A. Miyake and P. Shah, Eds. Cambridge University Press, New York, NY, 298-339.
• 6: Phil Barnard , Michael Harrison, Integrating cognitive and system models in human computer interaction, Proceedings of the fifth conference of the British Computer Society, Human-Computer Interaction Specialist Group on People and computers V, p.87-103, February 1990, Univ. of Nottingham
• 7: BARNARD, P. J. AND HARRISON, M. D. 1992. Towards a framework for modeling humancomputer interactions. In Proceedings on East-West International Conference on Human Computer Interaction (EWCHI'92, Moscow), J. Gornostaev, Ed. 189-196.
• 8: BARNARD, P. AND MARCEL, A. J. 1984. Representation and understanding in the use of symbols and pictograms. In Information Design: The Design and Evaluation of Signs and Printed Material, R. Easterby and H. Zwaga, Eds. John Wiley and Sons Ltd., Chichester, UK, 37-75.
• 9: BARNARD, P. AND MAY, J. 1993. Cognitive modeling for user requirements. In Computers, Communication and Usability: Design Issues, Research and Methods for Integrated Services, P. F. Byerley, P. J. Barnard, and J. May, Eds. Elsevier, Amsterdam, The Nethlands, 101-145.
• 10: BARNARD, P. AND MAY, J. 1995. Interactions with advanced graphical interfaces and the deployment of latent human knowledge. In Eurographics Workshop on Design, Specification and Verification of Interactive Systems, F. Patern , Ed. Springer-Verlag, Berlin, Germany, 15-49.
• 11: BARNARD, P. AND MAY, J. 1999. Representing cognitive activity in complex tasks. Hum. Comput. Interact. 14, 1-2, 93-158.
• 12: BARNARD, P. J., BERNSEN, N. O., COUTAZ, J., DARZENTAS, J., FACONTI, G., HAMMOND, N., HARRISON, M. D., JORGENSEN, A. H., LOWGREN, J., MAY, J., AND YOUNG, R. M. 1995. Assaying Means of Design Expression for Users and Systems: AMODEUS-2 Project Final report, available at http://www.mrc-cbu.cam.ac.uk/amodeus/abstracts/d/d13.html
• 13: BARNARD, P., GRUDIN, J., AND MACLEAN, A. 1989. Developing a science base for the naming of computer commands. In Cognitive Ergonomics and Human Computer Interaction, J. B. Long and A. Whitefield, Eds. Cambridge University Press, New York, NY, 95-133.
• 14: BARNARD, P. J., MACLEAN, A., AND HAMMOND, N.V. 1984. User representations of ordered sequences of command operations. In Proceedings on Interact'84: First IFIP Conference on Human-Computer Interaction (London), 434-438.
• 15: Phil Barnard , Michael Wilson , Allan MacLean, Approximate modelling of cognitive activity: towards an expert system design aid, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.21-26, April 05-09, 1987, Toronto, Ontario, Canada
• 16: BELLOTTI, V., BLANDFORD, A., DUKE, D., MACLEAN, A., MAY, J., AND NIGAY, L. 1996. Interpersonal access control in computer-mediated communications: A systematic analysis of the design space. Hum. Comput. Interact. 11, 4, 357-432.
• 17: Ann E. Blandford , David J. Duke, Integrating user and computer system concerns in the design of interactive systems, International Journal of Human-Computer Studies, v.46 n.5, p.653-679, May 1997 [doi>10.1006/ijhc.1997.0116]
• 18: Ann E. Blandford , Philip J. Barnard , Michael D. Harrison, Using Interaction Framework to guide the design of interactive systems, International Journal of Human-Computer Studies, v.43 n.1, p.101-130, July 1995 [doi>10.1006/ijhc.1995.1037]
• 19: BORDEGONI, M. AND HEMMJE, M. 1993. A dynamic gesture language and graphical feedback for interaction in a 3d user interface. Comput. Graph. Forum 12, 1, 1-11.
• 20: BOWMAN, H. AND FACONTI, G. 1999. Analysing cognitive behaviour using LOTOS and Mexitl. Form. Asp. Comput. 11.
• 21: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 22: CARROLL, J. M. AND CARRITHERS, C. 1984. Blocking learner errors in a training wheels system. Hum. Factors 26, 377-389.
• 23: John M. Carroll , Mary Beth Rosson, Getting around the task-artifact cycle: how to make claims and design by scenario, ACM Transactions on Information Systems (TOIS), v.10 n.2, p.181-212, April 1992 [doi>10.1145/146802.146834]
• 24: CHAPANIS, A. 1975. Interactive human communication. Sci. Am. 232, 3 (Mar.), 36-42.
• 25: Alphonse Chapanis, Human factors in systems engineering, John Wiley & Sons, Inc., New York, NY, 1996
• 26: CLARK, H. 1996. Using Language. Cambridge University Press, New York, NY.
• 27: R. Cooper , J. Fox , J. Farringdon , T. Shallice, A systematic methodology for cognitive modelling, Artificial Intelligence, v.85 n.1-2, p.3-44, Aug. 1996 [doi>10.1016/0004-3702(95)00112-3]
• 28: DIX, A. 1991. Formal Methods for Interactive Systems. Academic Press, Inc., New York, NY.
• 29: DUKE, D. 1995. Reasoning about gestural interaction. Comput. Graph. Forum 14, 55-66.
• 30: DUKE, D. J. AND DUCE, D.A. 2000. The formalisation of a cognitive architecture and its application to reasoning about human computer interaction. Form. Asp. Comput..
• 31: DUKE, D. AND HARRISON, M. 1993. Abstract Interaction Objects. Comput. Graph. Forum 12, 1, C25C36.
• 32: David J. Duke , Michael D. Harrison, A Theory of Presentations, Proceedings of the Second International Symposium of Formal Methods Europe on Industrial Benefit of Formal Methods, p.271-290, October 24-18, 1994
• 33: David J. Duke , Michael D. Harrison, From Formal Models to Formal Methods, Proceedings of the Workshop on Software Engineering and Human-Computer Interaction, p.159-173, May 16-17, 1994
• 34: DUKE, D. J. AND HARRISON, M. 1995b. Interaction and task requirements. In Proceedings of Eurographics Workshop on Design, Specification and Verification of Interactive Systems (DSV-IS'95), P. Palanque and R. Bastide, Eds. Springer-Verlag, Vienna, Austria, 54-75.
• 35: DUKE, D. J. AND BARNARD, P.J. 1998. Syndetic modelling. Hum. Comput. Interact. 13, 4, 337-393.
• 36: D. J. Duke , P. J. Barnard , J. May , D. A. Duce, Systematic Development of the Human Interface, Proceedings of the Second Asia Pacific Software Engineering Conference, p.313, December 06-09, 1995
• 37: DuPuY, R. E. AND DUPUY, T. N., Eds. 1993. The Collins Encyclopedia of Military History. HarperCollins Publishers, New York, NY.
• 38: FURNAS, G. W. 2000. Future Design: Mindful of the Moras. In Human-Computer Interaction in the New Millennium, J. M. Carroll Addison-Wesley, Reading, MA.
• 39: Alison J. K. Green , Philip J. Barnard, Iconic interfacing: The role of icon distinctiveness and fixed or variable screen locations, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.457-462, August 27-31, 1990
• 40: HAMMOND, N. V. AND BARNARD, P. 1982. Usability and its multiple determination for the occasional user of interactive systems. In Pathways to the Information Society, M. B. Williams, Ed. North Oxford Academic Publ. Co. Ltd., Oxford, UK, 543-548.
• 41: HARRISON, M. D. AND BARNARD, P. 1993. On defining the requirements for interaction. In Proceedings of the 1st International Symposium on Requirements Engineering (RE '93, San Diego, CA), S. Fickas and A. C. W. Finklestein, Eds. IEEE Computer Society Press, Los Alamitos, CA, 50-55.
• 42: HARmSON, M. AND TORRES, J., Eds. 1997. Design, Specification and Verification of Interactive Systems'97. Springer-Verlag, Vienna, Austria.
• 43: C. A. R. Hoare, How Did Software Get So Reliable Without Proof?, Proceedings of the Third International Symposium of Formal Methods Europe on Industrial Benefit and Advances in Formal Methods, p.1-17, March 18-22, 1996
• 44: P. A. Lindsay , C. B. Jones , K. D. Jones , R. D. Moore , B. Ritchie , A. C. Wills, Mural: A Formal Development Support System, Springer-Verlag New York, Inc., Secaucus, NJ, 1991
• 45: Thomas K. Landauer, Relations between cognitive psychology and computer system design, Interfacing thought: cognitive aspects of human-computer interaction, MIT Press, Cambridge, MA, 1987
• 46: LEAVITT, H.J. 1951. Some effects of certain communication patterns on group performance. J. Abn. Soc. Pysch. 46, 38-50.
• 47: Wai On Lee, The effects of skill development and feedback on action slips, Proceedings of the conference on People and computers VII, p.73-86, January 1993, York, United Kingdom
• 48: MARR, D. 1982. Vision. W. H. Freeman and Co., New York, NY.
• 49: MACLEAN, A., YOUNG, R. M., BELLOTTI, V. M. E., AND MORAN, T. P. 1991. Questions, options, and criteria: Elements of design space analysis. Human-Comput. Interact. 6, 3-4, 201-250.
• 50: Thomas W. Malone , Kevin Crowston, The interdisciplinary study of coordination, ACM Computing Surveys (CSUR), v.26 n.1, p.87-119, March 1994 [doi>10.1145/174666.174668]
• 51: MAY, J. AND BARNARD, P. 1995a. The case for supportive evaluation during design. Interact. Comput. 7, 115-144.
• 52: MAY, J. AND BARNARD, P.J. 1995b. Cinematography and interface design. In Proceedings of the 3rd IFIP Conference on Human-Computer Interaction (INTERACT '95, Lillehammer, Norway, June 27-29), K. Nordby, P. H. Helmersen, D. J. Gilmore, and S. A. Arnesen, Eds. Chapman and Hall, Ltd., London, UK, 26-31.
• 53: Jon May , Philip J. Barnard, Modelling multimodal interaction: A theory-based technique for design analysis support, Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.667-668, July 14-18, 1997
• 54: MAY, J., BARNARD, P., AND BLANDFORD, A. 1993a. Using structural descriptions of interfaces to automate the modeling of user cognition. In Proceedings on User Modeling and User Adaptive Interfaces, 27-64.
• 55: MAY, J., SCOTT, S., AND BARNARD, P. 1995. Structuring Displays: A Psychological Guide. Eurographics Tutorial Notes PS95 TN4.
• 56: MAY, J., TWEEDm, L., AND BARNARD, P. 1993b. Modeling user performance in visually based interactions. In People and Computers VIII: Proceedings of the HCI'93 Conference (HCI '93, Loughborough, England), A. Alty and S. Guest, Eds. Cambridge University Press, New York, NY, 95-110.
• 57: MEYER, D. AND KIERAS, D. 1997. A computational theory of executive cognitive processes and multiple-task performance: Part 1. Psychol. Rev. 104, 3-65.
• 58: R. Milner, Communication and concurrency, Prentice-Hall, Inc., Upper Saddle River, NJ, 1989
• 59: Robin Milner, Elements of interaction: Turing award lecture, Communications of the ACM, v.36 n.1, p.78-89, Jan. 1993 [doi>10.1145/151233.151240]
• 60: Allen Newell, Unified theories of cognition, Harvard University Press, Cambridge, MA, 1990
• 61: NEWELL, S. AND CARD, S. K. 1985. The prospects for science in human computer interaction. Hum. Comput. Interact. 1,209-242.
• 62: Allen Newell, Human Problem Solving, Prentice-Hall, Inc., Upper Saddle River, NJ, 1972
• 63: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 64: Laurence Nigay , Joëlle Coutaz, A generic platform for addressing the multimodal challenge, Proceedings of the SIGCHI conference on Human factors in computing systems, p.98-105, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223917]
• 65: Donald A. Norman, Design principles for human-computer interfaces, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.1-10, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801571]
• 66: Sam Owre , John Rushby , Natarajan Shankar , Friedrich von Henke, Formal Verification for Fault-Tolerant Architectures: Prolegomena to the Design of PVS, IEEE Transactions on Software Engineering, v.21 n.2, p.107-125, February 1995 [doi>10.1109/32.345827]
• 67: Philippe Palanque , Fabio Paterno, Formal Methods in Human-Computer Interaction, Springer-Verlag New York, Inc., Secaucus, NJ, 1997
• 68: RUDISILL, M., LEWIS, C., POLSON, P., AND MCKAY, T. 1996. Human-Computer Interface Design: Success Stories, Emerging Methods and Real World Context. Morgan Kaufmann Publishers Inc., San Francisco, CA.
• 69: SCOTT, S., BARNARD, P. J., AND MAY, J. 2001. Specifying executive representations and processes in number generation tasks. Q. J. Exp. Psychol..
• 70: SHAW, M. E. 1954. Some effects of problem complexity upon problem solving efficiency in different communication nets. J. Exp. Psychol. 48, 211-217.
• 71: Lucy A. Suchman, Plans and situated actions: the problem of human-machine communication, Cambridge University Press, New York, NY, 1987
• 72: TEASDALE, J. D. AND BARNARD, P. 1993. Affect, Cognition and Change: Re-modeling Depressive Thought. Lawrence Erlbaum Associates, Inc., Mahwah, NJ.
• 73: Susanne Van Mulken , Elisabeth André , Jochen Müller, The Persona Effect: How Substantial Is It?, Proceedings of HCI on People and Computers XIII, p.53-66, January 1998
• 74: Elizabeth S. Veinott , Judith S. Olson , Gary M. Olson , Xiaolan Fu, Video matters!: when communication ability is stressed, video helps, CHI '97 extended abstracts on Human factors in computing systems: looking to the future, March 22-27, 1997, Atlanta, Georgia [doi>10.1145/1120212.1120411]
• 75: Janet H. Walker , Lee Sproull , R. Subramani, Using a human face in an interface, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.85-91, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191708]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.1 Systems and Information Theory
          Subjects: General systems theory

General Terms:
Design, Human Factors, Theory

Keywords:
cognitive models, computing system models, models of interaction