Words from pictures for dual-channel processing

ABSTRACT

Combining graphics and text representations of complex systems, Object-Process Methodology makes it easier to understand technical ideas, whether or not one is technically oriented by nature or training.

REFERENCES

• 1: Baddeley, A. Working memory. Science 255, 5044 (1992), 556--559.
• 2: Chandler, P. and Sweller, J. Cognitive load theory and the format of instruction. Cognition and Instruction 8, 4 (1991), 293--332.
• 3: Clark, J. and Paivio, A. Dual coding theory and education. Educational Psychology Review 3, 3 (Sept. 1991), 149--210.
• 4: Dov Dori , Edward F. Crawley, Object-Process Methodology: A Holistic Systems Paradigm, Springer-Verlag New York, Inc., Secaucus, NJ, 1999
• 5: Dori, D., Reinhartz-Berger, I., and Sturm, A. Developing complex systems with object-process methodology using OPCAT. In Proceedings of Conceptual Modeling---ER 2003, Lecture Notes in Computer Science 2813 (Chicago, Oct. 13--16). Springer Verlag, Berlin, 2003, 570--572, 2003; software available at www.opcat.com.
• 6: Glenberg, A. and Langston, W. Comprehension of illustrated text: Pictures help to build mental models. Journal of Memory and Language 31, 2 (Apr. 1992), 129--151.
• 7: Hegarty, M. Mental animation: Inferring motion from static displays of mechanical systems. Journal of Experimental Psychology: Learning, Memory and Cognition 18, 15 (Sept. 1992), 1084--1102.
• 8: Mayer, R. The promise of multimedia learning: Using the same instructional design methods across different media. Learning and Instruction 13, 2 (Apr. 2003), 125--139.
• 9: Mayer, R. and Moreno, R. Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist 38, 1 (2003), 43--52.
• 10: Miller, G. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 63 (1956), 81--97.
• 11: Stenning, K. and Oberlander, J. A cognitive theory of graphical and linguistic reasoning: Logic and implementation. Cognitive Science 19, 1 (Jan.--Mar. 1995), 97--140.
• 12: von Glaserfeld, E. The Construction of Knowledge: Contributions to Conceptual Semantics. Intersystems Publications, Seaside, CA, 1987.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
      D.2.6 Programming Environments
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications
      D.3.3 Language Constructs and Features

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

  J. Computer Applications
  J.6 COMPUTER-AIDED ENGINEERING