A Case Study to Distill Structural Scaffolding Guidelines for Scaffolded Software Environments

ABSTRACT

A challenge for HCI researchers and designers involves developing software tools for learners to support them in mindfully doing and learning complex new work practices. Such "learner-centered" tools incorporate scaffolds-software features that address the cognitive obstacles learners face so they can engage in the work in an educationally productive manner. However, designers still lack specific scaffolding design guidelines for developing effective scaffolded tools. The HCI contribution of this paper is a set of scaffolding guidelines distilled from an empirical case study. The study evaluated Symphony, a scaffolded environment for high school students learning science inquiry. The study evaluated the "effects with" the Symphony scaffolds, which described how students worked with the scaffolds to do their science work. The scaffolds were evaluated using several usability and learner-centered criteria, and the resulting information was correlated with structural characteristics of the scaffolds to distill a set of structural scaffolding guidelines

REFERENCES

• 1: American Association for the Advancement of Science Benchmarks for Science Literacy. Oxford University Press, 1993.
• 2: Chi, M. Quantifying Qualitative Analyses of Verbal Data: A Practical Guide. Journal of the Learning Sciences, 6 (3). 271--315, 1997.
• 3: Collins, A. Design Issues for Learning Environments. In S. Vosniadou, E. De Corte, R. Glaser, and H. Mandl (Eds.) International Perspectives on the Design of Technology-Supported Learning Environments, Lawrenece Erlbaum Associates, 1996.
• 4: Collins, A., Brown, J.S. and Newman, S.E. Cognitive Apprenticeship: Teaching the Crafts of Reading, Writing, and Mathematics. In L.B. Resnick (Ed.) Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser, Lawrence Erlbaum Associates, 1989.
• 5: Favorin, M. and Kuutti, K. Supporting Learning at Work by Making Work Activities Visible Through Information Technology. Machine-Mediated Learning, 5 (2). 109--118, 1996.
• 6: Mark Joseph Guzdial, EMILE: software-realized scaffolding for science learners in mixed media, University of Michigan, Ann Arbor, MI, 1993
• 7: Deborah J. Mayhew, The usability engineering lifecycle: a practitioner's handbook for user interface design, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 8: Shari Jackson Metcalf , Elliot Soloway, The design of guided learner-adaptable scaffolding in interactive learning environments, 1999
• 9: National Research Council National Science Education Standards. National Academy Press, 1996.
• 10: Perkins, D.N. What is Understanding? In M.S. Wiske (Ed.) Teaching for Understanding: Linking Research with Practice, Jossey-Bass Publishers, San Francisco, CA, 1998.
• 11: Piaget, J. The Construction of Reality in the Child. Basic Books, 1954.
• 12: Christopher Quintana , Elliot Soloway, Symphony: a case study for exploring and describing design methods and guidelines for learner-centered design, 2001
• 13: Quintana, C., Carra, A., Krajcik, J. and Soloway, E. Learner-Centered Design: Reflections and New Directions. In J.M. Carroll (Ed.) Human Computer Interaction in the New Millennium, ACM Press, New York, 605--626, 2001.
• 14: Chris Quintana , Jim Eng , Andrew Carra , Hsin-Kai Wu , Elliot Soloway, Symphony: a case study in extending learner-centered design through process space analysis, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.473-480, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303136]
• 15: Chris Quintana , Eric Fretz , Joseph Krajcik , Elliot Soloway, Evaluation criteria for scaffolding in learner-centered tools, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633396]
• 16: Quintana, C., Krajcik, J. and Soloway, E. Exploring a Description and Methodology for Learner-Centered Design. In W. Heineke and L. Blasi (Eds.) Methods of Evaluating Educational Technology, Information Age Publishing, Greenwich, CT, 2001.
• 17: Salomon, G., Perkins, D.N. and Globerson, T. Partners in Cognition: Extending Human Intelligence with Intelligent Technologies. Educational Researcher (April), 1991.
• 18: Schoenfeld, A.H. What's All The Fuss About Metacognition? In A.H. Schoenfeld (Ed.) Cognitive Science and Mathematics Education, Lawrence Erlbaum Associates, 1987.
• 19: Kamran Sedig , Maria Klawe , Marvin Westrom, Role of interface manipulation style and scaffolding on cognition and concept learning in learnware, ACM Transactions on Computer-Human Interaction (TOCHI), v.8 n.1, p.34-59, March 2001 [doi>10.1145/371127.371159]
• 20: Singer, J., Marx, R., Krajcik, J. and Clay Chambers, J. Constructing Extended Inquiry Projects: Curriculum Materials for Science Education Reform. Educational Psychologist, 35 (3). 165--178, 2000.
• 21: Wood, D., Bruner, J.S. and Ross, G. The Role of Tutoring in Problem-Solving. Journal of Child Psychology and Psychiatry, 17. 89--100, 1975.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.1 Requirements/Specifications
          Subjects: Tools

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.0 General
          Subjects: Cognitive simulation

General Terms:
Design, Human Factors, Performance, Theory

Keywords:
design guidelines, educational applications, scaffolding