Spatial Hypertext for linear-information authoring: Interaction design and system development based on the ART Design principle

ABSTRACT

We have developed a series of spatial hypertext systems that support early stages of linear-information authoring, such as paper writing and movie editing. They are designed based on the ART (Amplifying Representational Talkback) principle, which emphasizes the importance of visual interaction and the power of external representations. The systems use spatial hypertext not as a medium for representing final artifacts but as a means of interacting with linear information during an authoring process. This paper first describes the role and the effect of the spatial hypertext representation plays in support of early stages of authoring linear information, and explains the ART interaction model for the approach. The ART#001 system, which supports early stages of writing, is described in detail and the other three ART systems are used to illustrate the essential aspects of our approach. The paper concludes with a discussion on the semiotic interpretation of spatial hypertext as a representation, and on the innovative use of spatial hypertext as an instrument to compose information, rather than as an information medium.

REFERENCES

• 1: Arnheim, R. Visual Thinking. University of California Press, Berkeley, 1969
• 2: Michel Beaudouin-Lafon, Instrumental interaction: an interaction model for designing post-WIMP user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.446-453, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332473]
• 3: Michel Beaudouin-Lafon , Wendy E. Mackay, Reification, polymorphism and reuse: three principles for designing visual interfaces, Proceedings of the working conference on Advanced visual interfaces, p.102-109, May 2000, Palermo, Italy [doi>10.1145/345513.345267]
• 4: Mark Bernstein , Jay David Bolter , Michael Joyce , Elli Mylonas, Architectures for volatile hypertext, Proceedings of the third annual ACM conference on Hypertext, p.243-260, December 15-18, 1991, San Antonio, Texas, United States [doi>10.1145/122974.122999]
• 5: Bruner, J. The Culture of Education. Harvard University Press, Cambridge, MA, 1996
• 6: Stuart K. Card , Jock D. Mackinlay , Ben Shneiderman, Readings in information visualization: using vision to think, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 7: Alan Cooper , Paul Saffo, The Inmates Are Running the Asylum, Macmillan Publishing Co., Inc., Indianapolis, IN, 1999
• 8: de-Souza(Ed.), C.S. Special Issue on Semiotic Approaches to User Interface Design. in Knowledge-Based Systems Journal, Elsevier Science, 2001
• 9: J. P. Djajadiningrat , C. J. Overbeeke , S. A. G. Wensveen, Augmenting fun and beauty: a pamphlet, Proceedings of DARE 2000 on Designing augmented reality environments, p.131-134, April 2000, Elsinore, Denmark [doi>10.1145/354666.354680]
• 10: Do, E.Y.-L. and Gross, M.D. Inferring Design Intentions from Sketches: An Investigation of Freehand Drawing Conventions in Design Proc. of the 2nd Conf. on Computer Aided Architectural Design Research in Asia (CAADRIA'97), Hu's Publishing, Taipei, Taiwan, 1997, 217--227
• 11: Goldschmidt, G. On Visual Thinking. in Design Studies, 1994, 158--174
• 12: Lawson, B. Design in Mind. Architectural Press, MA, 1994
• 13: Lawson, B. Designing with Drawings. in How Designers Think: The Design Process Demystified, Architectural Press, MA, 1997, 241--259
• 14: Catherine C. Marshall , Frank M. Shipman, III, Spatial hypertext: designing for change, Communications of the ACM, v.38 n.8, p.88-97, Aug. 1995 [doi>10.1145/208344.208350]
• 15: Nakakoji, K. and Yamamoto, Y. What does the Representation Talk Back to You? in Knowledge-Based Systems Journal, Elsevier Science,, 2001, 449--453
• 16: Kumiyo Nakakoji , Yasuhiro Yamamoto , Shingo Takada , Brent N. Reeves, Two-dimensional spatial positioning as a means for reflection in design, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.145-154, August 17-19, 2000, New York City, New York, United States [doi>10.1145/347642.347697]
• 17: Reisberg, D. External Representations and the Advantages of Externalizing One's Thoughts Proceedings of the 9th Annual Conf. of the Cognitive Science Society, 1987
• 18: Rosenberg, J. User Interface Behaviors for Spatially Overlaid Implicit Structures. in Workshop on Spatial Hypertext (Hypertext 2001), Arhus, Denmark, 2001
• 19: Schoen, D.A. The Reflective Practitioner: How Professionals Think in Action. Basic Books, New York, 1983
• 20: Frank M. Shipman, III , Haowei Hsieh , Preetam Maloor , J. Michael Moore, The visual knowledge builder: a second generation spatial hypertext, Proceedings of the twelfth ACM conference on Hypertext and Hypermedia, August 14-18, 2001, Århus, none, Denmark [doi>10.1145/504216.504245]
• 21: Frank M. Shipman, III , Catherine C. Marshall , Mark LeMere, Beyond location: hypertext workspaces and non-linear views, Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, p.121-130, February 21-25, 1999, Darmstadt, Germany [doi>10.1145/294469.294498]
• 22: Snograss, A.B. and Coyne, R.D. Is Designing Hermeneutical? in Architectural Theory Review, Journal of the Department of Architecture, The University of Sydney, 1997, 65--97
• 23: Shingo Takada , Yasuhiro Yamamoto , Kumiyo Nakakoji, Two-Dimensional Positioning as Visual Thinking, Proceedings of the First International Conference on Theory and Application of Diagrams, p.437-452, September 01-03, 2000
• 24: Brad Weed, The industrial design of the software industry, ACM SIGCHI Bulletin, v.28 n.3, p.8-11, July 1996 [doi>10.1145/231132.231134]
• 25: Yamamoto, Y., Nakakoji, K. and Takada, S. Hands-on Representations in a Two-Dimensional Space for Early Stages of Design. in Knowledge-Based Systems Journal, Elsevier Science, 2000, 375--384
• 26: Y. Yamamoto , S. Takada , M. Gross , K. Nakakoji, Representational Talkback: An Approach to Support Writing as Design, Proceedings of the Third Asian Pacific Computer and Human Interaction, p.125, July 15-17, 1998
• 27: Zhang, J. The Nature of External Representations in Problem Solving. in Cognitive Science, 1997, 179--217

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors

Keywords:
cognitive models, external representations, instrumental interaction, interaction design, spatial hypertext, the ART (amplifying representational talkback) principle