Supporting concurrency, communication, and synchronization in human-computer interaction—the Sassafras UIMS

ABSTRACT

Sassafras is a prototype User Interface Management System (UIMS) specifically designed to support a wide range of user interface styles. In particular, it supports the implementation of user interfaces where the user is free to manipulate multiple input devices and perform several (possibly related) tasks concurrently. These interfaces can be compactly represented and efficiently implemented without violating any of the rules of well-structured programming. Sassafras also supports elaborate run-time communication and synchronization among the modules that make up the user interface. This is needed to implement user interfaces that have context-sensitive defaults, and it simplifies recovery from semantic errors. Sassafras is based on a new language for specifying the syntax of human-computer dialogues known as Event-Response Language (ERL) and a new run-time structure and communication mechanism for UIMSs known as the Local Event Broadcast Method (LEBM). Both ERL and LEBM are described in detail, and implementation techniques are presented. The effectiveness of Sassafras is demonstrated by describing two interfaces that have been implemented with Sassafras.

REFERENCES

• 1: Richard J. Beach , John C. Beatty , Kellogg S. Booth , Darlene A. Plebon , Eugene L. Fiume, The message is the medium: Multiprocess structuring of an interactive paint program, Proceedings of the 9th annual conference on Computer graphics and interactive techniques, p.277-287, July 26-30, 1982, Boston, Massachusetts, United States
• 2: Teresa Bleser , James D. Foley, Towards specifying and evaluating the human factors of user-computer interfaces, Proceedings of the 1982 conference on Human factors in computing systems, p.309-314, March 15-17, 1982, Gaithersburg, Maryland, United States [doi>10.1145/800049.801801]
• 3: BLESER, T.W. A formal specification and computer-assisted evaluation of person-computer interfaces. GWU-IIST Rep. 83-18, George Washington Univ., Washington, D.C., 1983.
• 4: BOIES, S. J., GOULD, J. D., LEVY, S., RICHARDS, J. T., AND SCHOONARD, J. W. The 1984 Olympic message system--A case study in system design. Res. Rep. RC-11138, IBM, Yorktown Heights, N.Y., 1985.
• 5: W. Buxton , B. Myers, A study in two-handed input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.321-326, April 13-17, 1986, Boston, Massachusetts, United States
• 6: BUXTON, W., FIUME, E., HILL, R., LEE, A., AND WOO, C. Continuous hand-gesture driven input, in Proceedings of Graphics interface '83 (Edmonton, Aita., Canada, May 9-13). Canadian Man-Machine Communications Society, 1983, pp. 191-195.
• 7: BUXTON, W., HILL, R., AND ROWLEY, P. Issues and techniques in touch-sensitive tablet input. 11{ 2"J, blYJ OIUUZ~2"k~1Z 04) It.wUl$}Ul-Ull~C~. _#~ I UL.I;f.~f.Uld~,), %..,UIIi,lJbbl,,. vt.ll U~.ll&. 1,.7, ~n l.O--,~,g~"l;,
• 8: W. Buxton , M. R. Lamb , D. Sherman , K. C. Smith, Towards a comprehensive user interface management system, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.35-42, July 25-29, 1983, Detroit, Michigan, United States
• 9: BUXTON, W. A. S., AND SNIDERMAN, R. Iteration in the design of the human-computer interface. In Proceedings, 13th Annual Meeting, Human Factors Association of Canada. 1980, pp. 72-81.
• 10: Luca Cardelli , Rob Pike, Squeak: a language for communicating with mice, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.199-204, Jul. 1985
• 11: ENDERLE, G. Report on the interface of the UIMS to the application. In User Interface Management Systems, G. Pfaff, Ed. Springer-Verlag, New York, 1985, pp. 21-29. (Report on the activity of the working group on the interface between the application and the UIMS from the IFIP/EG Workshop on User Interface Management Systems, Seeheim, Federal Republic of Germany, October 1983.)
• 12: ENGELBART, D. C. Design considerations for knowledge workshop terminals. In Proceedings o/the National Computer Conference (June 4-8), vol. 42. AFIPS Press, Reston, Va., 1973, pp. 221-227.
• 13: ENGELBART, D. C., AND ENGLISH, W.K. A research center for augmenting human intellect. In Proceedings of the Fall Joint Computer Conference (San Francisco, Calif., Dec.), vol. 33. AFIPS
• 14: James D. Foley , Andries Van Dam, Fundamentals of interactive computer graphics, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1982
• 15: National Research Council of Canada, Ottawa, Canada, 1983.
• 16: GREEN, M. Report on dialogue specification tools. In User Interlace Management Systems, G. Pfaff, Ed. Springer-Verlag, New York, 1985. (Report on the activity of the working group on dialogue specification from the IFIP/EG Workshop on User Interface Management Systems, Seeheim, Federal Republic of Germany, October 1983.)
• 17: D. A. Henderson, Jr., The Trillium user interface design environment, Proceedings of the SIGCHI conference on Human factors in computing systems, p.221-227, April 13-17, 1986, Boston, Massachusetts, United States
• 18: Ralph Douglas Hill , R. M. Baecker , W. A. Buxton, Supporting concurrency, communication and synchronization in human-computer interaction, 1987
• 19: HILL, R.D. Sassafras demonstration video tape. Submitted for publication.
• 20: C. A. R. Hoare, Communicating sequential processes, Communications of the ACM, v.21 n.8, p.666-677, Aug. 1978 [doi>10.1145/359576.359585]
• 21: HOPGOOD, F. R. A., AND DUCE, D.A. A production system approach to interactive graphic program design. In Methodology o{ Interaction, R. A. Guedj, Ed. North-Holland, Amsterdam,
• 22: Robert J. K. Jacob, Using formal specifications in the design of a human-computer interface, Communications of the ACM, v.26 n.4, p.259-264, April 1983 [doi>10.1145/2163.358093]
• 23: Robert E. Kraut , Stephen J. Hanson , James M. Farber, Command use and interface design, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.120-124, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801594]
• 24: R. E. A. Mason , T. T. Carey, Prototyping interactive information systems, Communications of the ACM, v.26 n.5, p.347-354, May 1983 [doi>10.1145/69586.358137]
• 25: Alan S. Neal , Roger M. Simons, Playback: A method for evaluating the usability of software and its documentation, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.78-82, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801585]
• 26: S. J. Payne , T. R.G. Green, The user's perception of the interaction language: A two-level model, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.202-206, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801611]
• 27: PFAFF, G., Ed. User Inter~ace Management Systems. Springer-Verlag, New York, 1985. (Proceedings of the IFIP/EG Workshop on User Interface Management Systems, Seeheim, Federal Republic of Germany, October 1983.)
• 28: REISNER, P. Formal grammar and human factors design of an interactive graphics system. IEEE Trans. So/tw. Eng. SE-7, 2 (Mar. 1981), 229-240.
• 29: SHNEIDERMAN, B. Direct manipulation: A step beyond programming languages. Computer 16, 8 (Aug. 1983), 57-69.
• 30: William Swartout , Robert Balzer, On the inevitable intertwining of specification and implementation, Communications of the ACM, v.25 n.7, p.438-440, July 1982 [doi>10.1145/358557.358572]
• 31: TANNER, P. P., AND BUXTON, W. A. S. Some issues in future user interface management system development. In User interface Management Systems, G. Pfaff, Ed. Springer-Verlag, New v,,,~ , a~, ,,., n~_~a (Invited ........... +o,t o+ TI~TD WL~_ K 9 Workshop ,,,, T Ta---. T~,+--v~ea,,- Management, Seeheim, Federal Republic of Germany, October 1983.)
• 32: TANNER, P. P., WEIN, M., GENTLEMAN, W. M., MACKAY, S. A., AND STEWART, D.A. The user interface of AHA~o, n rnhntica rm,ltit~.qking multiprocessor workstation. In Proceedings of t._he !st International Con{erence and Exhibition on Computer Workstations (San Jose, Calif.). 1985, pp. 90-98.
• 33: James J. Thomas , Griffith Hamlin, Graphical input interaction technique (GIIT), ACM SIGGRAPH Computer Graphics, v.17 n.1, p.5-30, January 1983 [doi>10.1145/988584.988585]
• 34: Anthony I. Wasserman , David T. Shewmake, Rapid prototyping of interactive information systems, ACM SIGSOFT Software Engineering Notes, v.7 n.5, p.171-180, December 1982
• 35: XEROX CORP. Interlisp Re{erence Manual. Xerox Corp., Pasadena, Calif., 1983.
• 36: ZISMAN, M.D. Use of production systems to model asynchronous, concurrent processes. In Pattern Directed ln{erence Systems, D. Waterman, Ed. Academic Press, Orlando, Fla., 1978, pp. 53-68.

INDEX TERMS

Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

          Nouns: Sassafras

  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
          Nouns: UIMS

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Languages; Interaction techniques

General Terms:
Design, Experimentation, Human Factors