A new model for handling input

ABSTRACT

Although there has been important progress in models and packages for the output of graphics to computer screens, there has been little change in the way that input from the mouse, keyboard, and other input devices is handled. New graphics standards are still using a fifteen-year-old model even though it is widely accepted as inadequate, and most modern window managers simply return a stream of low-level, device-dependent input events. This paper presents a new model that handles input devices for highly interactive, direct manipulation, graphical user interfaces, which could be used in future toolkits, window managers, and graphics standards. This model encapsulates interactive behaviors into a few “Interactor” object types. Application programs can then create instances of these Interactor objects which hide the details of the underlying window manager events. In addition, Interactors allow a clean separation between the input handling, the graphics, and the application programs. This model has been extensively used as part of the Garnet system and has proven to be convenient, efficient, and easy to learn.

REFERENCES

• 1: William Buxton, Lexical and pragmatic considerations of input structures, ACM SIGGRAPH Computer Graphics, v.17 n.1, p.31-37, January 1983 [doi>10.1145/988584.988586]
• 2: W. Buxton , B. Myers, A study in two-handed input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.321-326, April 13-17, 1986, Boston, Massachusetts, United States
• 3: Stuart K. Card , Jock D. Mackinlay , George G. Robertson, The design space of input devices, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.117-124, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97263]
• 4: Luca Cardelli , Rob Pike, Squeak: a language for communicating with mice, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.199-204, July 1985
• 5: Luca Cardelli, Building user interfaces by direct manipulation, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.152-166, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62428]
• 6: Kenneth B. Evans , Peter P. Tanner , Marceli Wein, Tablet-based valuators that provide one, two, or three degrees of freedom, Proceedings of the 8th annual conference on Computer graphics and interactive techniques, p.91-97, August 03-07, 1981, Dallas, Texas, United States
• 7: FOLEY, J. D., AND WALLACE, V.L. The art of natural graphic man-machine conversation. In Proceedings IEEE 62, 4 (April 1974), pp. 462-471.
• 8: James D. Foley , Victor L. Wallace , Peggy Chan, The human factors of computer graphics interaction techniques, IEEE Computer Graphics and Applications, v.4 n.11, p.13-48, Nov. 1984
• 9: J. Foley , C. Gibbs , S. Kovacevic, A knowledge-based user interface management system, Proceedings of the SIGCHI conference on Human factors in computing systems, p.67-72, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57178]
• 10: Ralph D. Hill, Supporting concurrency, communication, and synchronization in human-computer interaction—the Sassafras UIMS, ACM Transactions on Graphics (TOG), v.5 n.3, p.179-210, July 1986 [doi>10.1145/24054.24055]
• 11: Robert J. K. Jacob, A specification language for direct-manipulation user interfaces, ACM Transactions on Graphics (TOG), v.5 n.4, p.283-317, Oct. 1986 [doi>10.1145/27623.27624]
• 12: Glenn E. Krasner , Stephen T. Pope, A cookbook for using the model-view controller user interface paradigm in Smalltalk-80, Journal of Object-Oriented Programming, v.1 n.3, p.26-49, Aug./Sept. 1988
• 13: Joel McCormack , Paul Asente, An overview of the X toolkit, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.46-55, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62407]
• 14: Jon Meads, The standards factor, ACM SIGCHI Bulletin, v.19 n.1, p.34-35, July 1987 [doi>10.1145/28189.28190]
• 15: B. A. Myers, Visual programming, programming by example, and program visualization: a taxonomy, Proceedings of the SIGCHI conference on Human factors in computing systems, p.59-66, April 13-17, 1986, Boston, Massachusetts, United States
• 16: Brad A. Myers, Creating user interfaces by demonstration, Academic Press Professional, Inc., San Diego, CA, 1988
• 17: Brad A. Myers, User-Interface Tools: Introduction and Survey, IEEE Software, v.6 n.1, p.15-23, January 1989 [doi>10.1109/52.16898]
• 18: B. A. Myers, Encapsulating interactive behaviors, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.319-324, March 1989
• 19: Brad A. Myers, Creating user interfaces using programming by example, visual programming, and constraints, ACM Transactions on Programming Languages and Systems (TOPLAS), v.12 n.2, p.143-177, April 1990 [doi>10.1145/78942.78943]
• 20: B. A. Myers , B. V. Zanden , R. B. Dannenberg, Creating graphical interactive application objects by demonstration, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.95-104, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73672]
• 21: Brad A. Myers , Dario A. Giuse , Roger B. Dannenberg , David S. Kosbie , Edward Pervin , Andrew Mickish , Brad Vander Zanden , Philippe Marchal, Garnet: Comprehensive Support for Graphical, Highly Interactive User Interfaces, Computer, v.23 n.11, p.71-85, November 1990 [doi>10.1109/2.60882]
• 22: MYERS, B. A., GIUSE, D., DANNENBERG, R. B., VANDER ZANDEN, B., KOSBIE, D., MARCHAL, P., PERVIN, E., MICKISH, A., KOLOJEJCHICK, J.A. The Garnet toolkit reference manuals: Support for highly-interactive, graphical user interfaces in Lisp. Tech. Rep. CMU-CS-90-117, Computer Science Dept., Carnegie Mellon Univ. March, 1990.
• 23: Jakob Nielsen, Classification of dialog techniques, ACM SIGCHI Bulletin, v.19 n.2, p.30-35, October 1, 1987 [doi>10.1145/36111.36115]
• 24: D R Olsen, Jr., Larger issues in user interface management, ACM SIGGRAPH Computer Graphics, v.21 n.2, p.134-137, April 1987 [doi>10.1145/24919.24932]
• 25: D R Olsen, Jr., Larger issues in user interface management, ACM SIGGRAPH Computer Graphics, v.21 n.2, p.134-137, April 1987 [doi>10.1145/24919.24932]
• 26: PALAY, A. J., HANSEN, W. J., KAZAR, i. L., SHERMAN, M., WADLOW, M. G., NEUENDORFFER, T. P., STERN, Z., BADER, M., PETERS, T. The Andrew toolkit--An overview. In the Proceedings Winter Usenix Technical Conference (Dallas, Tex, Feb. 1988), pp. 9-21.
• 27: G. E. Pfaff, User Interface Management Systems, Springer-Verlag New York, Inc., Secaucus, NJ, 1985
• 28: Draft Proposal American National Standard for the Functional Specification of the Programmer's Hierarchical Interactive Graphics Standard (PHIGS). American National Standards Committee X3Hc/84-40, 1984.
• 29: John L. Sibert , William D. Hurley , Teresa W. Bleser, An object-oriented user interface management system, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.259-268, August 1986
• 30: Pedro Szekely , Brad Myers, A user interface toolkit based on graphical objects and constraints, ACM SIGPLAN Notices, v.23 n.11, p.36-45, Nov. 1988
• 31: Peter P. Tanner , Stephen A. MacKay , Darlene A. Stewart , Marceli Wein, A multitasking switchboard approach to user interface management, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.241-248, August 1986
• 32: Brad Vander Zanden , Brad A. Myers, Automatic, look-and-feel independent dialog creation for graphical user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.27-34, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97248]
• 33: David A. Wilson , Larry S. Rosenstein , Daniel G. Shafer, Programming with MacApp, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

General Terms:
Design, Human Factors