User interface software tools

ABSTRACT

Almost as long as there have been user interfaces, there have been special software systems and tools to help design and implement the user interface software. Many of these tools have demonstrated significant productivity gains for programmers, and have become important commercial products. Others have proven less successful at supporting the kinds of user interfaces people want to build. This article discusses the different kinds of user interface software tools, and investigates why some approaches have worked and others have not. Many examples of commercial and research systems are included. Finally, current research directions and open issues in the field are discussed.

REFERENCES

• 1: CORPORATE Adobe Systems Inc., PostScript language reference manual (2nd ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990
• 2: APPLE COMPUTER 1985. Inside Macintosh. Addison-Wesley, Reading, Mass.
• 3: S. A. Bly , J. K. Rosenberg, A comparison of tiled and overlapping windows, Proceedings of the SIGCHI conference on Human factors in computing systems, p.101-106, April 13-17, 1986, Boston, Massachusetts, United States
• 4: BOOZ ALLEN AND HAMILTON 1992. NeXTStep vs. other development environments. Booz Alien and Hamilton, Inc. Report available from NEXT, Inc.
• 5: Alan Borning, The Programming Language Aspects of ThingLab, a Constraint-Oriented Simulation Laboratory, ACM Transactions on Programming Languages and Systems (TOPLAS), v.3 n.4, p.353-387, Oct. 1981 [doi>10.1145/357146.357147]
• 6: Alan Borning , Robert Duisberg, Constraint-based tools for building user interfaces, ACM Transactions on Graphics (TOG), v.5 n.4, p.345-374, Oct. 1986 [doi>10.1145/27623.29354]
• 7: A. Borning, Defining constraints graphically, Proceedings of the SIGCHI conference on Human factors in computing systems, p.137-143, April 13-17, 1986, Boston, Massachusetts, United States
• 8: W. Buxton , M. R. Lamb , D. Sherman , K. C. Smith, Towards a comprehensive user interface management system, ACM SIGGRAPH Computer Graphics, v.17 n.3, p.35-42, July 1983
• 9: Michael D. Byrne , Scott D. Wood , James D. Foley , David E. Kieras , Piyawadee Noi Sukaviriya, Automating interface evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.232-237, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191752]
• 10: Luca Cardelli, Building user interfaces by direct manipulation, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.152-166, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62428]
• 11: Luca Cardelli , Rob Pike, Squeak: a language for communicating with mice, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.199-204, Jul. 1985
• 12: CHIMERA, R. 1993. Evaluation of platform independent user interface builders. Tech. Rep. Working Paper 93-09, Human-Computer Interaction Laboratory, Univ. of Maryland.
• 13: DEPALMA, D. A. AND WOODmNG, S.D. 1993. Client/server power tools futures. Softw. Strat. Rep. 4, i (Apr.), 2-13. This is available only from Forrester Research, Cambridge, Mass.
• 14: Gene L. Fisher , Dale E. Busse , David A. Wolber, Adding rule-based reasoning to a demonstrational interface builder, Proceedings of the 5th annual ACM symposium on User interface software and technology, p.89-97, November 15-18, 1992, Monteray, California, United States [doi>10.1145/142621.142632]
• 15: Mark A. Flecchia , R. Daniel Bergeron, Specifying complex dialogs in ALGAE, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.229-234, April 05-09, 1987, Toronto, Ontario, Canada
• 16: Martin R. Frank , James D. Foley, Model-based user interface design by example and by interview, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.129-137, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168655]
• 17: Tom Gaskins, PEXlib programming manual, O'Reilly & Associates, Inc., Sebastopol, CA, 1992
• 18: Michael Gleicher, A graphics toolkit based on differential constraints, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.109-120, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168653]
• 19: Mark Green, A survey of three dialogue models, ACM Transactions on Graphics (TOG), v.5 n.3, p.244-275, July 1986 [doi>10.1145/24054.24057]
• 20: Nuno M. Guimarães , Nuno Correia , Telmo A. Carmo, Programming time in multimedia user interfaces, Proceedings of the 5th annual ACM symposium on User interface software and technology, p.125-134, November 15-18, 1992, Monteray, California, United States [doi>10.1145/142621.142637]
• 21: H. Rex Hartson , Deborah Hix, Human-computer interface development: concepts and systems for its management, ACM Computing Surveys (CSUR), v.21 n.1, p.5-92, March 1989 [doi>10.1145/62029.62031]
• 22: H. Rex Hartson , Antonio C. Siochi , D. Hix, The UAN: a user-oriented representation for direct manipulation interface designs, ACM Transactions on Information Systems (TOIS), v.8 n.3, p.181-203, July 1990 [doi>10.1145/98188.98191]
• 23: Philip J. Hayes , Pedro A. Szekely , Richard A. Lerner, Design alternatives for user interface management sytems based on experience with COUSIN, Proceedings of the SIGCHI conference on Human factors in computing systems, p.169-175, April 1985, San Francisco, California, United States
• 24: D. A. Henderson, Jr., The Trillium user interface design environment, Proceedings of the SIGCHI conference on Human factors in computing systems, p.221-227, April 13-17, 1986, Boston, Massachusetts, United States
• 25: Ralph D. Hill, The Rendezvous constraint maintenance system, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.225-234, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168665]
• 26: Ralph D. Hill, Supporting concurrency, communication, and synchronization in human-computer interaction—the Sassafras UIMS, ACM Transactions on Graphics (TOG), v.5 n.3, p.179-210, July 1986 [doi>10.1145/24054.24055]
• 27: Ralph D. Hill , Tom Brinck , John F. Patterson , Steven L. Rohall , Wayne T. Wilner, The Rendezvous language and architecture, Communications of the ACM, v.36 n.1, p.63-67, Jan. 1993 [doi>10.1145/151233.151238]
• 28: D. Hix, A procedure for evaluating human-computer interface development tools, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.53-61, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73667]
• 29: HUDSON, S.E. 1993. User interface specification using an enhanced spreadsheet model. Tech. Rep. GIT-GVU-93-20, Georgia Tech Graphics, Visualization and Usability Center.
• 30: Scott E. Hudson , John T. Stasko, Animation support in a user interface toolkit: flexible, robust, and reusable abstractions, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.57-67, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168648]
• 31: INGALLS, D. H.H. 1981. The Smalltalk graphics kernel. Byte Mag. 6, 8 (Aug.), 168-194.
• 32: Robert J. K. Jacob, A specification language for direct-manipulation user interfaces, ACM Transactions on Graphics (TOG), v.5 n.4, p.283-317, Oct. 1986 [doi>10.1145/27623.27624]
• 33: Jeff A. Johnson , Bonnie A. Nardi , Craig L. Zarmer , James R. Miller, ACE: building interactive graphical applications, Communications of the ACM, v.36 n.4, p.40-55, April 1993 [doi>10.1145/255950.153576]
• 34: Anthony Karrer , Walt Scacchi, Requirements for an extensible object-oriented tree/graph editor, Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology, p.84-91, October 03-05, 1990, Snowbird, Utah, United States [doi>10.1145/97924.97934]
• 35: Won Chul Kim , James D. Foley, Providing high-level control and expert assistance in the user interface presentation design, Proceedings of the SIGCHI conference on Human factors in computing systems, p.430-437, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169346]
• 36: James A. Landay , Brad A. Myers, Interactive sketching for the early stages of user interface design, Proceedings of the SIGCHI conference on Human factors in computing systems, p.43-50, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223910]
• 37: Mark A. Linton , John M. Vissides , Paul R. Calder, Composing User Interfaces with InterViews, Computer, v.22 n.2, p.8-22, February 1989 [doi>10.1109/2.19829]
• 38: Joel McCormack , Paul Asente, An overview of the X toolkit, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.46-55, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62407]
• 39: Brad Myers, Challenges of HCI design and implementation, interactions, v.1 n.1, p.73-83, Jan. 1994 [doi>10.1145/174800.174808]
• 40: Brad A. Myers, Languages for developing user interfaces, A. K. Peters, Ltd., Natick, MA, 1992
• 41: Brad A. Myers, Demonstrational Interfaces: A Step Beyond Direct Manipulation, Computer, v.25 n.8, p.61-73, August 1992 [doi>10.1109/2.153286]
• 42: Brad A. Myers, Separating application code from toolkits: eliminating the spaghetti of call-backs, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.211-220, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120805]
• 43: Brad A. Myers, Graphical techniques in a spreadsheet for specifying user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.243-249, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108903]
• 44: Brad A. Myers, A new model for handling input, ACM Transactions on Information Systems (TOIS), v.8 n.3, p.289-320, July 1990 [doi>10.1145/98188.98204]
• 45: MYERS, B.A. 1990b. All the Widgets. SIGGRAPH Vid. Rev. 57.
• 46: MYERS, B.A. 1990c. Taxonomies of visual programming and program visualization. J. Vis. Lang. Comput. 1, i (Mar.), 97-123.
• 47: Brad A. Myers, User-Interface Tools: Introduction and Survey, IEEE Software, v.6 n.1, p.15-23, January 1989 [doi>10.1109/52.16898]
• 48: Brad A. Myers, A Taxonomy of Window Manager User Interfaces, IEEE Computer Graphics and Applications, v.8 n.5, p.65-84, September 1988 [doi>10.1109/38.7762]
• 49: Brad A. Myers, Creating user interfaces by demonstration, Academic Press Professional, Inc., San Diego, CA, 1988
• 50: Brad A Myers, A complete and efficient implementation of covered windows, Computer, v.19 n.9, p.57-67, Sept. 1986 [doi>10.1109/MC.1986.1663332]
• 51: MYERS, B.A. 1984. The user interface for Sapphire. IEEE Comput. Graph. Appl. 4, 12 (Dec.), 13-23.
• 52: Brad A. Myers , Mary Beth Rosson, Survey on user interface programming, Proceedings of the SIGCHI conference on Human factors in computing systems, p.195-202, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142789]
• 53: Brad A. Myers , Brad Vander Zanden, Environment for rapidly creating interactive design tools, The Visual Computer: International Journal of Computer Graphics, v.8 n.2, p.94-116, Feb. 1992 [doi>10.1007/BF01900551]
• 54: Brad A. Myers , David Canfield Smith , Bruce Horn, Report of the “End-User Programming” working group, Languages for developing user interfaces, A. K. Peters, Ltd., Natick, MA, 1992
• 55: Brad A. Myers , Dario A. Giuse , Brad Vander Zanden, Declarative programming in a prototype-instance system: object-oriented programming without writing methods, ACM SIGPLAN Notices, v.27 n.10, p.184-200, Oct. 1992
• 56: Brad A. Myers , Dario A. Giuse , Roger B. Dannenberg , David S. Kosbie , Edward Pervin , Andrew Mickish , Brad Vander Zanden , Philippe Marchal, Garnet: Comprehensive Support for Graphical, Highly Interactive User Interfaces, Computer, v.23 n.11, p.71-85, November 1990 [doi>10.1109/2.60882]
• 57: Brad A. Myers , Richard G. McDaniel , David S. Kosbie, Marquise: creating complete user interfaces by demonstration, Proceedings of the SIGCHI conference on Human factors in computing systems, p.293-300, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169225]
• 58: B. A. Myers , B. V. Zanden , R. B. Dannenberg, Creating graphical interactive application objects by demonstration, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.95-104, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73672]
• 59: Robert Neches , Jim Foley , Pedro Szekely , Piyawadee Sukaviriya , Ping Luo , Srdjan Kovacevic , Scott Hudson, Knowledgeable development environments using shared design models, Proceedings of the 1st international conference on Intelligent user interfaces, p.63-70, January 04-07, 1993, Orlando, Florida, United States [doi>10.1145/169891.169901]
• 60: NEWBERY, F.J. 1988. An interface description language for graph editors. In 1988 IEEE Workshop on Visual Languages. IEEE Computer Society, Washington, D.C., 144-149.
• 61: NEWMAN, W.M. 1968. A system for interactive graphical programming. In AFIPS Spring Joint Computer Conference. AFIPS, Montvale, N.J., 47-54.
• 62: Jakob Nielsen, Noncommand user interfaces, Communications of the ACM, v.36 n.4, p.83-99, April 1993 [doi>10.1145/255950.153582]
• 63: Dan Olsen, User Interface Management Systems: Models and Algorithms, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1992
• 64: D. R. Olsen, Jr., A programming language basis for user interface, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.171-176, March 1989
• 65: D R Olsen, Jr., Larger issues in user interface management, ACM SIGGRAPH Computer Graphics, v.21 n.2, p.134-137, April 1987 [doi>10.1145/24919.24932]
• 66: Dan R. Olsen, Jr., MIKE: the menu interaction kontrol environment, ACM Transactions on Graphics (TOG), v.5 n.4, p.318-344, Oct. 1986 [doi>10.1145/27623.28868]
• 67: Dan R Olsen, Jr. , Elizabeth P. Dempsey, SYNGRAPH: A graphical user interface generator, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.43-50, July 25-29, 1983, Detroit, Michigan, United States
• 68: Dan R. Olsen , Bradley W. Halversen, Interface usage measurements in a user interface management system, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.102-108, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62420]
• 69: OLSEN, D. R., JR., FOLEY, J. D., HUDSON, S. E., MmLER, J. AND MYERS, B. 1993. Research directions for user interface software tools. Behav. Inf. Tech. 12, 2 (Mar.-Apr.), 80-97.
• 70: OUSTERHOUT, J. K. 1991. An Xll toolkit based on the Tcl language. In Winter USENIX. USENIX Assoc., Berkeley, Calif., 105-115.
• 71: PALEY, A. J., HANSEN, W., KAZAR, M., SHERMAN, M., WADLOW, M., NEUEUNDORFFER, T., STERN, Z., BADISI~, M., Ar/D PI~TI~I~D, T. lO~8. T~ Andrew t,oolklt An o~~rvlew. In Procecdir~gs of Winter Usenix Technieal Conference (Dallas, Tex., Feb.). USENIX Assoc., Berkeley, Califi, 9-21.
• 72: Randy Pausch , Matthew Conway , Robert Deline, Lessons learned from SUIT, the simple user interface toolkit, ACM Transactions on Information Systems (TOIS), v.10 n.4, p.320-344, Oct. 1992 [doi>10.1145/146486.146489]
• 73: R. Pike, Graphics in overlapping bitmap layers, ACM Transactions on Graphics (TOG), v.2 n.2, p.135-160, April 1983 [doi>10.1145/357318.357322]
• 74: Patricia Russo , Stephen Boor, How fluent is your interface?: designing for international users, Proceedings of the SIGCHI conference on Human factors in computing systems, p.342-347, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169274]
• 75: Pamela Samuelson, The ups and downs of look and feel, Communications of the ACM, v.36 n.4, p.29-35, April 1993 [doi>10.1145/255950.153595]
• 76: Robert W. Scheifler , Jim Gettys, The X window system, ACM Transactions on Graphics (TOG), v.5 n.2, p.79-109, April 1986 [doi>10.1145/22949.24053]
• 77: SCHMUCKER, K.J. 1986. MacApp: An application framework. Byte 11, 8 (Aug.), 189-193.
• 78: Andrew J. Schulert , George T. Rogers , James A. Hamilton, ADM — a dialog manager, Proceedings of the SIGCHI conference on Human factors in computing systems, p.177-183, April 1985, San Francisco, California, United States
• 79: G. Singh , M. Green, Chisel: a system for creating highly interactive screen layouts, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.86-94, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73671]
• 80: Gurminder Singh , Mark Green, Designing the interface designer's interface, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.109-116, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62422]
• 81: SMITH, D. C., IREY, C., K~MBALL, R., VERPLANK, B., AND HARSLEM, E. 1982. Designing the Star user interface. Byte 7, 4 (Apr.), 242-282.
• 82: Richard M. Stallman, EMACS: The Extensible, Customizable, Self-Documenting Display Editor, Massachusetts Institute of Technology, Cambridge, MA, 1979
• 83: STEVENS, A., ROBERTS, B., AND STEAD, L. 1983. The use of a sophisticated graphics interface in computer-assisted instruction. IEEE Comput. Graph. Appl. 3, 2 (Mar./Apr.), 25-31.
• 84: Paul S. Strauss , Rikk Carey, An object-oriented 3D graphics toolkit, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.341-349, July 1992
• 85: Piyawadee Sukaviriya , James D. Foley, Coupling a UI framework with automatic generation of context-sensitive animated help, Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology, p.152-166, October 03-05, 1990, Snowbird, Utah, United States [doi>10.1145/97924.97942]
• 86: Noi Sukaviriya , Srdjan Kovacevic , James D. Foley , Brad A. Myers , Dan R. Olsen, Jr. , Matthias Schneider-Hufschmidt, Model-based user interfaces: what are they and why should we care?, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.133-135, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192479]
• 87: Piyawadee Sukaviriya , James D. Foley , Todd Griffith, A second generation user interface design environment: the model and the runtime architecture, Proceedings of the SIGCHI conference on Human factors in computing systems, p.375-382, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169299]
• 88: SUTHERLAND, I. E., 1963. SketchPad: A man-machine graphical communication system. In AFIPS Spring Joint Computer Conference. AFIPS, Montvale, N.J., 329-346.
• 89: Daniel C. Swinehart , Polle T. Zellweger , Richard J. Beach , Robert B. Hagmann, A structural view of the Cedar programming environment, ACM Transactions on Programming Languages and Systems (TOPLAS), v.8 n.4, p.419-490, Oct. 1986 [doi>10.1145/6465.6466]
• 90: Pedro Szekely , Ping Luo , Robert Neches, Beyond interface builders: model-based interface tools, Proceedings of the SIGCHI conference on Human factors in computing systems, p.383-390, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169305]
• 91: TEITELMAN, W. 1979. A display oriented programmer's assistant. Int. J. Man Mach. Stud. 1I, 157-187. Also Xerox PARC Tech. Rep. CSL-77-3, Palo Alto, CA, March 8, 1977.
• 92: TESLER, L. 1981. The Smalltalk environment. Byte Mag. 6, 8 (Aug.), 90 147.
• 93: Brad Vander Zanden , Brad A. Myers, Automatic, look-and-feel independent dialog creation for graphical user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.27-34, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97248]
• 94: John M. Vlissides , Mark A. Linton, Unidraw: a framework for building domain-specific graphical editors, ACM Transactions on Information Systems (TOIS), v.8 n.3, p.237-268, July 1990 [doi>10.1145/98188.98197]
• 95: John M. Vlissides , Steven Tang, A unidraw-based user interface builder, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.201-210, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120804]
• 96: WERNECKE, J. 1994. The Inventor Mentor. Addison-Wesley, Reading, Mass.
• 97: Charles Wiecha , William Bennett , Stephen Boies , John Gould , Sharon Greene, ITS: a tool for rapidly developing interactive applications, ACM Transactions on Information Systems (TOIS), v.8 n.3, p.204-236, July 1990 [doi>10.1145/98188.98194]
• 98: C. Wiecha, Direct manipulation of programming: How should we design interfaces?, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.124-126, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73675]
• 99: Nicholas Wilde , Clayton Lewis, Spreadsheet-based interactive graphics: from prototype to tool, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.153-160, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97268]
• 100: David A. Wilson , Larry S. Rosenstein , Don Shafer, C++ programming with MacApp, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990
• 101: X BUSINESS GROUP. 1994. Interface Development Technology. X Business Group, Inc., Fremont, Calif.
• 102: Robert C. Zeleznik , D. Brookshire Conner , Matthias M. Wloka , Daniel G. Aliaga , Nathan T. Huang , Philip M. Hubbard , Brian Knep , Henry Kaufman , John F. Hughes , Andries van Dam, An object-oriented framework for the integration of interactive animation techniques, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.105-112, July 1991

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User interface management systems (UIMS)

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.2 Automatic Programming
          Subjects: Program synthesis

General Terms:
Human Factors, Languages

Keywords:
interface builders, toolkits, user interface development environments, user interface software