Interactive specification of flexible user interface displays

ABSTRACT

One of the problems with conventional UIMSs is that very often there is no graphical way to specify interfaces. This paper describes OPUS, the user interface editor of the Penguims UIMS. This system allows the presentation component of graphical user interfaces to be specified interactively in a graphical notation without explicit programming. The Penguims UIMS supports an underlying model of computation based loosely on spreadsheets. In particular, it supports incremental computations based on a system of equations (one-way constraints) over a set of named values (spreadsheet cells). These equations are used to provide immediate feedback at all levels of the interface. They are used to incrementally determine the position and dynamic appearance of the individual interactor objects that make up the interface. They are also used to connect the presentation directly to underlying application data thereby supporting semantic feedback. The OPUS user interface editor employs a special graphical notation for specifying the presentation component of a user interface. This notation allows the power of the underlying computational model to be expressed simply and quickly. The resulting presentations are very flexible in nature. They can automatically respond to changes in the size and position of display objects and can directly support derivation of their appearance from application data objects.

REFERENCES

• 1: Alan Borning, The Programming Language Aspects of ThingLab, a Constraint-Oriented Simulation Laboratory, ACM Transactions on Programming Languages and Systems (TOPLAS), v.3 n.4, p.353-387, Oct. 1981 [doi>10.1145/357146.357147]
• 2: A. Borning, Defining constraints graphically, Proceedings of the SIGCHI conference on Human factors in computing systems, p.137-143, April 13-17, 1986, Boston, Massachusetts, United States
• 3: Alan Borning , Robert Duisberg, Constraint-based tools for building user interfaces, ACM Transactions on Graphics (TOG), v.5 n.4, p.345-374, Oct. 1986 [doi>10.1145/27623.29354]
• 4: Alan Borning , Robert Duisberg , Bjorn Freeman-Benson , Axel Kramer , Michael Woolf, Constraint hierarchies, Conference proceedings on Object-oriented programming systems, languages and applications, p.48-60, October 04-08, 1987, Orlando, Florida, United States
• 5: W. Buxton , M. R. Lamb , D. Sherman , K. C. Smith, Towards a comprehensive user interface management system, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.35-42, July 25-29, 1983, Detroit, Michigan, United States
• 6: Luca Cardelli, Building user interfaces by direct manipulation, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.152-166, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62428]
• 7: R. A. Duisberg, Animated graphical interfaces using temporal constraints, Proceedings of the SIGCHI conference on Human factors in computing systems, p.131-136, April 13-17, 1986, Boston, Massachusetts, United States
• 8: Adele Goldberg , David Robson, Smalltalk-80: the language and its implementation, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1983
• 9: D. A. Henderson, Jr., The Trillium user interface design environment, Proceedings of the SIGCHI conference on Human factors in computing systems, p.221-227, April 13-17, 1986, Boston, Massachusetts, United States
• 10: Tyson R. Henry , Scott E. Hudson , Gary L. Newell, Integrating gesture and snapping into a user interface toolkit, Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology, p.112-122, October 03-05, 1990, Snowbird, Utah, United States [doi>10.1145/97924.97938]
• 11: S E Hudson, UIMS support for direct manipulation interfaces, ACM SIGGRAPH Computer Graphics, v.21 n.2, p.120-124, April 1987 [doi>10.1145/24919.24929]
• 12: Scott E. Hudson , Roger King, An Semantic Feedback in the Higgens UIMS, IEEE Transactions on Software Engineering, v.14 n.8, p.1188-1206, August 1988 [doi>10.1109/32.7628]
• 13: HUDSON, S.n. Incremental attribute evaluation: A flexible algorithm for lazy update. Tech. Rep. TR 89-12, Dept. of Computer Science, Univ. of Arizona (submitted for publication).
• 14: Scott E. Hudson, Adaptive semantic snaping—a technique for semantic feedback at the lexical level, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.65-70, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97253]
• 15: HUTCHINS, n. L., HOLLAN, Z. D., AND NORMAN, D.A. Direct manipulation interfaces. In User Centered Systems Design, D. A. Norman and S. W. Draper, Eds. Lawrence Erlbaum Associates, Hillsdale, N.J., 1986, pp. 87-124.
• 16: Robert J. K. Jacob, A specification language for direct-manipulation user interfaces, ACM Transactions on Graphics (TOG), v.5 n.4, p.283-317, Oct. 1986 [doi>10.1145/27623.27624]
• 17: David Kurlander , Eric A. Bier, Graphical search and replace, ACM SIGGRAPH Computer Graphics, v.22 n.4, p.113-120, Aug. 1988
• 18: William Leler, Constraint programming languages: their specification and generation, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1988
• 19: LEWIS, C.H. NoPumpG: Creating interactive graphics with spreadsheet machinery. Tech. Rep. CS-CU-372-87, Univ. of Colorado, Aug. 1987.
• 20: Mark A. Linton , John M. Vissides , Paul R. Calder, Composing User Interfaces with InterViews, Computer, v.22 n.2, p.8-22, February 1989 [doi>10.1109/2.19829]
• 21: Joel McCormack , Paul Asente, An overview of the X toolkit, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.46-55, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62407]
• 22: Brad A. Myers , William Buxton, Creating highly-interactive and graphical user interfaces by demonstration, ACM SIGGRAPH Computer Graphics, v.20 n.4, p.249-258, Aug. 1986
• 23: B. A. Myers , B. V. Zanden , R. B. Dannenberg, Creating graphical interactive application objects by demonstration, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.95-104, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73672]
• 24: MYERS, B., G}USE, D., DANNENBERG, R., VANDER ZANDEN, B., KOSBIE, P., PERVIN, E., AND KOLOJEJCHICK, J. The Garnet toolkit reference manuals: Support for highly-interactive, graphical user interfaces in Lisp. CMU Tech. Rep. CMU-CS-89-196, Computer Science Department, Carnegie Mellon University, Nov. 1989.
• 25: Robert W. Scheifler , Jim Gettys, The X window system, ACM Transactions on Graphics (TOG), v.5 n.2, p.79-109, April 1986 [doi>10.1145/22949.24053]
• 26: Andrew J. Schulert , George T. Rogers , James A. Hamilton, ADM — a dialog manager, Proceedings of the SIGCHI conference on Human factors in computing systems, p.177-183, April 1985, San Francisco, California, United States
• 27: SHNEIDERMAN, B. The future of interactive systems and the emergence of direct manipulation. Behav. Inf. Technol. 1 (1982), 237-256.
• 28: SHNEIDERMAN, B. Direct manipulation: A step beyond programming languages. Comput. 16 (Aug. 1983), 57-69.
• 29: Pedro Szekely , Brad Myers, A user interface toolkit based on graphical objects and constraints, Conference proceedings on Object-oriented programming systems, languages and applications, p.36-45, September 25-30, 1988, San Diego, California, United States
• 30: SUN MICROSYSTEMS INC. Sun View I Programmer's Guide. Sun Microsystems Inc., Mountain View, Calif., 1988.
• 31: Gurminder Singh , Mark Green, Designing the interface designer's interface, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.109-116, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62422]
• 32: G. Singh , M. Green, Chisel: a system for creating highly interactive screen layouts, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.86-94, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73671]
• 33: David N. Smith, Building interfaces interactively, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.144-151, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62426]
• 34: Nicholas Wilde , Clayton Lewis, Spreadsheet-based interactive graphics: from prototype to tool, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.153-160, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97268]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User interface management systems (UIMS)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces
      D.2.6 Programming Environments
          Subjects: Interactive environments

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.4 Graphics Utilities
          Subjects: Graphics editors

General Terms:
Design, Human Factors