Constraint-based tools for building user interfaces

ABSTRACT

A constraint describes a relation that must be maintained. Constraints provide a useful mechanism to aid in the construction of interactive graphical user interfaces. They can be used to maintain consistency between data and a view of the data, to maintain consistency among multiple views, to specify layout, and to specify relations between events and responses for describing animations of interactive systems and event-driven simulations. Object-oriented techniques for constraint representation and satisfaction are presented, and a range of examples that demonstrate the practical use of static and temporal constraints for such purposes is presented. These examples include animations of algorithms and physics simulations, and constructing user-interface elements such as file browsers, views onto statistical data, and an interactive monitor or a simulated operating system.

REFERENCES

• 1: Ron Baecker, Two systems which produce animated representations of the execution of computer programs, ACM SIGCSE Bulletin, v.7 n.1, p.158-167, February 1975
• 2: BAECKER, R. Sorting Out Sorting. 16mm color sound film, 25 minutes, Univ. of Toronto, Toronto, Ont., Canada, 1981.
• 3: BECKER, R. A., AND CLEVELAND, W.S. Brushing scatterplots. AT&T Bell Laboratories, Murray Hill, N.J., 1986.
• 4: BECKER, R. A., CLEVELAND, W. S., AND WILKS, A. R. High-interaction graphics for data analysis. AT&T Bell Laboratories, Murray Hill, N.J., June 1986.
• 5: G.M. Birtwhistle , O.J. Dahl , B. Myhrhaug , K. Nygaard, Simula Begin, Chartwell-Bratt Ltd, 1979
• 6: Alan Hamilton Borning, Thinglab--a constraint-oriented simulation laboratory., 1979
• 7: Alan Borning, The Programming Language Aspects of ThingLab, a Constraint-Oriented Simulation Laboratory, ACM Transactions on Programming Languages and Systems (TOPLAS), v.3 n.4, p.353-387, Oct. 1981 [doi>10.1145/357146.357147]
• 8: A. Borning, Defining constraints graphically, Proceedings of the SIGCHI conference on Human factors in computing systems, p.137-143, April 13-17, 1986, Boston, Massachusetts, United States
• 9: A. H. Borning, Classes versus prototypes in object-oriented languages, Proceedings of 1986 ACM Fall joint computer conference, p.36-40, November 1986, Dallas, Texas, United States
• 10: BROWN, G., CARLING, R., HEROT, C., KRAMLICH, D., AND SOUZA, P. Program visualization: Graphical support for software development. Computer, 18, 8 (Aug. 1985), 27-37.
• 11: Marc H. Brown , Robert Sedgewick, A system for algorithm animation, ACM SIGGRAPH Computer Graphics, v.18 n.3, p.177-186, July 1984
• 12: BUJA, A., ASIMOV, D., HURLEY, C., AND MCDONALD, J. Elements of a viewing pipeline for data analysis. Dept. of Statistics, Univ. of Washington, Seattle, 1986.
• 13: W. Buxton , M. R. Lamb , D. Sherman , K. C. Smith, Towards a comprehensive user interface management system, ACM SIGGRAPH Computer Graphics, v.17 n.3, p.35-42, July 1983
• 14: CARTER, C. A., AND LALONDE, W. R. The design of a program editor based on constraints. TR-50, Computer Science Dept., Carleton Univ., Ottawa, Ont., Canada, May 1984.
• 15: Carlos Christensen, On the implementation of AMBIT, a language for symbol manipulation, Communications of the ACM, v.9 n.8, p.570-573, Aug. 1966 [doi>10.1145/365758.365765]
• 16: William S. Cleveland, The elements of graphing data, Wadsworth Publ. Co., Belmont, CA, 1985
• 17: Ellis S Cohen , Edward T Smith , Lee A Iverson, Constraint-based tile windows, IEEE Computer Graphics and Applications, v.6 n.5, p.35-45, May 1986 [doi>10.1109/MCG.1986.276790]
• 18: CURRY, G.A. Programming by abstract demonstration. Ph.D. dissertation, ?'ech. Rep. 78-03- 02, Dept. of Computer Science, Univ. of Washington, Seattle, 1978.
• 19: DIONNE, M. S., AND MACKWORTH, A.K. ANTICS--A system for animating LISP programs. Comput. Graph. Image Process. 7, 1 (Feb. 1978), 105-119.
• 20: R. A. Duisberg, Animated graphical interfaces using temporal constraints, Proceedings of the SIGCHI conference on Human factors in computing systems, p.131-136, April 13-17, 1986, Boston, Massachusetts, United States
• 21: Robert Adamy Duisberg, Constraint-based animation: temporal constraints in the animus system, 1986
• 22: ELLIS, T 0., HAEFNER, J. F., AND SIBLEY, W.L. The GRAIL project: An experiment in manmachine communication. RM-5999-ARPA, Rand Corp., Santa Monica, Calif., 1969.
• 23: Ephraim Philip Glinert, Pict: experiments in the design of interactive, graphical programming environments (iconic, programming languages), 1985
• 24: Adele Goldberg, SMALLTALK-80: the interactive programming environment, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1984
• 25: Adele Goldberg , David Robson, Smalltalk-80: the language and its implementation, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1983
• 26: James Arthur Gosling, Algebraic constraints, 1983
• 27: GOULD, L., AND FINZER, W. Programming by rehearsal. SCL-84-1, Xerox Palo Alto Research Center, Palo Alto, Calif., May 1984.
• 28: GOULD, L., AND FINZER, W. Programming by rehearsal. Byte 9, 6 (June 1984), 187-210.
• 29: Mark Green, The University of Alberta user interface management system, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.205-213, Jul. 1985
• 30: Daniel Conrad Halbert, Programming by example, 1984
• 31: D. A. Henderson, Jr., The Trillium user interface design environment, Proceedings of the SIGCHI conference on Human factors in computing systems, p.221-227, April 13-17, 1986, Boston, Massachusetts, United States
• 32: HEROT, C. F., ET AL. An integrated environment for program visualization. In Automated Tools for Information Systems Design, H. J. Schneider and A. I. Wasserman, Eds. North-Holland, Amsterdam, 1982, pp. 237-259.
• 33: C. A. R. Hoare, Communicating sequential processes, Prentice-Hall, Inc., Upper Saddle River, NJ, 1985
• 34: KAHN, K.M. Knowledge-based creation of computer animation. Ph.D. dissertation, Dept. of Electrical Engineering and Computer Science, MIT, Cambridge, Mass., 1978.
• 35: David J. Kasik, A user interface management system, ACM SIGGRAPH Computer Graphics, v.16 n.3, p.99-106, July 1982
• 36: KAY, A.C. New directions for novice programming in the 1980s. In Programming Technology, P. J. L. Wallis, Ed. Pergamon, Elmsford, N.Y., 1983, pp. 209-247.
• 37: Donald E. Knuth, The Art of Computer Programming Volumes 1-3 Boxed Set, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1998
• 38: KONOPASEK, M., AND JAYARAMAN, S. The TK!Solver Book. Osborne/McGraw-Hill, Berkeley, Calif., 1984.
• 39: KONOPASEK, M., AND JAYARAMAN, S. Constraint and declarative languages for engineering applications: The TK!Solver contribution. Proc. IEEE 73, 12 (Dec. 1985), 1791-1806.
• 40: W. J. Leler, Specification and generation of constraint satisfaction systems, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1987
• 41: LEVITT, D. Machine tongues X: Constraint languages. Comput. Music J. 8, 1 (Spring 1984), 9-21.
• 42: Henry Lieberman, There's more to menu systems than meets the screen, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.181-189, Jul. 1985
• 43: Henry Lieberman , Carl Hewitt, A session with Tinker: Interleaving program testing with program design, Proceedings of the 1980 ACM conference on LISP and functional programming, p.90-99, August 25-27, 1980, Stanford University, California, United States [doi>10.1145/800087.802794]
• 44: LONDON, R. L., AND DUISBERG, R.A. Animating programs using Smalltalk. Computer 18, 8 (Aug. 1985), 61-71.
• 45: MCDONALD, J.A. Antelope: Data analysis with object-oriented programming and constraints. In Proceedings of the Joint Statistical Meetings. Statistical Computing Section, Chicago, 1986. To appear.
• 46: B. A. Myers, Visual programming, programming by example, and program visualization: a taxonomy, Proceedings of the SIGCHI conference on Human factors in computing systems, p.59-66, April 13-17, 1986, Boston, Massachusetts, United States
• 47: Greg Nelson, Juno, a constraint-based graphics system, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.235-243, July 1985
• 48: NORDQUIST, P. R. Interactive display generation in Smalltalk. Master's thesis, TR 85-009, Dept. of Computer Science and Engineering, Oregon Graduate Center, Beaverton, Mar. 1985.
• 49: Dan R. Olsen, Automatic generation of interactive systems, ACM SIGGRAPH Computer Graphics, v.17 n.1, p.53-57, January 1983 [doi>10.1145/988584.988589]
• 50: Dan R. Olsen, Jr., Pushdown automata for user interface management, ACM Transactions on Graphics (TOG), v.3 n.3, p.177-203, July 1984 [doi>10.1145/3870.3871]
• 51: Dan R Olsen, Jr. , Elizabeth P. Dempsey, SYNGRAPH: A graphical user interface generator, ACM SIGGRAPH Computer Graphics, v.17 n.3, p.43-50, July 1983
• 52: Dan R. Olsen, Jr. , Elizabeth P. Dempsey , Roy Rogge, Input/output linkage in a user interface management system, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.191-197, Jul. 1985
• 53: G. E. Pfaff, User Interface Management Systems, Springer-Verlag New York, Inc., Secaucus, NJ, 1985
• 54: Jeffrey Alan Scofield, Editing as a paradigm for user interaction (small talk, object-oriented, syntax-directed), 1985
• 55: David Canfield Smith, Pygmalion: a creative programming environment., 1975
• 56: Guy L. Steele, Jr., The Definition and Implementation of a Computer Programming Language Based on Constraints, Massachusetts Institute of Technology, Cambridge, MA, 1980
• 57: STUETZLE, W. Plot windows. Pep. 90, Dept. of Statistics, Univ. of Washington, Seattle, 1986.
• 58: SUSSMAN, G. J., AND STEELE, G. L. CONSTRAINTS--A language for expressing almosthierarchical descriptions. Arti{. InteU. 14, 1 (Jan. 1980), 1-39.
• 59: SUTHERLAND, I. Sketchpad: A man-machine graphical communication system. Ph.D. dissertation, Dept. of Electrical En~neering, MIT, Cambridge~ Mass:, 1963.
• 60: SUTHERLAND, W. On-line graphical specifications of computer procedures. Ph.D. dissertation, Dept. of Electrical Engineering, MIT, Cambridge, Mass., 1966.
• 61: Christopher John Van Wyk, A language for typesetting graphics, 1980
• 62: Christopher J. van Wyk, A High-Level Language for Specifying Pictures, ACM Transactions on Graphics (TOG), v.1 n.2, p.163-182, April 1982 [doi>10.1145/357299.357303]
• 63: Daniel Weinreb, Lisp machine manual, Massachusetts Institute of Technology, 1981

INDEX TERMS

Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces
      D.2.m Miscellaneous
          Subjects: Rapid prototyping**
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications
          Subjects: Nonprocedural languages**

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Languages
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

General Terms:
Algorithms, Languages