An approach to support automatic generation of user interfaces

ABSTRACT

In traditional interactive programming environments, each application individually manages its interaction with the human user. The result is duplication of effort in implementing user interface code and nonuniform—hence confusing—input conventions. This paper presents an approach to support automatic generation of user interfaces in environments based on algebraic languages. The approach supports the editing model of interaction, which allows a user to view all applications as data that can be edited. An application interacts with a user by submitting variables (of arbitrary types) to a dialogue manager, which displays their presentations to the user and offers type-directed editing of these presentations. Applications and dialogue managers communicate through a protocol that allows a presentation to be kept consistent with the variable it displays. A particular implementation of the approach, called Dost, has been constructed for the Xerox development environment and the Mesa programming language. Dost is used as a concrete example to describe the editing model, the primitives to support it, and our preliminary experience with these primitives. The approach is compared with related work, its shortcomings are discussed, and suggestions for future work are made.

REFERENCES

• 1: Malcolm P. Atkinson , O. Peter Buneman, Types and persistence in database programming languages, ACM Computing Surveys (CSUR), v.19 n.2, p.105-170, June 1987 [doi>10.1145/62070.45066]
• 2: John Backus, Can programming be liberated from the von Neumann style?: a functional style and its algebra of programs, Communications of the ACM, v.21 n.8, p.613-641, Aug. 1978 [doi>10.1145/359576.359579]
• 3: Rolf Bahlke , Gregor Snelting, The PSG - Programming System Generator, Proceedings of the ACM SIGPLAN 85 symposium on Language issues in programming environments, p.28-33, June 25-28, 1985, Seattle, Washington, United States
• 4: A. Borning, Defining constraints graphically, Proceedings of the SIGCHI conference on Human factors in computing systems, p.137-143, April 13-17, 1986, Boston, Massachusetts, United States
• 5: Alan Borning, The Programming Language Aspects of ThingLab, a Constraint-Oriented Simulation Laboratory, ACM Transactions on Programming Languages and Systems (TOPLAS), v.3 n.4, p.353-387, Oct. 1981 [doi>10.1145/357146.357147]
• 6: Jan Van Den Bos, Abstract interaction tools: a language for user interface management systems, ACM Transactions on Programming Languages and Systems (TOPLAS), v.10 n.2, p.215-247, April 1988 [doi>10.1145/42190.42191]
• 7: W. Buxton , M. R. Lamb , D. Sherman , K. C. Smith, Towards a comprehensive user interface management system, ACM SIGGRAPH Computer Graphics, v.17 n.3, p.35-42, July 1983
• 8: Lisa A. Call , David L. Cohrs , Barton P. Miller, CLAM- an open system for graphical user interfaces, ACM SIGPLAN Notices, v.22 n.12, p.277-286, Dec. 1987
• 9: CARDELLI, L. Amber. In Proceedings of the 13th Summer School of the LITP (Le Val D'Jol Vosges, France). Lecture Notes in Computer Science, 242. Springer Verlag, New York, 1985.
• 10: Luca Cardelli, Building user interfaces by direct manipulation, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.152-166, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62428]
• 11: Luca Cardelli , Rob Pike, Squeak: a language for communicating with mice, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.199-204, Jul. 1985
• 12: Prasun Dewan, Automatic generation of user interfaces (editing, programming environments, syntax directed editing), 1986
• 13: DEWAN, P. Ingerating editing in a monolingual environment. Tech. Rep. CSD-TR-763, Purdue University, W. Lafayette, Ind., April 1988.
• 14: Prasun Dewan, Object-oriented editor generation, Journal of Object-Oriented Programming, v.3 n.2, p.35-49, Jul./Aug. 1990
• 15: DEWAN, P., AND SOLOMON, M. An approach to generalized editing. In Proceedings of the IEEE 1st International Conference on Computer Workstations, (Nov. 1985), pp. 52-60.
• 16: Prasun Dewan , Marvin Solomon, Dost: an environment to support automatic generation of user interfaces, Proceedings of the second ACM SIGSOFT/SIGPLAN software engineering symposium on Practical software development environments, p.150-159, December 09-11, 1986, Palo Alto, California, United States
• 17: DEWAN, P., AND ~ASILIK, E. An approach to integrating user interface management systems with programming languages. In Proceedings of the IFIP WG2.7 Working Conference on Engineering for Human Computer Interaction, Aug. 1989. (Napa Valley, Calif., Aug. 1989). North- Holland, Amsterdam, 1990, 493-514.
• 18: C. N. Fischer , Gregory F. Johnson , Jon Mauney , Anil Pal , Daniel L. Stock, The Poe language-based editor project, Proceedings of the first ACM SIGSOFT/SIGPLAN software engineering symposium on Practical software development environments, p.21-29, April 1984
• 19: G. Fisher, An Overview of a Graphical Multilanguage Applications Environment, IEEE Transactions on Software Engineering, v.14 n.6, p.774-786, June 1988 [doi>10.1109/32.6157]
• 20: Christopher W. Fraser, A generalized text editor, Communications of the ACM, v.23 n.3, p.154-158, March 1980 [doi>10.1145/358826.358834]
• 21: Christopher W. Fraser , David R. Hanson, High-level language facilities for low-level services, Proceedings of the 12th ACM SIGACT-SIGPLAN symposium on Principles of programming languages, p.217-224, January 14-16, 1985, New Orleans, Louisiana, United States [doi>10.1145/318593.318642]
• 22: Christopher W. Fraser , A. A. Lopez, Editing Data Structures, ACM Transactions on Programming Languages and Systems (TOPLAS), v.3 n.2, p.115-125, April 1981 [doi>10.1145/357133.357134]
• 23: Adele Goldberg , David Robson, Smalltalk-80: the language and its implementation, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1983
• 24: Mark Green, A survey of three dialogue models, ACM Transactions on Graphics (TOG), v.5 n.3, p.244-275, July 1986 [doi>10.1145/24054.24057]
• 25: Mark Green, The University of Alberta user interface management system, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.205-213, Jul. 1985
• 26: Irene Greif , Robert Seliger , William E. Weihl, Atomic data abstractions in a distributed collaborative editing system, Proceedings of the 13th ACM SIGACT-SIGPLAN symposium on Principles of programming languages, p.160-172, January 01, 1986, St. Petersburg Beach, Florida [doi>10.1145/512644.512659]
• 27: H. Rex Hartson , Deborah Hix, Human-computer interface development: concepts and systems for its management, ACM Computing Surveys (CSUR), v.21 n.1, p.5-92, March 1989 [doi>10.1145/62029.62031]
• 28: Jan Heering , Paul Klint, Towards monolingual programming environments, ACM Transactions on Programming Languages and Systems (TOPLAS), v.7 n.2, p.183-213, April 1985 [doi>10.1145/3318.3321]
• 29: Ralph D. Hill, Supporting concurrency, communication, and synchronization in human-computer interaction—the Sassafras UIMS, ACM Transactions on Graphics (TOG), v.5 n.3, p.179-210, July 1986 [doi>10.1145/24054.24055]
• 30: Roger King , Scott Hudson, Implementing a user interface as a system of attributes, Proceedings of the second ACM SIGSOFT/SIGPLAN software engineering symposium on Practical software development environments, p.143-149, December 09-11, 1986, Palo Alto, California, United States
• 31: Gregory F. Johnson , C. N. Fischer, A meta-language and system for nonlocal incremental attribute evaluation in language-based editors, Proceedings of the 12th ACM SIGACT-SIGPLAN symposium on Principles of programming languages, p.141-151, January 14-16, 1985, New Orleans, Louisiana, United States [doi>10.1145/318593.318627]
• 32: G. E. Kaiser, Incremental dynamic semantics for language-based programming environments, ACM Transactions on Programming Languages and Systems (TOPLAS), v.11 n.2, p.169-193, April 1989 [doi>10.1145/63264.63400]
• 33: G D Kimura, A structure editor for abstract document objects, IEEE Transactions on Software Engineering, v.12 n.3, p.417-435, March 1986
• 34: Glenn E. Krasner , Stephen T. Pope, A cookbook for using the model-view controller user interface paradigm in Smalltalk-80, Journal of Object-Oriented Programming, v.1 n.3, p.26-49, Aug./Sept. 1988
• 35: Balachander Krishnamurthy , John T. Korb, A uniform model of interaction in interactive systems, 1987
• 36: LAFUENE, J. M., AND GRIES, D. Language facilities for programming user-computer dialogues. IBM J. Res. Dev. 22, 2 (March 1978), 145-158.
• 37: K A Lantz , P P Tanner , C Binding , Kuan-Tsae Huang , A Dwelly, Reference models, window systems, and concurrency, ACM SIGGRAPH Computer Graphics, v.21 n.2, p.87-97, April 1987 [doi>10.1145/24919.24922]
• 38: George B. Leeman, Jr., A formal approach to undo operations in programming languages, ACM Transactions on Programming Languages and Systems (TOPLAS), v.8 n.1, p.50-87, Jan. 1986 [doi>10.1145/5001.5005]
• 39: Mark A. Linton , John M. Vissides , Paul R. Calder, Composing User Interfaces with InterViews, Computer, v.22 n.2, p.8-22, February 1989 [doi>10.1109/2.19829]
• 40: Jock Mackinlay, Automating the design of graphical presentations of relational information, ACM Transactions on Graphics (TOG), v.5 n.2, p.110-141, April 1986 [doi>10.1145/22949.22950]
• 41: Michael Marcotty , Henry Ledgard , Gregor V. Bochmann, A Sampler of Formal Definitions, ACM Computing Surveys (CSUR), v.8 n.2, p.191-276, June 1976 [doi>10.1145/356669.356672]
• 42: Raul I. Medina-Mora, Syntax-directed editing: towards integrated programming environments, 1982
• 43: MILNER, R. The standard ML core language. Polymorphism 2, 2 (Oct. 1985).
• 44: T. G. Moher, PROVIDE: A Process Visualization and Debugging Environment, IEEE Transactions on Software Engineering, v.14 n.6, p.849-857, June 1988 [doi>10.1109/32.6163]
• 45: Brad A. Myers, Creating user interfaces using programming by example, visual programming, and constraints, ACM Transactions on Programming Languages and Systems (TOPLAS), v.12 n.2, p.143-177, April 1990 [doi>10.1145/78942.78943]
• 46: Brad A. Myers, INCENSE: A system for displaying data structures, ACM SIGGRAPH Computer Graphics, v.17 n.3, p.115-125, July 1983
• 47: Brad A. Myers, User-Interface Tools: Introduction and Survey, IEEE Software, v.6 n.1, p.15-23, January 1989 [doi>10.1109/52.16898]
• 48: Bruce Jay Nelson, Remote procedure call, 1981
• 49: David Samuel Notkin, Interactive structure-oriented computing, 1984
• 50: Anil Allan Pal, Generating execution facilities for integrated programming environments (denotational semantics), 1986
• 51: PALAY, A. J., HANSEN, W. J., KAZAR, M. L., SHERMAN, M., WADLOW, M. G., NEUENDORFFER, T. P., STERN, Z., BADER, M., AND PETERS, T. The Andrew toolkit--an overview. In Proceedings of 1988 Winter USENIX (Feb. 1988).
• 52: G. E. Pfaff, User Interface Management Systems, Springer-Verlag New York, Inc., Secaucus, NJ, 1985
• 53: Steven P. Reiss, PECAN: program development systems that support multiple views, IEEE Transactions on Software Engineering, v.11 n.3, p.276-285, March 1985 [doi>10.1109/TSE.1985.232211]
• 54: Thomas Reps , Tim Teitelbaum , Alan Demers, Incremental Context-Dependent Analysis for Language-Based Editors, ACM Transactions on Programming Languages and Systems (TOPLAS), v.5 n.3, p.449-477, July 1983 [doi>10.1145/2166.357218]
• 55: Thomas Reps , Tim Teitelbaum, The synthesizer generator, Proceedings of the first ACM SIGSOFT/SIGPLAN software engineering symposium on Practical software development environments, p.42-48, April 1984
• 56: ROWE, L.A. "Fill-in-the-form" programming. In Proceedings of VLDB (1985), pp. 394-404.
• 57: ROWE, L. A., AND SHOENS, K.A. Programming language constructs for screen definition. IEEE Trans. Softw. Eng. SE-9 1 (Jan. 1983), 31-39.
• 58: Sunil Sarin , Irene Greif, Computer-based real-time conferencing systems, Computer, v.18 n.10, p.33-45, Oct. 1985 [doi>10.1109/MC.1985.1662711]
• 59: Kurt J. Schmucker, Object-oriented programming for the Macintosh, Hayden Books, Carmel, IN, 1986
• 60: SCOF1ELD, J. Editing as a paradigm for user interaction. Ph.D. dissertation and Tech. Rep. 85- 08-10, Department of Computer Science, University of Washington, Seattle, Aug. 1985.
• 61: M. L. Scott , S.-K. Yap, A grammar-based approach to automatic generation of user-interface dialogues, Proceedings of the SIGCHI conference on Human factors in computing systems, p.73-78, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57179]
• 62: Mary Shaw , Ellen Borison , Michael Horowitz , Tom Lane , David Nichols , Randy Pausch, Descartes: A programming-language approach to interactive display interfaces, Proceedings of the 1983 ACM SIGPLAN symposium on Programming language issues in software systems, p.100-111, June 27-29, 1983, San Francisco, California, United States
• 63: SHNEIDERMAN, B. Direct manipulation: A step beyond programming languages. IEEE Comput. 16, 8 (Aug. 1983), 57-69.
• 64: Gregor Snelting , Wolfgang Henhapl, Unification in many-sorted algebras as a device for incremental semantic analysis, Proceedings of the 13th ACM SIGACT-SIGPLAN symposium on Principles of programming languages, p.229-235, January 01, 1986, St. Petersburg Beach, Florida [doi>10.1145/512644.512665]
• 65: Mark Stefik , Gregg Foster , Daniel G. Bobrow , Kenneth Kahn , Stan Lanning , Lucy Suchman, Beyond the chalkboard: computer support for collaboration and problem solving in meetings, Communications of the ACM, v.30 n.1, p.32-47, Jan. 1987 [doi>10.1145/7885.7887]
• 66: SUTTON, J., AND SPRAGUE, R. A study of display generation and management in interactive business applications. Tech. Rep. RJ2392 (31804), IBM San Jose Research Laboratory, San Jose, Calif., Nov. 1978.
• 67: Richard E. Sweet, The Mesa programming environment, Proceedings of the ACM SIGPLAN 85 symposium on Language issues in programming environments, p.216-229, June 25-28, 1985, Seattle, Washington, United States
• 68: Tim Teitelbaum , Thomas Reps , Susan Horwitz, The why and wherefore of the Cornell Program Synthesizer, ACM SIGPLAN Notices, v.16 n.6, p.8-16, June 1981
• 69: Jeffrey Scott Vitter, US&R: A new framework for redoing (Extended Abstract), Proceedings of the first ACM SIGSOFT/SIGPLAN software engineering symposium on Practical software development environments, p.168-176, April 1984
• 70: Peter Wegner, Dimensions of object-based language design, Conference proceedings on Object-oriented programming systems, languages and applications, p.168-182, October 04-08, 1987, Orlando, Florida, United States
• 71: J. H. Williams , E. L. Wimmers, Sacrificing simplicity for convenience: Where do you draw the line?, Proceedings of the 15th ACM SIGPLAN-SIGACT symposium on Principles of programming languages, p.169-179, January 10-13, 1988, San Diego, California, United States [doi>10.1145/73560.73575]
• 72: William Allan Wulf , Richard K. Johnsson , Charles B. Weinstock , Steven O. Hobbs , Charles M. Geschke, The Design of an Optimizing Compiler, Elsevier Science Inc., New York, NY, 1975
• 73: M. Young , R. N. Taylor , D. B. Troup, Software Environment Architectures and User Interface Facilities, IEEE Transactions on Software Engineering, v.14 n.6, p.697-708, June 1988 [doi>10.1109/32.6151]
• 74: ZLOOF, M. M. Query by example, The invocation and definition of tables and forms. In Proceedings of the International Conference on Very Large Databases (Sept. 1975), pp. 1-24.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces
  D.3 PROGRAMMING LANGUAGES

General Terms:
Design, Languages