Creating graphical interactive application objects by demonstration

ABSTRACT

The Lapidary user interface tool allows all pictorial aspects of programs to be specified graphically. In addition, the behavior of these objects at run-time can be specified using dialogue boxes and by demonstration. In particular, Lapidary allows the designer to draw pictures of application-specific graphical objects which will be created and maintained at run-time by the application. This includes the graphical entities that the end user will manipulate (such as the components of the picture), the feedback that shows which objects are selected (such as small boxes on the sides and corners of an object), and the dynamic feedback objects (such as hair-line boxes to show where an object is being dragged). In addition, Lapidary supports the construction and use of “widgets” (sometimes called interaction techniques or gadgets) such as menus, scroll bars, buttons and icons. Lapidary therefore supports using a pre-defined library of widgets, and defining a new library with a unique “look and feel.” The run-time behavior of all these objects can be specified in a straightforward way using constraints and abstract descriptions of the interactive response to the input devices. Lapidary generalizes from the specific example pictures to allow the graphics and behaviors to be specified by demonstration.

REFERENCES

• 1: ACM SIGGRAPH. Proceedings of the ACM SIGGRAPH Symposium on User Interface Software. Banff, Alberta, Canada, Oct., 1988.
• 2: Alan Boming. Thinglab--A Constraint-Oriented Simulation Laboratory. Tech. Rept. SSL-79-3, Xerox Palo Alto Research Center, July, 1979.
• 3: Alan Borning , Robert Duisberg, Constraint-based tools for building user interfaces, ACM Transactions on Graphics (TOG), v.5 n.4, p.345-374, Oct. 1986 [doi>10.1145/27623.29354]
• 4: A. Borning, Defining constraints graphically, Proceedings of the SIGCHI conference on Human factors in computing systems, p.137-143, April 13-17, 1986, Boston, Massachusetts, United States
• 5: W. Buxton , M. R. Lamb , D. Sherman , K. C. Smith, Towards a comprehensive user interface management system, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.35-42, July 25-29, 1983, Detroit, Michigan, United States
• 6: Luca Cardelli, Building user interfaces by direct manipulation, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.152-166, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62428]
• 7: Alessandro Giacalone, XY-WINS: an integraded environment for developing graphical user interfaces, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.129-143, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62425]
• 8: Dario Giuse. KR: Constraint-Based Knowledge Representation. Tech. Rept. CMU-CS-89-142, Carnegie Mellon University Computer Science Department, April, 1989.
• 9: D. A. Henderson, Jr., The Trillium user interface design environment, Proceedings of the SIGCHI conference on Human factors in computing systems, p.221-227, April 13-17, 1986, Boston, Massachusetts, United States
• 10: Tyson R. Henry , Scott E. Hudson, Using active data in a UIMS, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.167-178, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62429]
• 11: David Kurlander , Eric A. Bier, Graphical search and replace, Proceedings of the 15th annual conference on Computer graphics and interactive techniques, p.113-120, June 1988
• 12: Henry Lieberman, Using prototypical objects to implement shared behavior in object-oriented systems, Conference proceedings on Object-oriented programming systems, languages and applications, p.214-223, September 29-October 02, 1986, Portland, Oregon, United States
• 13: B. A. Myers, Visual programming, programming by example, and program visualization: a taxonomy, Proceedings of the SIGCHI conference on Human factors in computing systems, p.59-66, April 13-17, 1986, Boston, Massachusetts, United States
• 14: Brad A. Myers. "Creating Interaction Techniques by Demonstration". IEEE Computer Graphics and Applications 7.9 (Sept. 1987), 51-60.
• 15: Brad A. Myers. The Garnet User Interface Development Environment: A Proposal. Tech. Rept. CMU-CS-88-153. Carnegie Mellon University Computer Science Department, Sept., 1988.
• 16: Brad A. Myers, Creating user interfaces by demonstration, Academic Press Professional, Inc., San Diego, CA, 1988
• 17: Brad A. Myers, John A. Kolojejchick, and Edward Pervin. Opal: Garnet Project Graphical Object System. Carnegie Mellon University, School of Computer Science, 1989.
• 18: B. A. Myers, Encapsulating interactive behaviors, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.319-324, March 1989
• 19: Frances J. Newbery. An interface description language for graph editors. 1988 IEEE Workshop on Visual Languages, Pittsburgh, PA, Oct., 1988. pp. 144-149. IEEE Computer Society Order Number 876.
• 20: D R Olsen, Jr., Larger issues in user interface management, ACM SIGGRAPH Computer Graphics, v.21 n.2, p.134-137, April 1987 [doi>10.1145/24919.24932]
• 21: Ben Shneidemran. "Direct Manipulation: A Step Beyond Programming Languages". IEEE Computer 16,8 (Aug. 1983). 57-69.
• 22: Gurminder Singh , Mark Green, Designing the interface designer's interface, Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, p.109-116, October 17-19, 1988, Alberta, Canada [doi>10.1145/62402.62422]
• 23: Pedro Szekely , Brad Myers, A user interface toolkit based on graphical objects and constraints, ACM SIGPLAN Notices, v.23 n.11, p.36-45, Nov. 1988

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Design, Human Factors, Performance