Interactive constraint-based search and replace

ABSTRACT

We describe enhancements to graphical search and replace that allow users to extend the capabilities of a graphical editor. Interactive constraint-based search and replace can search for objects that obey user-specified sets of constraints and automatically apply other constraints to modify these objects. We show how an interactive tool that employs this technique makes it possible for users to define sets of constraints graphically that modify existing illustrations or control the creation of new illustrations. The interace uses the same visual language as the editor and allows users to understand and create powerful rules without conventional programming. Rules can be saved and retrieved for use alone or in combination. Examples, generated with a working implementation, demonstrate applications to drawing beautification and transformation.

REFERENCES

• 1: Eric A. Bier , Maureen C. Stone, Snap-dragging, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.233-240, August 1986
• 2: Boming, A. Graphically Defining New Building Blocks in ThingLab. Human Computer Interaction 2, 4. 1986. 269-295. Reprinted in Visual Programming Environments: Paradigms and Systems. Ephraim Glinert, ed. IEEE Computer Society Press, Los Alamitos, CA. 1990. 450-469.
• 3: Michael R. Garey , David S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman & Co., New York, NY, 1979
• 4: Goines, D. L. A Constructed Roman Alphabet. David R. Godine, publisher. 306 Dartmouth St., Boston, MA 02116. 1982.
• 5: Hudson, S. E. An Enhanced Spreadsheet Model for User Interface Specification. Report TR 90-33. Univ. of Arizona. Computer Science. October 1990.
• 6: Scott E. Hudson , Andrey K. Yeatts, Smoothly integrating rule-based techniques into a direct manipulation interface builder, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.145-153, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120798]
• 7: Karsenty, S., Landay, J. A., and Weikart, C. Inferring Graphical Constraints with Rockit. Research Report. DEC Pads Research Laboratory. In preparation.
• 8: David Kurlander , Eric A. Bier, Graphical search and replace, Proceedings of the 15th annual conference on Computer graphics and interactive techniques, p.113-120, June 1988
• 9: Kurlander, D. Editor Extensibility: Domains and Mechnisms. Technical Report CUCS-516-89. Columbia University, Computer Science. May 1989.
• 10: David Joshua Kurlander, Graphical editing by example, Columbia University, New York, NY, 1993
• 11: Lewis, C. NoPumpG: Creating Interactive Graphics with Spreadsheet Machinery. In E. Glinert, Visual Programming Environments" Paradigms and Systems, IEEE Computer Society Press, Los Alamitos, CA. 526- 546.
• 12: David L. Maulsby , Ian H. Witten , Kenneth A. Kittlitz, Metamouse: specifying graphical procedures by example, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.127-136, July 1989
• 13: Brad A. Myers, Creating user interfaces by demonstration, Academic Press Professional, Inc., San Diego, CA, 1988
• 14: Myers, B. A. Demonstrational Interfaces: A Step Beyond Direct Manipulation. Technical Report CMU- CS-90-162. Carnegie Mellon University, School of Computer Science. August 1990.
• 15: Brad A. Myers, Graphical techniques in a spreadsheet for specifying user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.243-249, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108903]
• 16: Greg Nelson, Juno, a constraint-based graphics system, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.235-243, Jul. 1985
• 17: Theo Pavlidis , Christopher J. Van Wyk, An automatic beautifier for drawings and illustrations, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.225-234, Jul. 1985
• 18: William H. Press , Brian P. Flannery , Saul A. Teukolsky , William T. Vetterling, Numerical recipes in C: the art of scientific computing, Cambridge University Press, New York, NY, 1988
• 19: Shneiderman, B. Direct Manipulation: A Step Beyond Programming Languages. IEEE Computer 16, 8 (August 1983), 57-69.
• 20: Sutherland, I. E. Sketchpad: A Man-Machine Graphical Communication System. AFIPS Conference Proceedings, Spring Joint Computer Conference. 1963. 329- 346.
• 21: B. T. Zanden, Constraint grammars–a new model for specifying graphical applications, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.325-330, March 1989
• 22: Weitzman, L. DESIGNER: A Knowledge-Based Graphic Design Assistant. ICS Report 8609. University of California, San Diego. July 1986.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.4 Graphics Utilities
          Subjects: Graphics editors
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
  I.7 DOCUMENT AND TEXT PROCESSING

General Terms:
Documentation, Human Factors

Keywords:
constraint specification, demonstrational techniques, editor extensibility, graphical editing, interactive techniques