Squidy: a zoomable design environment for natural user interfaces

ABSTRACT

We introduce the interaction library Squidy, which eases the design of natural user interfaces by unifying relevant frameworks and toolkits in a common library. Squidy provides a central design environment based on high-level visual data flow programming combined with zoomable user interface concepts. The user interface offers a simple visual language and a collection of ready-to-use devices, filters and interaction techniques. The concept of semantic zooming enables nevertheless access to more advanced functionality on demand. Thus, users are able to adjust the complexity of the user interface to their current need and knowledge.

REFERENCES

• 1: Dragicevic, P., Fekete, J-D. Input Device Selection and Interaction Configuration with ICON. In Proc. IHM-HCI 2001, Springer Verlag (2001), 543--558.
• 2: Harper, R., Rodden, T., Rogers, Y., Sellen, A., Being Human: Human-Computer Interaction in the Year 2020. Microsoft Research Ltd., Cambridge, 2008.
• 3: Stéphane Huot , Cédric Dumas , Pierre Dragicevic , Jean-Daniel Fekete , Gérard Hégron, The MaggLite post-WIMP toolkit: draw it, connect it and run it, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029677]
• 4: Robert J.K. Jacob , Audrey Girouard , Leanne M. Hirshfield , Michael S. Horn , Orit Shaer , Erin Treacy Solovey , Jamie Zigelbaum, Reality-based interaction: a framework for post-WIMP interfaces, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357089]
• 5: Max/MSP/Jitter, Cycling '74. http://www.cycling74.com/.
• 6: Ken Perlin , David Fox, Pad: an alternative approach to the computer interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.57-64, August 02-06, 1993, Anaheim, CA [doi>10.1145/166117.166125]
• 7: Marcos Serrano , Laurence Nigay , Jean-Yves L. Lawson , Andrew Ramsay , Roderick Murray-Smith , Sebastian Denef, The openinterface framework: a tool for multimodal interaction., CHI '08 extended abstracts on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1358628.1358881]
• 8: Andries van Dam, Post-WIMP user interfaces, Communications of the ACM, v.40 n.2, p.63-67, Feb. 1997 [doi>10.1145/253671.253708]
• 9: vvvv: a multipurpose toolkit, vvvv group, http://vvvv.org/tiki-index.php.
• 10: Victor L. Wallace, The semantics of graphic input devices, The papers of the ACM symposium on Graphic languages, p.61-65, April 26-27, 1976, Florida, United States

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); Prototyping; Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Human Factors

Keywords:
design environment, multimodal interaction, natural user interface, squidy, zoomable user interface