Evolving tuis with smart objects for multi-context interaction

ABSTRACT

We present our ongoing work, an application framework created to extend the concept of natural and tangible interfaces to environments composed of many interactive systems disseminated in an indoor space. In such environments users can perform solo or collaborative activities using different systems (like interactive tabletops or walls) and interacting with them through tangible smart objects provided with sensors, storage, processing and wireless communication capabilities. The smart objects become the representatives of the user navigating in the environment, and while retaining their basic affordance suggested by their shape, can assume different roles in relation to the system they approach. We investigated some application scenarios and present early observations related to the design and implementation, as well as future directions.

REFERENCES

• 1: M. J. Ananny, J. C., TellTale: A toy to encourage written literacy skills through oral storytelling, in Text, Discourse Cognition. 2001: Jackson Hole, WY.
• 2: Stefano Baraldi , Alberto Del Bimbo , Lea Landucci , Alessandro Valli, wikiTable: finger driven interaction for collaborative knowledge-building workspaces, Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, p.144, June 17-22, 2006 [doi>10.1109/CVPRW.2006.217]
• 3: Stefano Baraldi , Alberto Del Bimbo , Lea Landucci , Nicola Torpei , Omar Cafini , Elisabetta Farella , Augusto Pieracci , Luca Benini, Introducing tangerine: a tangible interactive natural environment, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291422]
• 4: Alessandro Cappelletti , Giulia Gelmini , Fabio Pianesi , Franca Rossi , Massimo Zancanaro, Enforcing Cooperative Storytelling: First Studies, Proceedings of the IEEE International Conference on Advanced Learning Technologies, p.281-285, August 30-September 01, 2004
• 5: Anind K. Dey , Gerd Kortuem , David R. Morse , Albrecht Schmidt, Situated Interaction and Context-Aware Computing, Personal and Ubiquitous Computing, v.5 n.1, p.1-3, February 2001 [doi>10.1007/PL00000013]
• 6: Ali Mazalek , Matthew Reynolds , Glorianna Davenport, TViews: An Extensible Architecture for Multiuser Digital Media Tables, IEEE Computer Graphics and Applications, v.26 n.5, p.47-55, September 2006 [doi>10.1109/MCG.2006.117]
• 7: F. Sparacino, K. Hall, C. Wren, G. Davenport, and A. Pentland, "Improvisational Theater Space," Symposium on Arts and Technology, 1997
• 8: Strachan, S., Murray-Smith, R., "Tremor as an Input Mechanism", UIST 2004.
• 9: B. Ullmer , H. Ishii, Emerging frameworks for tangible user interfaces, IBM Systems Journal, v.39 n.3-4, p.915-931, July 2000
• 10: Ron Wakkary , Marek Hatala, ec(h)o: situated play in a tangible and audio museum guide, Proceedings of the 6th conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA [doi>10.1145/1142405.1142448]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); Prototyping; User-centered design; Input devices and strategies (e.g., mouse, touchscreen); Graphical user interfaces (GUI)

General Terms:
Design, Experimentation, Human Factors

Keywords:
natural interaction, smart objects, tangible interaction, vision systems, wireless sensors