Balancing physical and digital properties in mixed objects

ABSTRACT

Mixed interactive systems seek to smoothly merge physical and digital worlds. In this paper we focus on mixed objects that take part in the interaction. Based on our Mixed Interaction Model, we introduce a new characterization space of the physical and digital properties of a mixed object from an intrinsic viewpoint without taking into account the context of use of the object. The resulting enriched Mixed Interaction Model aims at balancing physical and digital properties in the design process of mixed objects. The model extends and generalizes previous studies on the design of mixed systems and covers existing approaches of mixed systems including tangible user interfaces, augmented reality and augmented virtuality. A mixed system called ORBIS that we developed is used to illustrate the discussion: we highlight how the model informs the design alternatives of ORBIS.

REFERENCES

• 1: Gregory D. Abowd , Joëlle Coutaz , Laurence Nigay, Structuring the Space of Interactive System Properties, Proceedings of the IFIP TC2/WG2.7 Working Conference on Engineering for Human-Computer Interaction, p.113-129, August 10-12, 1992
• 2: Gilles Bailly , Laurence Nigay , David Auber, NAVRNA: visualization - exploration - editing of RNA, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133370]
• 3: Steve Benford , Holger Schnädelbach , Boriana Koleva , Rob Anastasi , Chris Greenhalgh , Tom Rodden , Jonathan Green , Ahmed Ghali , Tony Pridmore , Bill Gaver , Andy Boucher , Brendan Walker , Sarah Pennington , Albrecht Schmidt , Hans Gellersen , Anthony Steed, Expected, sensed, and desired: A framework for designing sensing-based interaction, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.3-30, March 2005 [doi>10.1145/1057237.1057239]
• 4: Thomas Binder , Giorgio De Michelis , Michael Gervautz , Giulio Jacucci , Kresimir Matkovic , Thomas Psik , Ina Wagner, Supporting configurability in a mixed-media environment for design students, Personal and Ubiquitous Computing, v.8 n.5, p.310-325, September 2004 [doi>10.1007/s00779-004-0294-7]
• 5: William Buxton, Lexical and pragmatic considerations of input structures, ACM SIGGRAPH Computer Graphics, v.17 n.1, p.31-37, January 1983 [doi>10.1145/988584.988586]
• 6: Chin, T., You, Y., Coutrix, C., Lim, J., Chevallet, J.-P., Nigay, L., 2008. Snap2Play: A Mixed-Reality Game based on Scene Identification. In proceedings of ACM IEEE MMM'08, LNCS, Springer, 220--229.
• 7: Céline Coutrix , Laurence Nigay, Mixed reality: a model of mixed interaction, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133274]
• 8: Emmanuel Dubois , Laurence Nigay , Jocelyne Troccaz, Consistency in Augmented Reality Systems, Proceedings of the 8th IFIP International Conference on Engineering for Human-Computer Interaction, p.111-122, May 11-13, 2001
• 9: George W. Fitzmaurice , Hiroshi Ishii , William A. S. Buxton, Bricks: laying the foundations for graspable user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.442-449, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223964]
• 10: Mackinlay, J., Card, S., Robertson, G., 1990. A Semantic Analysis of the Design Space of Input Devices. Lawrence Erlbaum HCI, 5, 2&3 (1990), 145--190.
• 11: Darnell J. Moore , Roy Want , Beverly L. Harrison , Anuj Gujar , Ken Fishkin, Implementing phicons: combining computer vision with infrared technology for interactive physical icons, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.67-68, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322585]
• 12: Donald A. Norman, Affordance, conventions, and design, interactions, v.6 n.3, p.38-43, May/June 1999 [doi>10.1145/301153.301168]
• 13: Dan R. Olsen, Jr., Evaluating user interface systems research, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294256]
• 14: Gian Pangaro , Dan Maynes-Aminzade , Hiroshi Ishii, The actuated workbench: computer-controlled actuation in tabletop tangible interfaces, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572011]
• 15: James Patten , Hiroshi Ishii, Mechanical constraints as computational constraints in tabletop tangible interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240746]
• 16: Brygg Ullmer , Hiroshi Ishii , Robert J. K. Jacob, Token+constraint systems for tangible interaction with digital information, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.81-118, March 2005 [doi>10.1145/1057237.1057242]
• 17: Vernier, F., Nigay, L., 2000. A Framework for the Combination and Characterization of Output Modalities. In proceedings of DSVIS'00, LNCS, Springer, 32--48.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

General Terms:
Design, Human Factors

Keywords:
augmented reality, design space, mixed objects, mixed systems, tangible user interfaces