Tangible menus and interaction trays: core tangibles for common physical/digital activities

ABSTRACT

We introduce core tangibles: physical interaction elements which serve common roles across a variety of tangible and embedded interfaces. We describe two such tangibles: tangible menus and interaction trays. These may be composed together to dynamically bind discrete and continuous interactors to various digital behaviors. We discuss our approach, implementation, and early usage experiences.

REFERENCES

• 1: Apple Computer, Inc., Macintosh human interface guidelines, Addison-Wesley Publishing Company, 1992
• 2: Mark Billinghurst , Hirkazu Kato , Ivan Poupyrev, The MagicBook—Moving Seamlessly between Reality and Virtuality, IEEE Computer Graphics and Applications, v.21 n.3, p.6-8, May 2001
• 3: Alan F. Blackwell , Mark Stringer , Eleanor F. Toye , Jennifer A. Rode, Tangible interface for collaborative information retrieval, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986093]
• 4: Jacob Buur , Astrid Soendergaard, Video card game: an augmented environment for user centred design discussions, Proceedings of DARE 2000 on Designing augmented reality environments, p.63-69, April 2000, Elsinore, Denmark [doi>10.1145/354666.354673]
• 5: Scott Carter , Amy Hurst , Jennifer Mankoff , Jack Li, Dynamically adapting GUIs to diverse input devices, Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility, October 23-25, 2006, Portland, Oregon, USA [doi>10.1145/1168987.1169000]
• 6: Andrew Fano, What are a Location’s “File” and “Edit” Menus?, Personal and Ubiquitous Computing, v.5 n.1, p.12-15, February 2001 [doi>10.1007/s007790170021]
• 7: George W. Fitzmaurice , Hiroshi Ishii , William A. S. Buxton, Bricks: laying the foundations for graspable user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.442-449, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223964]
• 8: Saul Greenberg , Chester Fitchett, Phidgets: easy development of physical interfaces through physical widgets, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502388]
• 9: Björn Hartmann , Scott R. Klemmer , Michael Bernstein , Leith Abdulla , Brandon Burr , Avi Robinson-Mosher , Jennifer Gee, Reflective physical prototyping through integrated design, test, and analysis, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166300]
• 10: Lars Erik Holmquist , Johan Redström , Peter Ljungstrand, Token-Based Acces to Digital Information, Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing, p.234-245, September 27-29, 1999, Karlsruhe, Germany
• 11: W. Mackay , D. Pagani, Video mosaic: laying out time in a physical space, Proceedings of the second ACM international conference on Multimedia, p.165-172, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192646]
• 12: Les Nelson , Satoshi Ichimura , Elin Rønby Pedersen , Lia Adams, Palette: a paper interface for giving presentations, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.354-361, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303109]
• 13: Perlman, R. Using Computer Technology to Provide a Creative Learning Environment for Preschool Children. MIT Logo Memo #24, 1976.
• 14: Jun Rekimoto , Brygg Ullmer , Haruo Oba, DataTiles: a modular platform for mixed physical and graphical interactions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.269-276, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365115]
• 15: Sankaran, R., Ullmer, B., et al. Blades and Tiles: an extensible hardware architecture for interaction devices. In Proc. of Ubicomp'07, pp. 260--263, 2007.
• 16: Beat Signer , Moira C. Norrie, PaperPoint: a paper-based presentation and interactive paper prototyping tool, Proceedings of the 1st international conference on Tangible and embedded interaction, February 15-17, 2007, Baton Rouge, Louisiana [doi>10.1145/1226969.1226981]
• 17: Tomas Sokoler , Håkan Edeholt , Martin Johansoon, VideoTable: a tangible interface for collaborative exploration of video material during design sessions, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506531]
• 18: B. Ullmer , H. Ishii, Emerging frameworks for tangible user interfaces, IBM Systems Journal, v.39 n.3-4, p.915-931, July 2000
• 19: John Underkoffler , Hiroshi Ishii, Urp: a luminous-tangible workbench for urban planning and design, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.386-393, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303114]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
blades+tiles, core tangibles, interaction trays, tangible menus