Towards more paper-like input: flexible input devices for foldable interaction styles

ABSTRACT

This paper presents Foldable User Interfaces (FUI), a combination of a 3D GUI with windows imbued with the physics of paper, and Foldable Input Devices (FIDs). FIDs are sheets of paper that allow realistic transformations of graphical sheets in the FUI. Foldable input devices are made out of construction paper augmented with IR reflectors, and tracked by computer vision. Window sheets can be picked up and flexed with simple movements and deformations of the FID. FIDs allow a diverse lexicon of one-handed and two-handed interaction techniques, including folding, bending, flipping and stacking. We show how these can be used to ease the creation of simple 3D models, but also for tasks such as page navigation.

REFERENCES

• 1: Kenneth P. Fishkin , Anuj Gujar , Beverly L. Harrison , Thomas P. Moran , Roy Want, Embodied user interfaces for really direct manipulation, Communications of the ACM, v.43 n.9, p.74-80, Sept. 2000 [doi>10.1145/348941.348998]
• 2: François Guimbretière, Paper augmented digital documents, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.51-60, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964702]
• 3: Harold, P. Creating a Magic Lighting Experience with Textiles, Password: Philips Research Technology Magazine, 28 (2006), 6--11.
• 4: David Holman , Roel Vertegaal , Mark Altosaar , Nikolaus Troje , Derek Johns, Paper windows: interaction techniques for digital paper, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055054]
• 5: Walter Johnson , Herbert Jellinek , Leigh Klotz, Jr. , Ramana Rao , Stuart Card, Bridging the paper and electronic worlds: the paper user interface, Proceedings of the INTERCHI '93 conference on Human factors in computing systems, p.507-512, May 1993, Amsterdam, The Netherlands
• 6: Scott R. Klemmer , Mark W. Newman , Ryan Farrell , Mark Bilezikjian , James A. Landay, The designers' outpost: a tangible interface for collaborative web site, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502350]
• 7: Lang, R. J. The Complete Book of Origami: Step-by-Step Instructions in Over 1000 Diagrams. Dover Publications, Mineola, NY, USA, (1988).
• 8: Leunissen, M. E., Christova, C. G., Hynninen, A.-P., Royall, C. P., Campbell, A. I., Imhof, A., Dijkstra, Van Roij, M. R. and Van Blaaderen, A. Ionic Colloidal Crystals of Oppositely Charged Particles, Nature (2005) 437, 235--240.
• 9: W. E. Mackay , Anne-Laure Fayard, Designing interactive paper: lessons from three augmented reality projects, Proceedings of the international workshop on Augmented reality : placing artificial objects in real scenes: placing artificial objects in real scenes, p.81-90, November 1999, Bellevue, Washington, United States
• 10: Polymer Vision. http://www.polymervision.com/ (2007)
• 11: Bill N. Schilit , Gene Golovchinsky , Morgan N. Price, Beyond paper: supporting active reading with free form digital ink annotations, Proceedings of the SIGCHI conference on Human factors in computing systems, p.249-256, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274680]
• 12: Carsten Schwesig , Ivan Poupyrev , Eijiro Mori, Gummi: user interface for deformable computers, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766091]
• 13: Abigail J. Sellen , Richard H.R. Harper, The Myth of the Paperless Office, MIT Press, Cambridge, MA, 2003
• 14: Sony, Inc. http://www.sony.net/SonyInfo/News/Press_Archive/200409/04-048E/, (2007)
• 15: Kevin Vlack , Terukazu Mizota , Naoki Kawakami , Kazuto Kamiyama , Hiroyuki Kajimoto , Susumu Tachi, GelForce: a vision-based traction field computer interface, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056859]
• 16: Pierre Wellner, The DigitalDesk calculator: tangible manipulation on a desk top display, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.27-33, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120785]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Algorithms, Design, Human Factors

Keywords:
foldable input device, organic user interface, paper interface