Bridging the gap between real printouts and digital whiteboard

ABSTRACT

In this paper, we describe a paper-based interface, which combines the physical (real) with the digital world: while interacting with real paper printouts, users can seamlessly work with a digital whiteboard at the same time. Users are able to send data from a real paper to the digital world by picking up the content (e.g. images) from real printouts and drop it on the digital surface. The reverse direction for transferring data from the whiteboard to the real paper is supported through printouts of the whiteboard page that are enhanced with integrated Anoto patterns. We present four different interaction techniques that show the potential of this paper and digital world combination. Moreover, we describe the workflow of our system that bridges the gap between the two worlds in detail.

REFERENCES

• 1: Arregui, D., Fernstrom, C., Pacull, F., Rondeau, G., Willamowski, J., Crochon, F., and Favre-Reguillon, F. Paper-based communicating objects in the future office. 2003.
• 2: Peter Brandl , Michael Haller , Michael Hurnaus , Verena Lugmayr , Juergen Oberngruber , Claudia Oster , Christian Schafleitner , Mark Billinghurst, An Adaptable Rear-Projection Screen Using Digital Pens And Hand Gestures, Proceedings of the 17th International Conference on Artificial Reality and Telexistence, p.49-54, November 28-30, 2007 [doi>10.1109/ICAT.2007.16]
• 3: Mark Fiala, ARTag, a Fiducial Marker System Using Digital Techniques, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2, p.590-596, June 20-26, 2005 [doi>10.1109/CVPR.2005.74]
• 4: François Guimbretière, Paper augmented digital documents, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.51-60, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964702]
• 5: David L. Hecht, Printed Embedded Data Graphical User Interfaces, Computer, v.34 n.3, p.47-55, March 2001
• 6: Jonathan J. Hull , Berna Erol , Jamey Graham , Qifa Ke , Hidenobu Kishi , Jorge Moraleda , Daniel G. Van Olst, Paper-Based Augmented Reality, Proceedings of the 17th International Conference on Artificial Reality and Telexistence, p.205-209, November 28-30, 2007 [doi>10.1109/ICAT.2007.42]
• 7: Walter Johnson , Herbert Jellinek , Leigh Klotz, Jr. , Ramana Rao , Stuart Card, Bridging the paper and electronic worlds: the paper user interface, Proceedings of the INTERCHI '93 conference on Human factors in computing systems, p.507-512, May 1993, Amsterdam, The Netherlands
• 8: Chunyuan Liao , François Guimbretière , Ken Hinckley, PapierCraft: a command system for interactive paper, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095074]
• 9: Wendy E. Mackay , Guillaume Pothier , Catherine Letondal , Kaare Bøegh , Hans Erik Sørensen, The missing link: augmenting biology laboratory notebooks, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571992]
• 10: Les Nelson , Satoshi Ichimura , Elin Rønby Pedersen , Lia Adams, Palette: a paper interface for giving presentations, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.354-361, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303109]
• 11: Jun Rekimoto, Pick-and-drop: a direct manipulation technique for multiple computer environments, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.31-39, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263505]
• 12: Beat Signer , Moira C. Norrie, PaperPoint: a paper-based presentation and interactive paper prototyping tool, Proceedings of the 1st international conference on Tangible and embedded interaction, February 15-17, 2007, Baton Rouge, Louisiana [doi>10.1145/1226969.1226981]
• 13: Signer, B. Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces, Dissertation, ETH No. 16218, Zurich, Switzerland, 2006.
• 14: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]
• 15: Ron Yeh , Chunyuan Liao , Scott Klemmer , François Guimbretière , Brian Lee , Boyko Kakaradov , Jeannie Stamberger , Andreas Paepcke, ButterflyNet: a mobile capture and access system for field biology research, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124859]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Human Factors

Keywords:
digital pen, interactive paper, paper interface