Interaction for tabletop computing environment: an analysis and implementation

ABSTRACT

In the future ubiquitous computing living environment, humans will interact with computers (knowingly or unknowingly) any where by various means other than through the traditional desktop interface (e.g. keyboard and mouse). Interacting with a "smart" table could very well be one such probable scenario. In this paper, we outline and classify various possible techniques for interacting with the smart table under reasonable assumptions about the operating environment. We considered the primitive tasks of object selection, object manipulation and menu control. The classification should serve as a basis for experimenting, designing, selecting, composing and implementing a specific interaction technique for a given task to achieve high usability.

REFERENCES

• 1: M. Weiser, The computer for the 21st century, Scientific American," Vol. 265, No. 3, pp. 94--104, Sep. 1991
• 2: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 3: Chia Shen , Frédéric D. Vernier , Clifton Forlines , Meredith Ringel, DiamondSpin: an extensible toolkit for around-the-table interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.167-174, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985714]
• 4: T. Starner, B. Leibe, D. Minnen, T. Westyn, A. Hurst, J. Weeks, The perceptive workbench: computer-vision based gesture tracking, object tracking, and 3D reconstruction for augmented desks, Machine Vision and Applications, Vol. 14, No. 1, pp. 59--71, 2003
• 5: D. Bowman, D. Johnson and L. Hodges, Testbed evaluation of virtual environment interaction techniques, Presence: Teleoperators and Virtual Environments, Vol. 10, No. 1, pp. 75--95, 2001
• 6: A. Jacobs, J. Mather, R. Winlow, D. Montgomery, G. Jones, M. Willis, M. Tillin, L. Hill, M. Khazova, H. Stevenson and G. Bourhill, 2D/3D switchable displays, Sharp Technical Journal, No. 4, Apr. 2003
• 7: G. J. Woodgate, J. Harrold, A. Jacobs, R. R. Moseley and D. Ezra, Flat panel autostereoscopic displays -- characterization and enhancement, Proceedings of SPIE, Vol. 3957, Jan. 2000
• 8: Marek Czernuszenko , Dave Pape , Daniel Sandin , Tom DeFanti , Gregory L. Dawe , Maxine D. Brown, The ImmersaDesk and Infinity Wall projection-based virtual reality displays, ACM SIGGRAPH Computer Graphics, v.31 n.2, p.46-49, May 1997 [doi>10.1145/271283.271303]
• 9: Wolfgang Krueger , Bernd Froehlich, The Responsive Workbench, IEEE Computer Graphics and Applications, v.14 n.3, p.12-15, May 1994 [doi>10.1109/38.279036]
• 10: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]
• 11: R. van de Pol, W. Ribarsky, L. Hodges and F. Post, Interaction in semi-immersive large display environments, Virtual Environment '99, Proceedings of the Eurographics Workshop in Vienna, pp. 157--168, May 1999
• 12: P. Tandler, Architecture of BEACH: the software infrastructure for roomware environments, CSCW 2000, Workshop on Shared Environments to Support Face-to-Face Collaboration, Dec. 2000
• 13: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 14: Mike Wu , Ravin Balakrishnan, Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.193-202, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964718]
• 15: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 16: Y. Kakehi, M. Iida, T. Naemura, Y. Shirai, M. Matsushita and T. Ohguro, Limisight table: interactive view-dependent display-table surrounded by multiple users, ACM SIGGRAPH 2004, Emerging Technologies, LA, Aug. 2004
• 17: A. S. Forsberg, J. J. La Viola Jr., R. C. Zeleznik, ErgoDesk: a framework for two- and three-dimensional interaction at the ActiveDesk, Proceedings of the Second International Immersive Projection Technology Workshop, May 1998
• 18: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 19: Ken Shoemake, ARCBALL: a user interface for specifying three-dimensional orientation using a mouse, Proceedings of the conference on Graphics interface '92, p.151-156, September 1992, Vancouver, British Columbia, Canada
• 20: Mark R. Mine , Frederick P. Brooks, Jr. , Carlo H. Sequin, Moving objects in space: exploiting proprioception in virtual-environment interaction, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.19-26, August 1997 [doi>10.1145/258734.258747]
• 21: Comart System Co. Ltd., MIG4 manual and SDK, http://www.comartsystem.com
• 22: Intel, OpenCV library, http://www.intel.com/research/mrl/research/opencv/
• 23: Microsoft, Speech SDK 5.1 for Windows applications, http://www.microsoft.com/speech/downIoad/sdk51/
• 24: 3M, 3D MicroTouch, http://www.3m.com/3MTouchSystems/

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Information browsers
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors, Management

Keywords:
3D interaction techniques, tabletop computing, task analysis, ubiquitous computing