Barehands: implement-free interaction with a wall-mounted display

ABSTRACT

We describe Barehands, a free-handed interaction technique, in which the user can control the invocation of system commands and tools on a touch screen by touching it with distinct hand postures. Using behind-screen infrared (IR) illumination and a video camera with an IR filter, we enable a back-projected SMARTBoard (a commercially available, 61 3/8" x 47" touch-sensing display) to identify and respond to several distinct hand postures. Barehands provides a natural, quick, implement-free method of interacting with large, wall-mounted interactive surfaces.

REFERENCES

• 1: Nobuyuki Matsushita , Jun Rekimoto, HoloWall: designing a finger, hand, body, and object sensitive wall, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.209-210, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263549]
• 2: See http://www.smarttech.com.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Algorithms, Design, Human Factors

Keywords:
hand posture, image processing, infrared, interaction technique, touch interaction, user interface