Low-cost multi-touch sensing through frustrated total internal reflection

ABSTRACT

This paper describes a simple, inexpensive, and scalable technique for enabling high-resolution multi-touch sensing on rear-projected interactive surfaces based on frustrated total internal reflection. We review previous applications of this phenomenon to sensing, provide implementation details, discuss results from our initial prototype, and outline future directions.

REFERENCES

• 1: William Buxton , Ralph Hill , Peter Rowley, Issues and techniques in touch-sensitive tablet input, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.215-224, July 1985
• 2: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 3: Fingerworks. iGesturePad. http://www.fingerworks.com/
• 4: Fujieda, I., Haga, H. 1997. Fingerprint Input based on Scattered-Light Detection. Applied Optics-IP, 36, 35, 9152-9156
• 5: Richard Greene, The drawing prism: a versatile graphic input device, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.103-110, July 1985
• 6: Hillis, W. D. 1982. A High Resolution Imaging Touch Sensor. International Journal of Robotics Research, 1982, 1, 2, 33--44.
• 7: Johnson, R. and Fryberger, D. 1972. Touch Actuable Data Input Panel Assembly. U.S. Patent 3,673,327. Jun. 1972.
• 8: Kazuto Kamiyama , Kevin Vlack , Terukazu Mizota , Hiroyuki Kajimoto , Naoki Kawakami , Susumu Tachi, Vision-Based Sensor for Real-Time Measuring of Surface Traction Fields, IEEE Computer Graphics and Applications, v.25 n.1, p.68-75, January 2005 [doi>10.1109/MCG.2005.27]
• 9: Kasday, L. 1984. Touch Position Sensitive Surface. U.S. Patent 4,484,179. Nov. 1984.
• 10: Andreas M. Kunz , Christian P. Spagno, Technical system for collaborative work, Proceedings of the workshop on Virtual environments 2002, May 30-31, 2002, Barcelona, Spain
• 11: SK Lee , William Buxton , K. C. Smith, A multi-touch three dimensional touch-sensitive tablet, Proceedings of the SIGCHI conference on Human factors in computing systems, p.21-25, April 1985, San Francisco, California, United States
• 12: Shahzad Malik , Joe Laszlo, Visual touchpad: a two-handed gestural input device, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027980]
• 13: Mallos, J. 1982. Touch Position Sensitive Surface. U.S. Patent 4,346,376. Aug. 1982.
• 14: Mitsunori Matsushita , Makoto Iida , Takeshi Ohguro , Yoshinari Shirai , Yasuaki Kakehi , Takeshi Naemura, Lumisight table: a face-to-face collaboration support system that optimizes direction of projected information to each stakeholder, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031653]
• 15: Nobuyuki Matsushita , Jun Rekimoto, HoloWall: designing a finger, hand, body, and object sensitive wall, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.209-210, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263549]
• 16: Mott, D. H., Lee, M. H., and Nicholls, H. 1986. An Experimental Very High Resolution Tactile Sensor Array. In Robot Sensors Vol. 2: Tactile and Non-Vision, Pugh, A., Ed. Springer-Verlag, Berlin, 179--188.
• 17: Mueller, R. 1974. Direct Television Drawing and Image Manipulating System. U.S. Patent 3,846,826. Nov. 1974.
• 18: Nicol, K., and Hennig, E. M. C. 1979. Apparatus for the Time-Dependant Measurement of Physical Quantities. U.S. Patent 4,134,063. Jan. 1979.
• 19: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 20: Tactex. Smart Fabric Technology. http://www.tactex.com/
• 21: Tanie, K., Komoriya, K., Kaneko, M., Tachis, S., and Fujikava, A. 1986. A High Resolution Tactile Sensor. In Robot Sensors Vol. 2: Tactile and Non-Vision, Pugh, A., Ed. Springer-Verlag, Berlin, 189--198.
• 22: Westerman, W. and Elias, J. G. 2001. Method and Apparatus for Integrating Manual Input. U.S. Patent 6,323,846. Nov. 2001.
• 23: Westerman, W., Elias, J. G., and Hedge, A. 2001. Multi-Touch: A New Tactile 2-D Gesture Interface for Human-Computer Interaction. In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (Minneapolis/St. Paul, MN, Oct. 2001), 632--636.
• 24: White, R. M. 1987. Tactile Sensor Employing a Light Conducting Element and a Resiliently Deformable Sheet. U.S. Patent 4,668,861. May 1987.
• 25: White, W. 1965. Method for Optical Comparison of Skin Friction-Ridge Patterns. U.S. Patent 3,200,701. Aug. 1965.
• 26: Andrew D. Wilson, TouchLight: an imaging touch screen and display for gesture-based interaction, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027946]
• 27: Mike Wu , Ravin Balakrishnan, Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.193-202, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964718]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Human Factors

Keywords:
frustrated total internal reflection, multi-touch, tactile, touch