Haptic techniques for media control

ABSTRACT

We introduce a set of techniques for haptically manipulating digital media such as video, audio, voicemail and computer graphics, utilizing virtual mediating dynamic models based on intuitive physical metaphors. For example, a video sequence can be modeled by linking its motion to a heavy spinning virtual wheel: the user browses by grasping a physical force-feedback knob and engaging the virtual wheel through a simulated clutch to spin or brake it, while feeling the passage of individual frames. These systems were implemented on a collection of single axis actuated displays (knobs and sliders), equipped with orthogonal force sensing to enhance their expressive potential. We demonstrate how continuous interaction through a haptically actuated device rather than discrete button and key presses can produce simple yet powerful tools that leverage physical intuition.

REFERENCES

• 1: M. Covell, M. Withgott, and M. Slaney, "Machl: Nonuniform Time-Scale Modification of Speech," Proc. of the IEEE Int'l Conf. on Acoustics, Speech, and Signal Processing, 1998.
• 2: Tinsley A. Galyean , John F. Hughes, Sculpting: an interactive volumetric modeling technique, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.267-274, July 1991
• 3: W. Gaver, "Auditory Interfaces," in Handbook of Human-Computer Interaction, M. G. Helander, T. K. Landauer, and P. Prabhu, Eds., 2nd ed. The Netherlands: Elsevier Science, 1997.
• 4: B. Gillespie, "The Virtual Piano Action: Design and Implementation," in Proc. of Int'l Computer Music Conf., Auhus, Denmark, pp. 167-170, 1994.
• 5: Ken Hinckley , Mike Sinclair, Touch-sensing input devices, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.223-230, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303045]
• 6: E. L. Hutchins, J. D. Hollan, and D. A. Norman, "Direct manipulation interfaces," in User Centered System Design: New Perspectives on Human- Computer Interaction, D. A. Norman and S. W. Draper, Ed. Hillsdale, N J: Lawrence Erlbaum Associates, 1986.
• 7: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 8: K. E. MacLean and S. S. Snibbe, "An Architecture for Haptic Control of Media," in Proc. of the 8th Ann. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, ASME / IMECE, Nashville, TN, DSC-5B-3, 1999.
• 9: Karon E. MacLean , Scott S. Snibbe , Golan Levin, Tagged handles: merging discrete and continuous manual control, Proceedings of the SIGCHI conference on Human factors in computing systems, p.225-232, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332435]
• 10: A. Madhani, G. Niemeyer, and J. K. Salisbury, "The Black Falcon: A Teleoperated Surgical Instrument for Minimally Invasive Surgery," in Proc. of IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), Victoria, BC, Canada, 1998.
• 11: Timothy Miller , Robert Zeleznik, The design of 3D haptic widgets, Proceedings of the 1999 symposium on Interactive 3D graphics, p.97-102, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300534]
• 12: H. B. Morganbesser and M. A. Srinivasan, "Force shading for shape perception in haptic virtual environments," in Proc. of the 5th Ann. Symp. on Haptic Interfaces for Virtual Environment and Teleoperator Systems, ASME/IMECE, Atlanta, GA, DSC:58, 1996.
• 13: W. Murch and F. F. Coppola, In the Blink of an Eye : A Perspective on Film Editing. Los Angeles: Silman-James Press, 1995.
• 14: M. Naimark, "Movimap and a 3D Panorama," SPIE, vol. 3012, pp. 297-305, 1997.
• 15: Wendy Plesniak , Ravikanth Pappu, Coincident display using haptics and holographic video, Proceedings of the SIGCHI conference on Human factors in computing systems, p.304-311, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274687]
• 16: Diego C. Ruspini , Krasimir Kolarov , Oussama Khatib, The haptic display of complex graphical environments, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.345-352, August 1997 [doi>10.1145/258734.258878]
• 17: Manojit Sarkar , Scott S. Snibbe , Oren J. Tversky , Steven P. Reiss, Stretching the rubber sheet: a metaphor for viewing large layouts on small screens, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.81-91, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168650]
• 18: B. Schneiderman, "Direct manipulation: A step beyond programming languages," IEEE Computer, vol. 16, 8, pp. 57-63, 1983.
• 19: S. S. Snibbe, S. Anderson, and W. L. Verplank, "Springs and Constraints for 3D Drawing," in Proc. of the 3rd Phantom Users' Group, Dedham, MA, MIT AI Lab TR #1643, 1998.
• 20: J. Watkinson, The Engineer's Guide to Motion Compensation: Petersfield: Snell & Wilcox, 1994.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors

Keywords:
Haptic force feedback, interaction techniques, media browsing, multimedia control, tangible interfaces, user interface design, video editing