Motion-pointing: target selection using elliptical motions

ABSTRACT

We present a novel method called motion-pointing for selecting a set of visual items such as push-buttons without actually pointing to them. Instead, each potential target displays a rhythmically animated point we call the driver. To select a specific item, the user only has to imitate the motion of its driver using the input device. Once the motion has been recognized by the system, the user can confirm the selection to trigger the action. We consider cyclic motions on an elliptic trajectory with a specific period, and study the most effective methods for real-time matching such a trajectory, as well as the range of parameters a human can reliably reproduce. We then show how to implement motion-pointing in real applications using an interaction technique we call move-and-stroke. Finally, we measure the throughput and error rate of move-and-stroke in a controlled experiment. We show that the selection time is linearly proportional to the number of input bits conveyed up to 6 bits, confirming that motion-pointing is a practical input method.

REFERENCES

• 1: Ravin Balakrishnan, "Beating" Fitts' law: virtual enhancements for pointing facilitation, International Journal of Human-Computer Studies, v.61 n.6, p.857-874, December 2004 [doi>10.1016/j.ijhcs.2004.09.002]
• 2: Olivier Bau , Wendy E. Mackay, OctoPocus: a dynamic guide for learning gesture-based command sets, Proceedings of the 21st annual ACM symposium on User interface software and technology, October 19-22, 2008, Monterey, CA, USA [doi>10.1145/1449715.1449724]
• 3: Michel Beaudouin-Lafon, Designing interaction, not interfaces, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989865]
• 4: Stuart K. Card , Jock D. Mackinlay , George G. Robertson, A morphological analysis of the design space of input devices, ACM Transactions on Information Systems (TOIS), v.9 n.2, p.99-122, April 1991 [doi>10.1145/123078.128726]
• 5: P. M. Fitts. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47:381--391, 1954.
• 6: Andrew Fitzgibbon , Maurizio Pilu , Robert B. Fisher, Direct Least Square Fitting of Ellipses, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.21 n.5, p.476-480, May 1999 [doi>10.1109/34.765658]
• 7: Tovi Grossman , Pierre Dragicevic , Ravin Balakrishnan, Strategies for accelerating on-line learning of hotkeys, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240865]
• 8: Y. Guiard. On Fitts' and Hooke's laws: simple harmonic movement in upper-limb cyclical aiming. Acta Psychologica, 82(1-3):139--159, 1993.
• 9: H. Haken, J. A. S. Kelso, and H. Bunz. A theoretical model of phase transitions in human hand movements. Biological Cybernetics, 51(5):347--356, February 1985.
• 10: John C. Hart, Distance to an ellipsoid, Graphics gems IV, Academic Press Professional, Inc., San Diego, CA, 1994
• 11: P. N. Kugler and M. T. Turvey. Information, natural law, and the self-assembly of rhythmic movement. Lawrence Erlbaum Associates, 1987.
• 12: Gordon Kurtenbach , William Buxton, User learning and performance with marking menus, Conference companion on Human factors in computing systems, p.218, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260376]
• 13: I. Scott MacKenzie, Fitts' law as a research and design tool in human-computer interaction, Human-Computer Interaction, v.7 n.1, p.91-139, March 1992 [doi>10.1207/s15327051hci0701_3]
• 14: Sébastien Maury , Sylvie Athénes , Stéphane Chatty, Rhythmic menus: toward interaction based on rhythm, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632873]
• 15: D. Mottet, Y. Guiard, T. Ferrand, and R. J. Bootsma. Two-handed performance of a rhythmical Fitts task by individuals and dyads. Journal of Experimental Psychology: Human Perception and Performance, 27(6):1275--1286, 2001.
• 16: A. D. Patel, J. R. Iversen, Y. Chen, and B. H. Repp. The influence of metricality and modality on synchronization with a beat. Experimental Brain Research, 163(2):226--238, May 2005.
• 17: K. M. F. Romero, S. G. Mokarzel, M. O. T. Cunha, and M. C. Nemes. Realistic decoherence free subspaces. arXiv:quant-ph/0304018v2, 2003.
• 18: Dean Rubine, Specifying gestures by example, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.329-337, July 1991
• 19: R. Schmidt and M. T. Turvey. Phase-entrainment dynamics of visually coupled rhythmic movements. Biological Cybernetics, 70(4):369--376, Nov. 1994.
• 20: R. C. Schmidt, M. Bienvenu, P. A. Fitzpatrick, and P. G. Amazeen. A comparison of intra- and interpersonal interlimb coordination: Coordination breakdowns and coupling strength. Journal of Experimental Psychology: Human Perception and Performance, 24(3):884--900, 1998.
• 21: J. Williamson. Continuous Uncertain Interaction. PhD thesis, Department of Computing Science, University of Glasgow, 2006.
• 22: John Williamson , Roderick Murray-Smith, Pointing without a pointer, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986076]
• 23: P. G. Zanone and J. A. S. Kelso. Coordination dynamics of learning and transfer: collective and component levels. Journal of Experimental Psychology, 23(5):1454--1480, October 1997.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User interface management systems (UIMS)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Experimentation, Human Factors

Keywords:
alternative input, harmonic motion, oscillatory motion