Espace de caractérisation des interactions gestuelles physiques sur dispositifs mobiles

ABSTRACT

Mobile interaction has become one of the most prominent fields in HCI. Because interaction resources are limited (small sized screen, no physical keyboard), and due to the specific constraints involved in mobile usage, many new interaction techniques have been proposed for handheld devices in recent years. This paper reviews the state of the art for gesture-based physical interaction and the techniques that rely on this concept. We also propose a design space aimed at classifying the existing techniques in regards to the specific issues involved in mobile interaction.

REFERENCES

• 1: Baffoun, S. and Robert, J. 2006. État de l'art des techniques de présentation d'information sur écran d'assistant numérique personnel. In Proc. of IHM06 (Montreal, Canada, April 18--21, 2006). vol. 133. ACM, New York, NY, 27--34.
• 2: Bailly, G., Roudaut, A., Lecolinet, E., and Nigay, L. 2008. Menus leaf: enrichir les menus linéaires par des gestes. In Proc. of IHM08 (Metz, France, September 02--05, 2008). vol. 339. ACM, New York, NY, 169--172.
• 3: Ballagas, R., Borchers, J., Rohs, M., Sheridan, J. G., 2006 "The Smart Phone: A Ubiquitous Input Device," IEEE Pervasive Computing, vol. 5, no. 1, pp. 70--77, January-March, 2006.
• 4: Bartlett, J. F. 2000. Rock'n' Scroll Is Here to Stay. IEEE Comput. Graph. Appl. 20, 3 (May. 2000), 40--45.
• 5: Baudisch, P. and Chu, G. 2009 Back-of-device Interaction allows creating very small touch devices In Proceedings of CHI 2009, Boston, MS, April 4--9, 2009
• 6: Baudisch, P. and Rosenholtz, R. 2003. Halo: a technique for visualizing off-screen objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05--10, 2003). CHI'03. ACM, New York, NY, 481--488.
• 7: Beaudouin-Lafon, M. 2000. Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands, April 01--06, 2000). CHI'00. ACM, New York, NY, 446--453.
• 8: Cadoz, C. 1994. Le geste, canal de communication homme/machine: la communication instrumentale. Technique et Science de l'information, 13(1): pp. 31--61.
• 9: Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Souchon, N., Bouillon, L., Vanderdonckt, J. 2002. Plasticity of User Interfaces: A revised reference framework. TAMODIA'02.
• 10: Ferscha, A., Vogl, S., Emsenhuber, B., and Wally, B. 2007. Physical shortcuts for media remote controls. In Proceedings of the 2nd international Conference on intelligent Technologies For interactive Entertainment (Cancun, Mexico, January 08--10, 2008). ICST (Institute for Computer Sciences Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, 1--8.
• 11: Hachet, M., Pouderoux, J., and Guitton, P. 2005. A camera-based interface for interaction with mobile handheld computers. In Proceedings of the 2005 Symposium on interactive 3D Graphics and Games (Washington, District of Columbia, April 03--06, 2005). I3D'05. ACM, New York, NY, 65--72.
• 12: Haro, A., Mori, K., Setlur, V., and Capin, T. 2005. Mobile camera-based adaptive viewing. In Proceedings of the 4th international Conference on Mobile and Ubiquitous Multimedia (Christchurch, New Zealand, December 08--10, 2005). MUM'05, vol. 154. ACM, New York, NY, 78--83.
• 13: Hinckley, K. 2003. Synchronous gestures for multiple persons and computers. In Proceedings of the 16th Annual ACM Symposium on User interface Software and Technology (Vancouver, Canada, November 02--05, 2003). UIST'03. ACM, New York, NY, 149--158.
• 14: Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. 2000. Sensing techniques for mobile interaction. In Proceedings of the 13th Annual ACM Symposium on User interface Software and Technology (San Diego, California, United States, November 06--08, 2000). UIST'00. ACM, New York, NY, 91--100.
• 15: Karam, M. and Schraefel, M. C. (2005) A Taxonomy of Gesture in Human Computer Interactions. Technical Report ECSTR-IAM05-009, Electronics and Computer Science, University of Southampton.
• 16: Karlson, A. K., Bederson, B. B., and SanGiovanni, J. 2005. AppLens and launchTile: two designs for one-handed thumb use on small devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA, April 02--07, 2005). CHI'05. ACM, New York, NY, 201--210.
• 17: Kauppila M (2008) Filler Models for Accelerometer Based Continuous Gesture Recognition. Sc. Thesis, Dept. of Mathematical Sciences, University of Oulu, May 2008.
• 18: Kauppila M, Inkeroinen T, Pirttikangas S & Riekki J (2008) Mobile Phone Controller Based on Accelerative Gesturing. Adjunct Proceedings Pervasive 2008, Sydney, Australia, 130--133.
• 19: Keim, D. A. 2002. Information Visualization and Visual Data Mining. IEEE Transactions on Visualization and Computer Graphics 8, 1 (Jan. 2002), 1--8.
• 20: Ladetto, Q., Merminod, B. 2002. Digital magnetic compass and gyroscope integration for pedestrian navigation. 9thinternational conference on integrated navigation systems, St-Petersburg, 27--29 May 2002.
• 21: Linjama, J. and Kaaresoja, T. 2004. Novel, minimalist haptic gesture interaction for mobile devices. In Proceedings of the Third Nordic Conference on Human-Computer interaction (Tampere, Finland, October 23--27, 2004). NordiCHI'04, vol. 82. ACM, New York, NY, 457--458.
• 22: Murray-Smith, R., Williamson, J., Hughes, S., Quaade, T., and Strachan, S. 2008. Rub the stane. In CHI'08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy, April 05--10, 2008). CHI'08. ACM, New York, NY, 2355--2360.
• 23: Nigay, L., Coutaz, J. Espaces conceptuels pour l'interaction multimédia et multimodale. TSI, spécial Multimédia et Collecticiel, AFCET & Hermes Publ., Vol 15(9), 1996, pp. 1195--1225.
• 24: Oakley, I. and Park, J. 2007. A motion-based marking menu system. In CHI'07 Extended Abstracts on Human Factors in Computing Systems (San Jose, CA, USA, April 28 - May 03, 2007). CHI'07. ACM, New York, NY, 2597--2602.
• 25: Pering, T., Anokwa, Y., and Want, R. 2007. Gesture connect: facilitating tangible interaction with a flick of the wrist. In Proc. of TEI'07 (Baton Rouge, Louisiana, February 15--17, 2007). TEI'07. ACM, New York, NY, 259--262.
• 26: Poirier, F., Schadle, I., État de l'art des méthodes de saisie de données sur dispositifs nomades, IHM 2004.
• 27: Pook, S., Lecolinet, E., Vaysseix, G., and Barillot, E. 2000. Control menus: excecution and control in a single interactor. In CHI'00 Extended Abstracts on Human Factors in Computing Systems (The Hague, The Netherlands, April 01--06, 2000). CHI'00. ACM, New York, NY, 263--264.
• 28: Rahman, M., Gustafson, S., Irani, P., and Subramanian, S. 2009. Tilt techniques: investigating the dexterity of wrist-based input. In Proceedings of the 27th international Conference on Human Factors in Computing Systems (Boston, MA, USA, April 04--09, 2009). CHI'09. ACM, New York, NY, 1943--1952.
• 29: Rehm, M., Bee, N., André, E. 2008. Wave Like an Egyptian --- Accelerometer Based Gesture Recognition for Culture Specific Interactions. In Procedings of HCI 2008 Culture, Creativity, Interaction, (2008).
• 30: Roudaut A., Baglioni M. et Lecolinet E. 2009. TimeTilt: Using Sensor-Based Gestures to Travel Through Multiple Applications on a Mobile Device. In Proc. of INTERACT'09.
• 31: Roudaut, A. et Lecolinet, E. 2007. Un espace de classification pour l'interaction sur dispositifs mobiles. IHM'07.
• 32: Roudaut, A., Huot, S., and Lecolinet, E. 2008. Tap-Tap and MagStick: improving one-handed target acquisition on small touch-screens. In Proceedings of the Working Conference on Advanced Visual interfaces (Napoli, Italy, May 28--30, 2008). AVI'08. ACM, New York, NY, 146--153.
• 33: Roudaut, A., Lecolinet, E., and Guiard, Y. 2009. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In Proc. of CHI09 (Boston, MA, USA, April 04--09, 2009). CHI'09. ACM, New York, NY, 927--936.
• 34: Schlömer, T., Poppinga, B., Henze, N., and Boll, S. 2008. Gesture recognition with a Wii controller. In Proceedings of the 2nd international Conference on Tangible and Embedded interaction (Bonn, Germany, February 18--20, 2008). TEI'08. ACM, New York, NY, 11--14.
• 35: Shneiderman, B. 1996. The eyes have it: A task by data type taxonomy of information visualizations, Proc. IEEE Symposium on Visual Languages '96, IEEE, Los Alamos, CA (September 1996), pg 336--34.
• 36: Sirisena, A., 2002. Mobile Text Entry, Rapport en informatique, Université de Canterbury (NZ), 2002.
• 37: Wigdor, D. and Balakrishnan, R. 2003. TiltText: using tilt for text input to mobile phones. In Proc. of UIST'03 (Vancouver, Canada, November 02--05, 2003). UIST'03. ACM, New York, NY, 81--90.
• 38: Wobbrock, J. O., Morris, M. R., and Wilson, A. D. 2009. User-defined gestures for surface computing. In Proc. CHI09 (Boston, MA, USA, April 04--09, 2009). CHI'09. ACM, New York, NY, 1083--1092.
• 39: Wobbrock, J., Myers, B., and Rothrock, B. 2006. Few-key text entry revisited: mnemonic gestures on four keys. In Proc. of CHI'06 (Montréal, Québec, Canada, April 22--27, 2006). R. Grinter, T. Rodden, P. Aoki, E. Cutrell, R. Jeffries, and G. Olson, Eds. CHI'06. ACM, New York, NY, 489--492.
• 40: http://www.realeyes3d.com/
• 41: http://www.apple.com/iphone
• 42: http://www.sonyericsson.com/
• 43: http://www.tat.se/
• 44: http://www.jmobil.fr/jeu-iphone/1491-shakeit.html
• 45: http://www.htc.com/
• 46: http://www.nitendo.fr/
• 47: http://www.techcrunch.com/2008/09/17/sgn-launches-igolf-for-iphone-wii-action-is-here/
• 48: http://wiki.openmoko.org/wiki/Neo_FreeRunner/fr
• 49: http://www.ssec.honeywell.com/magnetic/
• 50: http://www.france-powerball.com/
• 51: http://www.segway.fr/
• 52: http://www.pranavmistry.com/projects/sixthsense/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques

General Terms:
Design, Human Factors

Keywords:
embodied interaction, gestural language, interaction technique, mobile device, physical interaction