Flashlight interaction: a study on mobile phone interaction techniques with large displays

ABSTRACT

In this paper, we introduce Flashlight interaction, a new approach to light-based interaction between mobile phones and large screens by using the phone camera flashlight. Using a mobile phone as an interaction device with large screens has been explored in various projects. Mobile phones are enhanced with different sensors and provide opportunities to be used as an interaction device with other devices such as a large display. Our approach supports to set up a private-public display setting and provide simple means for interaction without a wireless connectivity. Our user study results indicate that the interaction is easy to perform and understand due to the direct mapping between the phone movement and the response on the screen.

REFERENCES

• 1: Ballagas, R., Rohs, M., Sheridan, J. G., 2005. Sweep and Point and Shoot: Phonecam-Based Interactions for Large Public Displays. In Extended Abstracts HumanFactors in Computing Systems, ACM Press, New York, pp. 1200--1203
• 2: Holleis P., Rukzio E., Otto F., Schmidt A., 2007. Privacy and Curiosity in Mobile Interactions with Public Displays. In CHI 2007 workshop on Mobile Spatial Interaction, 2007
• 3: Jiang, H., Ofek E., Moraveji, N., Shi Y., 2006. Direct Pointer: Direct Manipulation for Large-DisplayInteraction using Handheld Cameras. In Proceedings of the SIGCHI conference on Human Factors in computing systems, ACM Press, New York, pp. 3941--3944
• 4: Miyaoku K., Higashino S., Tonomura Y., 2004. C-Blink: A Hue-Difference-Based Light Signal Marker for Large Screen Interaction via Any Mobile Terminal. In Proc. 17th Ann. ACM Symp. User Interface Softwareand Technology (UIST 04), ACM Press, New York, pp. 147--156
• 5: Rohs, M., Essl, G., 2008. Sensing-Based Interaction for Information Navigation on Handheld Displays. In Advances in Human-Computer Interaction, Hindawi Publishing Corporation, p. 11 ff.
• 6: Vajk, T., Coulton, P., Bamford, W., Edwards, R. Using a mobile phone as a "Wii-like" controller for playing games on a large public display, International Journal of Computer Games Technology, v. 2008 n. 2, p. 1--6, January 2008

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors

Keywords:
interaction, light, mobile phone, public display