Multi-context photo browsing on mobile devices based on tilt dynamics

ABSTRACT

This paper presents a photo browsing system on mobile devices to browse and search photos efficiently by tilting action. It employs tilt dynamics and a multi-scale photo screen layout for enhancing the browsing and the search capability respectively. The implementation uses continuous inputs from an accelerometer, and a multimodal (visual, audio and vibrotactile) display coupled with the states of this model. The model is based on a simple physical model, with its characteristics shaped to enhance controllability. The multi-scale layout holds both local and global view for users to both control photos and look at the surrounding context in a single framework. The experiment on Samsung MITs PDA used seven novice users browsing from 100 photos. We compare a tilt-based interaction method with a button-based browser and an iPod wheel by a quantitative usability criteria and subjective experience. The proposed tilt dynamics improves the usability over conventional dynamics. The iPod wheel has mixed performance comparing worse on some metrics than button pushing or tilt interaction, despite its commercial popularity.

REFERENCES

• 1: Q. Wang, S. Harada, T. Hsieh, A. Paepcke, M. Costabile, F. Paterno, "Visual interface and control modality: an experiment about fast photo browsing on mobile devices," IFIP Interact, p240--252 2005
• 2: D. Patel, G. Marsden, S. Jones, M. Jones, "An evaluation of techniques for browsing photograph collections on small displays," Mobile HCI, Glasgow, UK, p132--143, 2004
• 3: Dynal Patel , Gary Marsden , Matt Jones , Steve Jones, Improving photo searching interfaces for small-screen mobile computers, Proceedings of the 8th conference on Human-computer interaction with mobile devices and services, September 12-15, 2006, Helsinki, Finland [doi>10.1145/1152215.1152247]
• 4: A. Cockburn, J. Savage, "Comparing Speed-dependent automatic zooming with traditional scroll, pan, and zoom method," British HCI, Bath, England, p87--102, 2003
• 5: A. Cockburn., J. Looser, and J. Savage, "Around the World in Seconds with Speed-Dependent Automatic Zooming" Demo in ACM UIST, Vancouver, Canada, p35--36, 2003
• 6: Andy Cockburn , Joshua Savage , Andrew Wallace, Tuning and testing scrolling interfaces that automatically zoom, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1054983]
• 7: Steve Jones , Matt Jones , Gary Marsden , Dynal Patel , Andy Cockburn, An evaluation of integrated zooming and scrolling on small screens, International Journal of Human-Computer Studies, v.63 n.3, p.271-303, September 2005 [doi>10.1016/j.ijhcs.2005.03.005]
• 8: Apple, iPod (click wheel) manuals, http://docs.info.apple.com/article.html?artnum=32514
• 9: Wikipedia, "TFT LCD," http://en.wikipedia.org/wiki/TFT_LCD, 2006
• 10: Jun Rekimoto, Tilting operations for small screen interfaces, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.167-168, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237115]
• 11: Beverly L. Harrison , Kenneth P. Fishkin , Anuj Gujar , Carlos Mochon , Roy Want, Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.17-24, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274647]
• 12: Ken Hinckley , Jeff Pierce , Mike Sinclair , Eric Horvitz, Sensing techniques for mobile interaction, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.91-100, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354417]
• 13: P. Eslambolchilar, R. Murray-Smith, "Tilt-based Automatic Zooming and Scaling in Mobile Devices- a state-space implementation," Mobile HCI, Glasgow, p120--131, 2004
• 14: J. Kelly, R. Murray-Smith, Video of tilt-menu, 2004. www.dcs.gla.ac.uk/~rod/Videos/JamesMenu2.avi
• 15: J. Williamson, R. Murray-Smith, Dynamics and probabilistic text entry, Hamilton Summer School on SLFS, Springer-Verlag, LNCS, Vol. 3355, p333--342, 2005
• 16: P. Eslambolchilar, Making Sense of Interaction Using a Model-Based Approach, Ph.D. thesis, Hamilton Institute, National University of Ireland, Maynooth, 2006.
• 17: Oscar de Bruijn , Robert Spence, Rapid serial visual presentation: a space-time trade-off in information presentation, Proceedings of the working conference on Advanced visual interfaces, p.189-192, May 2000, Palermo, Italy [doi>10.1145/345513.345309]
• 18: J. Wijk, W. Nuij, "Smooth and efficient zooming and panning," IEEE Symp. on Information Visualization, Seattle, Washington, USA, p15--23, 2003
• 19: Andy Cockburn , Carl Gutwin , Jason Alexander, Faster document navigation with space-filling thumbnails, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124774]
• 20: Liyang Sun , François Guimbretière, Flipper: a new method of digital document navigation, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057077]
• 21: Sung-Jung Cho , Changkyu Choi , Younghoon Sung , Kwanghyeon Lee , Yeun-Bae Kim , Roderick Murray-Smith, Dynamics of tilt-based browsing on mobile devices, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1240930]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Algorithms, Human Factors

Keywords:
accelerometer, mobile interaction, motion-based interaction, multi-scale view, photo browsing, tilt dynamics