Using visualizations to increase compliance in experience sampling

ABSTRACT

Experience sampling method (or ESM) is a common data collection method to understand user behavior and to evaluate ubiquitous computing technologies. However, ESM studies often demand too much time and commitment from participants, which leads to attrition and low compliance among participants. We introduce a new approach called experience sampling with feedback or ES+feedback that improves compliance by giving feedback to participants through various visualizations. Providing feedback to users makes the information personally relevant and increases the value of the study to participants, which increases their compliance. Our exploratory study shows that ES+feedback increases the compliance rate by 23%.

REFERENCES

• 1: Lisa Feldman Barrett , Daniel J. Barrett, An introduction to computerized experience sampling in psychology, Social Science Computer Review, v.19 n.2, p.175-185, June 12 2001 [doi>10.1177/089443930101900204]
• 2: Scott Carter , Jennifer Mankoff , Jeffrey Heer, Momento: support for situated ubicomp experimentation, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240644]
• 3: Sunny Consolvo , Miriam Walker, Using the Experience Sampling Method to Evaluate Ubicomp Applications, IEEE Pervasive Computing, v.2 n.2, p.24-31, April 2003 [doi>10.1109/MPRV.2003.1203750]
• 4: Jon Froehlich , Mike Y. Chen , Sunny Consolvo , Beverly Harrison , James A. Landay, MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones, Proceedings of the 5th international conference on Mobile systems, applications and services, June 11-13, 2007, San Juan, Puerto Rico [doi>10.1145/1247660.1247670]
• 5: James M. Hudson , Jim Christensen , Wendy A. Kellogg , Thomas Erickson, "I'd be overwhelmed, but it's just one more thing to do": availability and interruption in research management, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503394]
• 6: Intille, S. S., Tapia, E. M., Rondoni, J., Beaudin, J. Kukla, C., Agarwal, S., Bao, L., and Larson, K. Tools for Studying Behavior and Technology in Natural Settings. Ubicomp 2003, pp. 157--174.
• 7: Aparna Krishnan , Steve Jones, TimeSpace: activity-based temporal visualisation of personal information spaces, Personal and Ubiquitous Computing, v.9 n.1, p.46-65, January 2005 [doi>10.1007/s00779-004-0291-x]
• 8: Leysia Palen , Marilyn Salzman, Voice-mail diary studies for naturalistic data capture under mobile conditions, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587092]
• 9: Scollon, C., Kim-Prieto, C., and Diener, E. Experience Sampling: Promises and Pitfalls, Strengths and Weaknesses. Journal of Happiness Studies 4, 2003, pp. 5--34.
• 10: Seligman, C. and Darley, J. M. Feedback as a Means of Decreasing Residential Energy Consumption. Applied Psychology, vol. 62(4), 1977, pp. 363--368.
• 11: Edward R. Tufte, Visual explanations: images and quantities, evidence and narrative, Graphics Press, Cheshire, CT, 1997

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Keywords:
empirical studies, experience sampling, visualizations