New methods for conducting experiments with mobile systems and services in the field

ABSTRACT

The main aim of this PhD study is to develop new methods for conducting field experiments to evaluate mobile systems and services. A framework is proposed for automatic and remote capture and analysis of usage and contextual data on the mobile devices. The paper presents and discusses the background, motivation and research goals for the study as well as the main problems and envisioned solutions. Also a brief status will be given including preliminary results.

REFERENCES

• 1: Nathan Eagle , Alex (Sandy) Pentland, Reality mining: sensing complex social systems, Personal and Ubiquitous Computing, v.10 n.4, p.255-268, March 2006 [doi>10.1007/s00779-005-0046-3]
• 2: David M. Hilbert , David F. Redmiles, An approach to large-scale collection of application usage data over the Internet, Proceedings of the 20th international conference on Software engineering, p.136-145, April 19-25, 1998, Kyoto, Japan
• 3: David M. Hilbert , David F. Redmiles, Extracting usability information from user interface events, ACM Computing Surveys (CSUR), v.32 n.4, p.384-421, Dec. 2000 [doi>10.1145/371578.371593]
• 4: Melody Y. Ivory , Marti A Hearst, The state of the art in automating usability evaluation of user interfaces, ACM Computing Surveys (CSUR), v.33 n.4, p.470-516, December 2001 [doi>10.1145/503112.503114]
• 5: K. L. Jensen, L. B. Larsen, S. Larsen, and M. H. Rasmussen. Implementation of the cntk car rental service. Technical report, Aalborg University, 2006.
• 6: K. L. Jensen, C. F. Pedersen, and L. B. Larsen. Towards useful and usable services in personal networks. In First International Workshop on Personalized Networks, 2006.
• 7: K. L. Jensen, C. F. Pedersen, and L. B. Larsen. Diasnet mobile: A personalized mobile diabetes management and advisory service. In Second Workshop on Personalization for E-Health, 2007.
• 8: A. M. Kanstrup, N. Boye, and C. Nøhr. Designing m-learning for junior registrars - activation of a theoretical model of clinical knowledge. In 12th International Health (Medical) Informatics Congress, 2007.
• 9: J. Kjeldskov and C. Graham. A review of mobilehci research methods. In Proceedings of the 5th International Mobile HCI 2003 conference, pages 317--335, Berlin, 2003. Springer-Verlag.
• 10: J. Kjeldskov and M. B. Skov. Studying usability in sitro: Simulating real world phenomena in controlled environments. International Journal of Human-Computer Studies, 22:7--37, 2007.
• 11: J. Kjeldskov, M. B. Skov, B. S. Als, and R. T. Høegh. Is it worth the hassle? exploring the added value of evaluating the usability of context-aware mobile systems in the field. In Proceedings of the 6th International Mobile HCI 2004 conference, pages 61--73, Berlin, 2004. Springer-Verlag.
• 12: Mika Raento , Antti Oulasvirta , Renaud Petit , Hannu Toivonen, ContextPhone: A Prototyping Platform for Context-Aware Mobile Applications, IEEE Pervasive Computing, v.4 n.2, p.51-59, April 2005 [doi>10.1109/MPRV.2005.29]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Experimentation, Human Factors, Measurement

Keywords:
analysis, automated, context, data capture, evaluation, field experiments, framework, mobile interaction, remote, usability