Designing and evaluating kalas: A social navigation system for food recipes

ABSTRACT

The idea of social navigation is to aid users to navigate information spaces through making the collective, aggregated, or individual actions of others visible and useful as a basis for making decisions on where to go next and what to choose. These social markers should also help in turning the navigation experience into a social and pleasurable one rather than the tedious, boring, frustrating, and sometimes even scary experience of a lonely traveler. To evaluate whether it is possible to design for social navigation, we built the food recipe system Kalas. It includes several different forms of aggregated trails of user actions and means of communication between users: recommender system functionality (recommendations computed from others' choices), real-time broadcasting of concurrent user activity in the interface, possibilities to comment and vote on recipes, the number of downloads per recipe, and chatting facilities. Recipe author was also included in the recipe description.Kalas was tried with 302 users during six months, and 73 of the users answered a final questionnaire. The overall impression was that users liked and acted on aggregated trails and navigated differently because of them. 18&percent; of the selected recipes came from the list of recommended recipes. About half of the 73 users understood that recommendations were computed from their own and others actions, while the rest had not reflected upon it or had erroneous beliefs. Interestingly, both groups selected a large proportion of their recipes from the recommendations.Unfortunately, there were not enough users to populate the space at every occasion, and thus both chatting and following other users moving in the space was for the most part not possible, but when possible, users move to the space where most other users could be found. Of the other social textures, users themselves claimed to be most influenced by other users' comments attached to the recipes and less by recipe author or number of downloads. Users are more positive to the possibility of expressing themselves in terms of comments and voting than seeing the comments and votes of others.It was noted that users did not pick more recommended recipes towards the end of the study period when the accuracy of recommendations should have been higher. More or less from the start, they picked recommended recipes and went on doing so throughout the whole period.

REFERENCES

• 1: Breese, J. S., Heckerman, D., and Kadie, C. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th Annual Conference on Uncertainty in Artificial Intelligence. 43--52.
• 2: Maritza L. Calderón-Benavides , Cristina N. González-Caro , José de J. Pérez-Alcázar , Juan C. García-Díaz , Joaquin Delgado, A comparison of several predictive algorithms for collaborative filtering on multi-valued ratings, Proceedings of the 2004 ACM symposium on Applied computing, March 14-17, 2004, Nicosia, Cyprus [doi>10.1145/967900.968112]
• 3: Dan Cosley , Shyong K. Lam , Istvan Albert , Joseph A. Konstan , John Riedl, Is seeing believing?: how recommender system interfaces affect users' opinions, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642713]
• 4: Cosley, S. Lawrence, and D. M. Pennock. 2002. REFEREE: An open framework for practical testing of recommender systems using researchindex. In the 28th International Conference on Very Large Databases (VLDB'02) Hong Kong.
• 5: Andreas Dieberger, Supporting social navigation on the World Wide Web, International Journal of Human-Computer Studies, v.46 n.6, p.805-825, June 1997 [doi>10.1006/ijhc.1996.0111]
• 6: A. Dieberger , P. Dourish , K. Höök , P. Resnick , A. Wexelblat, Social navigation: techniques for building more usable systems, interactions, v.7 n.6, p.36-45, Nov./Dec. 2000 [doi>10.1145/352580.352587]
• 7: Andreas Dieberger , Peter Lönnqvist, Visualizing interaction history on a collaborative web server, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.220-221, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336374]
• 8: Dourish, P. and Chalmers, M. 1994. Running out of space: Models of information navigation. In Proceedings of Human Computer Interaction (HCI'94).
• 9: Thomas Erickson, The World-Wide-Web as social hypertext, Communications of the ACM, v.39 n.1, p.15-17, Jan. 1996 [doi>10.1145/234173.234174]
• 10: Erickson, T. 2004. Designing online collaborative environments: Social visualizations as shared resources. In Proceedings of the 9th International Working Conference on the Language-Action Perspective on Communication Modeling (LAP'04). M. Aakhus and M. Lind, Eds. Rutgers University, The State University of New Jersey, New Brunswick, NJ.
• 11: Thomas Erickson , David N. Smith , Wendy A. Kellogg , Mark Laff , John T. Richards , Erin Bradner, Socially translucent systems: social proxies, persistent conversation, and the design of “babble”, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.72-79, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302997]
• 12: Andreas Girgensohn , Alison Lee, Making web sites be places for social interaction, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587098]
• 13: Jonathan L. Herlocker , Joseph A. Konstan , John Riedl, Explaining collaborative filtering recommendations, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.241-250, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358995]
• 14: William C. Hill , James D. Hollan , Dave Wroblewski , Tim McCandless, Edit wear and read wear, Proceedings of the SIGCHI conference on Human factors in computing systems, p.3-9, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142751]
• 15: Höök, K., Munro, A., and Benyon, D., Eds. 2002. Designing Information Spaces: The Social Navigation Approach. Springer Verlag.
• 16: Joseph A. Konstan , Bradley N. Miller , David Maltz , Jonathan L. Herlocker , Lee R. Gordon , John Riedl, GroupLens: applying collaborative filtering to Usenet news, Communications of the ACM, v.40 n.3, p.77-87, March 1997 [doi>10.1145/245108.245126]
• 17: Maglio, P. and Barrett, R. 1999. WebPlaces: Adding people to the web. In the 8th International World Wide Web Conference (WWW8). Toronto, Canada.
• 18: Munro, A. 1999. Fringe Benefits: An ethnographic study of social navigation at the Edinburgh festival. Deliverable 2.1.1 from the PERSONA Project, available from SICS, Stockholm, Sweden.
• 19: Alan J. Munro , D. J. Sanger , D. R. Benyon, Personal and Social Navigation of Information Space, Springer-Verlag, London, 1999
• 20: Upendra Shardanand , Pattie Maes, Social information filtering: algorithms for automating “word of mouth”, Proceedings of the SIGCHI conference on Human factors in computing systems, p.210-217, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223931]
• 21: Lynn A. Streeter , Diane Vitello , Susan A. Wonsiewicz, How to tell people where to go: comparing navigational aids, International Journal of Man-Machine Studies, v.22 n.5, p.549-562, May 1985 [doi>10.1016/S0020-7373(85)80017-1]
• 22: Martin Svensson , Kristina Höök , Jarmo Laaksolahti , Annika Waern, Social navigation of food recipes, Proceedings of the SIGCHI conference on Human factors in computing systems, p.341-348, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365130]
• 23: Timpka, T. and Hallberg N. 1996. Talking at work---professional advice-seeking at primary healthcare centers. Scand. J. Prim Health Care 14, 130--135.
• 24: Alan Wexelblat, Results from the footprints project, Designing information spaces: the social navigation approach, Springer-Verlag, London, 2003
• 25: Alan Wexelblat , Pattie Maes, Footprints: history-rich tools for information foraging, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.270-277, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303060]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation

General Terms:
Design, Experimentation, Human Factors

Keywords:
Social navigation, collaborative filtering, design, evaluation, experiments