CommunityCommands: command recommendations for software applications

ABSTRACT

We explore the use of modern recommender system technology to address the problem of learning software applications. Before describing our new command recommender system, we first define relevant design considerations. We then discuss a 3 month user study we conducted with professional users to evaluate our algorithms which generated customized recommendations for each user. Analysis shows that our item-based collaborative filtering algorithm generates 2.1 times as many good suggestions as existing techniques. In addition we present a prototype user interface to ambiently present command recommendations to users, which has received promising initial user feedback.

REFERENCES

• 1: Abran, A., Khelifi, A., Suryn, W. and Seffah, A. Usability Meanings and Interpretations in ISO standards. Software Quality Journal. 11(4): 325--338.
• 2: Adomavicius, G., Tuzhilin, A. (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. Transactions on Knowledge and Data Engineering 17(6): 734--749.
• 3: Apple Computers iTunes (http://www.apple.com/itunes) Active March 2009.
• 4: Benyon, D. (1993) Adaptive Systems: a Solution to Usability Problems. Journal of User Modelling and User-Adapted Interaction, 3(1): 65--87.
• 5: Claypool, M., Le, P., Waseda, M., Brown, D. (2001) Implicit interest indicators, in ACM IUI. p.33--40.
• 6: Cutrell, E., Czerwinski, M., and Horvitz, E. (2001) Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance. ACM CHI. p.263--269.
• 7: Czerwinski, M., Cutrell, E., and Horvitz, E. (2000) Instant messaging: Effects of relevance and time. People and Computers XIV: Proceedings of HCI. p.71--76.
• 8: Davison, B., and Hirsh, H. (1998) Predicting Sequences of User Actions. the AAAI/ICML Workshop on Predicting the Future: AI Approaches to Time-Series Analysis. AAAI. p.5--12.
• 9: Dent, L., Boticario, J., McDermott, J., Mitchell, T., and Zabowski, D. (1992) A Personal Learning Apprentice. AAAI. p.96--103.
• 10: Farzan, R., and Brusilovsky, P.. (2006) Social Navigation Support in a Course Recommendation System. Proceedings of Hypermedia and Adaptive Web-Based Systems. p.91--100.
• 11: Fischer, G. (2001). User Modeling in Human-Computer Interaction. UMUAI. 11(1--2): p.65--86.
• 12: Fogarty, J., Hudson, S. E., Atkeson, C. G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J. C., and Yang, J. (2005). Predicting human interruptibility with sensors. ACM TOCHI. 12(1): p.119--146.
• 13: Gajos, K. Z., Everitt, K., Tan, D.S., Czerwinski, M., and Weld D.S. (2008) Predictability and Accuracy in Adaptive User Interfaces. ACM CHI. p.1271--1274.
• 14: Grossman, T., Fitzmaurice, G., and Attar, R. (2009) A Survey of Software Learnability: Metrics, Methodologies and Guidelines. ACM CHI.
• 15: Hermens, L.A., and Schlimmer, J.C. (1994) A Machine-Learning Apprentice for the Completion of Repetitive Forms. IEEE Expert 9(1): p.28--33.
• 16: Hill, W., Stead, L., Rosenstein, M., and Furnas, G. (1995) Recommending And Evaluating Choices in a Virtual Community of Use. ACM CHI. 194--201.
• 17: Horvitz, E. (1999) Principles of Mixed--Initiative User Interfaces. ACM CHI. p.159--166.
• 18: Hsi, I. and Potts, C. (2000). Studying the Evolution and Enhancement of Software Features. IEEE SM. 143--151.
• 19: Hsu, Mei-Hua. (2008) A Personalized English Learning Recommender System for ESL Students. Expert Systems with Applications, 34(1): 683--688.
• 20: Igarashi, E., and Hughes, J.F. (2001) A Suggestive Interface for 3D Drawing. UIST. p.173--181.
• 21: Jones, Karen Spärck (1972) A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation, 60(5): p.493--502.
• 22: Knabe, K. (1995). Apple guide: a case study in user-aided design of online help. ACM CHI. p.286--287.
• 23: Linden, G., Smith, B., and York, J. (2003) Amazon.com recommendations: item-to-item collaborative filtering. Internet Computing, 7(1): p.76--80.
• 24: Linton, F., and Schaefer, H. (2000) Recommender Systems for Learning: Building User and Expert Models through Long-Term Observation of Application Use. UMUAI. 10(2--3): p.181--208.
• 25: Linton, F., Joy, D., Schaefer, H., and Charron, A. (2000) OWL: A Recommender System for Organization-Wide Learning. Educational Technology and Society, 3(1): 62--76.
• 26: Liu, J., Wong, C.K., and Hui, K.K. (2003) An Adaptive User Interface Based On Personalized Learning. Intelligent Systems, 18(2): 52--57.
• 27: McCrickard, S.D., Czerwinski, M., and Bartram, L. (2003) Introduction: design and evaluation of notification user interfaces. Int. J. Human-Computer Studies 8(5): p.509--514.
• 28: McGrenere, J., Baecker, R. M., and Booth, K. S. (2007) A Field Evaluation of An Adaptable Two-Interface Design for Feature-Rich Software. TOCHI. 14(1): #3
• 29: McNee, S.M., Kapoor, N., and Konstan, J.A. (2007) Don't look stupid: avoiding pitfalls when recommending research papers. CSCW. p.171--180.
• 30: Miller B. N., Albert, I., Lam, S. K., Konstan, J. A., Riedl, J. (2003) MovieLens unplugged: experiences with an occasionally connected recommender system, ACM IUI. p.263--266.
• 31: Mitchell, J., and Shneiderman, B. (1989). Dynamic versus static menus: an exploratory comparison. SIGCHI Bull. 20(4): p.33--37
• 32: Owen, D. (1986), Answers first, then questions. In: D. A. Norman and S. W. Draper (eds.), User-Centered System Design, New Perspectives on Human-Computer Interaction. p.361--375
• 33: Paymans, T.F., Lindenberg, J. and Neerincx, M. (2004). Usability trade-offs for adaptive user interfaces: ease of use and learnability, ACM IUI. p.301--303
• 34: Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., and Riedl, J. (1994) GroupLens: An Open Architecture for Collaborative Filtering of Netnews. CSCW. p.175--186.
• 35: Salton G., McGill M.J., (1983), Introduction to Modern Information Retrieval. McGraw-Hill, New York
• 36: Sarwar, B., George, K., Konstan, J., and Riedl, J. (2000) Analysis of Recommendation Algorithms for E-Commerce. ACM Electronic Commerce. p.158--167.
• 37: Shardanand, U., and Maes, P. (1995) "Social Information Filtering: Algorithms for Automating Word of Mouth". ACM CHI. p.210--217.
• 38: Shen, J., Li, L., Dietterich, T.G., and Herlocker J.L. (2006) A Hybrid Learning System for Recognizing User Tasks from Desktop Activities and Email Messages. IUI. p.86--92
• 39: Shneiderman, B. (1983). Direct Manipulation: A Step Beyond Programming Languages. Computer. 16(8): 57--69.
• 40: Shneiderman, B., (1997) Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley Longman Publishing Co., Inc.
• 41: Witten I., Cleary, J., and Greenberg, S. (1984). On frequency-based menu-splitting algorithms. Intl. Journal of Man-Machine Studies 21(2): 135--148.
• 42: Xiao, J., Stasko, J. and Catrambone, R. (2004). An Empirical Study of the Effect of Agent Competence on User Performance and Perception. Joint Conference on Autonomous Agents and Multiagent Systems. p.178--185.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Human Factors

Keywords:
recommender