Assieme: finding and leveraging implicit references in a web search interface for programmers

ABSTRACT

Programmers regularly use search as part of the development process, attempting to identify an appropriate API for a problem, seeking more information about an API, and seeking samples that show how to use an API. However, neither general-purpose search engines nor existing code search engines currently fit their needs, in large part because the information programmers need is distributed across many pages. We present Assieme, a Web search interface that effectively supports common programming search tasks by combining information from Web-accessible Java Archive (JAR) files, API documentation, and pages that include explanatory text and sample code. Assieme uses a novel approach to finding and resolving implicit references to Java packages, types, and members within sample code on the Web. In a study of programmers performing searches related to common programming tasks, we show that programmers obtain better solutions, using fewer queries, in the same amount of time spent using a general Web search interface.

REFERENCES

• 1: Bajracharya, S., Ngo, T., Linstead, E., Rigor, P., Dou, Y., Baldi, P. and Lopes, C. Sourcerer: A Search Engine for Open Source Code. International Conference on Software Engineering (ICSE 2007).
• 2: Banko, M., Cafarella, M., Soderland, S., Broadhead, M. and Etzioni, O. Open Information Extraction from the Web. International Join Conferences on Artificial Intelligence (IJCAI 2007), 2670--2676.
• 3: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Computer Networks and ISDN Systems, v.30 n.1-7, p.107-117, April 1, 1998
• 4: Davor Čubranić , Gail C. Murphy, Hipikat: recommending pertinent software development artifacts, Proceedings of the 25th International Conference on Software Engineering, May 03-10, 2003, Portland, Oregon
• 5: Edward Cutrell , Zhiwei Guan, What are you looking for?: an eye-tracking study of information usage in web search, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240690]
• 6: Edward Cutrell , Daniel Robbins , Susan Dumais , Raman Sarin, Fast, flexible filtering with phlat, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124812]
• 7: Xin Dong , Alon Halevy , Jayant Madhavan, Reference reconciliation in complex information spaces, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland [doi>10.1145/1066157.1066168]
• 8: Mira Dontcheva , Steven M. Drucker , Geraldine Wade , David Salesin , Michael F. Cohen, Summarizing personal web browsing sessions, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166273]
• 9: Susan Dumais , Edward Cutrell , JJ Cadiz , Gavin Jancke , Raman Sarin , Daniel C. Robbins, Stuff I've seen: a system for personal information retrieval and re-use, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860451]
• 10: Nadav Eiron , Kevin S. McCurley, Analysis of anchor text for web search, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860550]
• 11: W B Frakes , B A Nejmeh, Software reuse through information retrieval, ACM SIGIR Forum, v.21 n.1-2, p.30-36, Sept.-March 1986-1987 [doi>10.1145/24634.24636]
• 12: Scott Henninger, Using Iterative Refinement to Find Reusable Software, IEEE Software, v.11 n.5, p.48-59, September 1994 [doi>10.1109/52.311059]
• 13: Reid Holmes , Gail C. Murphy, Using structural context to recommend source code examples, Proceedings of the 27th international conference on Software engineering, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062491]
• 14: David F. Huynh , Robert C. Miller , David R. Karger, Enabling web browsers to augment web sites' filtering and sorting functionalities, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166274]
• 15: Katsuro Inoue , Reishi Yokomori , Tetsuo Yamamoto , Makoto Matsushita , Shinji Kusumoto, Ranking Significance of Software Components Based on Use Relations, IEEE Transactions on Software Engineering, v.31 n.3, p.213-225, March 2005 [doi>10.1109/TSE.2005.38]
• 16: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, p.668-677, January 25-27, 1998, San Francisco, California, United States
• 17: Andrew J. Ko , Brad A. Myers , Htet Htet Aung, Six Learning Barriers in End-User Programming Systems, Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing, p.199-206, September 26-29, 2004 [doi>10.1109/VLHCC.2004.47]
• 18: Greg Little , Robert C. Miller, Translating keyword commands into executable code, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166275]
• 19: Yoëlle S. Maarek , Daniel M. Berry , Gail E. Kaiser, An Information Retrieval Approach for Automatically Constructing Software Libraries, IEEE Transactions on Software Engineering, v.17 n.8, p.800-813, August 1991 [doi>10.1109/32.83915]
• 20: David Mandelin , Lin Xu , Rastislav Bodík , Doug Kimelman, Jungloid mining: helping to navigate the API jungle, Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation, June 12-15, 2005, Chicago, IL, USA
• 21: A. Mili , R. Mili , R. T. Mittermeir, A survey of software reuse libraries, Annals of Software Engineering, 5, p.349-414, 1998
• 22: Blair Neate , Warwick Irwin , Neville Churcher, CodeRank: A New Family of Software Metrics, Proceedings of the Australian Software Engineering Conference, p.369-378, April 18-21, 2006 [doi>10.1109/ASWEC.2006.21]
• 23: Eduardo Ostertag , James Hendler , Rubén Prieto Díaz , Christine Braun, Computing similarity in a reuse library system: an AI-based approach, ACM Transactions on Software Engineering and Methodology (TOSEM), v.1 n.3, p.205-228, July 1992 [doi>10.1145/131736.131739]
• 24: Tim Paek , Susan Dumais , Ron Logan, WaveLens: a new view onto Internet search results, Proceedings of the SIGCHI conference on Human factors in computing systems, p.727-734, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985784]
• 25: S. Paul , A. Prakash, A Framework for Source Code Search Using Program Patterns, IEEE Transactions on Software Engineering, v.20 n.6, p.463-475, June 1994 [doi>10.1109/32.295894]
• 26: Diego Puppin , Fabrizio Silvestri, The social network of Java classes, Proceedings of the 2006 ACM symposium on Applied computing, April 23-27, 2006, Dijon, France [doi>10.1145/1141277.1141605]
• 27: Renuka Sindhgatta, Using an information retrieval system to retrieve source code samples, Proceedings of the 28th international conference on Software engineering, May 20-28, 2006, Shanghai, China [doi>10.1145/1134285.1134448]
• 28: Parag Singla , Pedro Domingos, Entity Resolution with Markov Logic, Proceedings of the Sixth International Conference on Data Mining, p.572-582, December 18-22, 2006 [doi>10.1109/ICDM.2006.65]
• 29: Naiyana Sahavechaphan , Kajal Claypool, XSnippet: mining For sample code, Proceedings of the 21st annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applications, October 22-26, 2006, Portland, Oregon, USA
• 30: Tao Xie , Jian Pei, MAPO: mining API usages from open source repositories, Proceedings of the 2006 international workshop on Mining software repositories, May 22-23, 2006, Shanghai, China [doi>10.1145/1137983.1137997]
• 31: Ka-Ping Yee , Kirsten Swearingen , Kevin Li , Marti Hearst, Faceted metadata for image search and browsing, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642681]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
implicit references, web search interfaces