Mining email social networks

ABSTRACT

Communication & Co-ordination activities are central to large software projects, but are difficult to observe and study in traditional (closed-source, commercial) settings because of the prevalence of informal, direct communication modes. OSS projects, on the other hand, use the internet as the communication medium,and typically conduct discussions in an open, public manner. As a result, the email archives of OSS projects provide a useful trace of the communication and co-ordination activities of the participants. However, there are various challenges that must be addressed before this data can be effectively mined. Once this is done, we can construct social networks of email correspondents, and begin to address some interesting questions. These include questions relating to participation in the email; the social status of different types of OSS participants; the relationship of email activity and commit activity (in the CVS repositories) and the relationship of social status with commit activity. In this paper, we begin with a discussion of our infrastructure (including a novel use of Scientific Workflow software) and then discuss our approach to mining the email archives; and finally we present some preliminary results from our data analysis.

REFERENCES

• 1: Rakesh Agrawal , Sridhar Rajagopalan , Ramakrishnan Srikant , Yirong Xu, Mining newsgroups using networks arising from social behavior, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775227]
• 2: A.-L. Barabási and R. Albert. Emergence of scaling in random networks. Science, 286:509--512, 1999.
• 3: Christian Bird , Alex Gourley , Prem Devanbu , Michael Gertz , Anand Swaminathan, Mining email social networks in Postgres, Proceedings of the 2006 international workshop on Mining software repositories, May 22-23, 2006, Shanghai, China [doi>10.1145/1137983.1138033]
• 4: Frederick P. Brooks, Jr., The Mythical Man-Month: Essays on Softw, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1978
• 5: S. Chapman. Sam's string metrics page. www.dcs.shef.ac.uk/ sam/stringmetrics.html.
• 6: J. F. P. D. Cleidson de Souza. Seeking the source: Software source code as a social and technical artifact, 2005. http://opensource.mit.edu/papers/desouza.pdf.
• 7: K. Crowston and J. Howison. The social structure of free and open source software development. opensource.mit.edu/papers/crowstonhowison.pdf, November 2004.
• 8: Bert J. Dempsey , Debra Weiss , Paul Jones , Jane Greenberg, Who is an open source software developer?, Communications of the ACM, v.45 n.2, p.67-72, February 2002 [doi>10.1145/503124.503125]
• 9: L. C. Freeman. Centrality in social networks I. Conceptual clarification. Social Networks, 1:215--239, 1979.
• 10: M. Granovetter. The strength of weak ties. American Journal of Sociology, 78:1360--1380, 1973.
• 11: K. Kuwabara. Linux: A bazaar at the edge of chaos. First Monday, 5(3), March 2000.
• 12: L. Lopez, J. M. Gonzalez-Barahona, and G. Robles. Applying social network analysis to the information in cvs repositories. In Proceedings of the International Workshop on Mining Software Repositories, 2004.
• 13: Gonzalo Navarro, A guided tour to approximate string matching, ACM Computing Surveys (CSUR), v.33 n.1, p.31-88, March 2001 [doi>10.1145/375360.375365]
• 14: M. E. J. Newman. The structure and function of complex networks. SIAM Review, 45:167--256, 2003.
• 15: J. Nieminen. On centrality in a graph. Scandinavian Journal of Psychology, 15:322--336, 1974.
• 16: Eric S. Raymond, The cathedral and the bazaar: musings on Linux and open source by an accidental revolutionary, O'Reilly & Associates, Inc., Sebastopol, CA, 2001
• 17: Esko Ukkonen, Algorithms for approximate string matching, Information and Control, v.64 n.1-3, p.100-118, Jan./Feb./March 1985 [doi>10.1016/S0019-9958(85)80046-2]
• 18: P. A. Wagstrom, J. D. Herbsleb, and K. Carley. A social network approach to free/open source software simulation. In Proceedings First International Conference on Open Source Systems, pages 16--23, 2005.
• 19: Jin Xu , Yongqin Gao , Scott Christley , Gregory Madey, A Topological Analysis of the Open Souce Software Development Community, Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS'05) - Track 7, p.198.1, January 03-06, 2005 [doi>10.1109/HICSS.2005.57]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics

General Terms:
Human Factors, Measurement

Keywords:
open source, social networks