|
ABSTRACT
Decentralized and unstructured peer-to-peer networks such as Gnutella are attractive for certain applications because they require no centralized directories and no precise control over network topology or data placement. However, the flooding-based query algorithm used in Gnutella does not scale; each query generates a large amount of traffic and large systems quickly become overwhelmed by the query-induced load. This paper explores, through simulation, various alternatives to Gnutella's query algorithm, data replication strategy, and network topology. We propose a query algorithm based on multiple random walks that resolves queries almost as quickly as Gnutella's flooding method while reducing the network traffic by two orders of magnitude in many cases. We also present simulation results on a distributed replication strategy proposed in [8]. Finally, we find that among the various network topologies we consider, uniform random graphs yield the best performance.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
L. A. Adamic, R. M. Lukose, A. R. Puniyani, and B. A. Huberman. Search in power law networks. In Phys. Rev. E64, pages 46135--46143, 2001.
|
| |
2
|
E. Adar and B. A. Huberman. Free riding on gnutella. In First Monday, http://www.firstmonday.dk/issues/ issue5_10/adar/index.html, Oct. 2000.
|
 |
3
|
William Aiello , Fan Chung , Linyuan Lu, A random graph model for massive graphs, Proceedings of the thirty-second annual ACM symposium on Theory of computing, p.171-180, May 21-23, 2000, Portland, Oregon, United States
[doi> 10.1145/335305.335326]
|
| |
4
|
Virgílio Almeida , Azer Bestavros , Mark Crovella , Adriana de Oliveira, Characterizing reference locality in the WWW, Proceedings of the fourth international conference on on Parallel and distributed information systems, p.92-107, December 18-20, 1996, Miami Beach, Florida, United States
|
| |
5
|
K. Calvert and E. W. Zegura. Gt-itm: Georgia tech internetwork topology models. In http://www.cc.gatech.edu/projects/gtitm/, 1997.
|
| |
6
|
Clip2.com. The gnutella protocol specification v0.4. In http://www9.limewire.com/developer/gnutella_protocol_0.4.pdf, 2000.
|
| |
7
|
Clip2.com. Gnutella: To the bandwidth barrier and beyond. In http://www.clip2.com/gnutella.html, 2000.
|
 |
8
|
Edith Cohen , Scott Shenker, Replication strategies in unstructured peer-to-peer networks, Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications, August 19-23, 2002, Pittsburgh, Pennsylvania, USA
|
| |
9
|
|
| |
10
|
Free Haven website. http://www.freehaven.net.
|
| |
11
|
Freenet website. http://freenet.sourceforge.net.
|
| |
12
|
D. Gallagher and R. Wilkerson. Network performance statistics for university of south carolina. In http://eddie.csd.sc.edu, Oct. 2001.
|
| |
13
|
Gnutella website. http://gnutella.wego.com.
|
| |
14
|
M. A. Jovanovic, F. S. Annexstein, and K. A. Berman. Scalability issues in large peer-to-peer networks - a case study of gnutella. Technical Report http://www.ececs.uc.edu/~mjovanov/Research/paper.html, University of Cincinnati, 2001.
|
| |
15
|
Mojo Nation, 2001. http://www.mojonation.net.
|
| |
16
|
Napster website. http://www.napster.com.
|
| |
17
|
D. Plonka. Uw-madison napster traffic measurement. In http://net.doit.wisc.edu/data/Napster, Mar. 2000.
|
 |
18
|
Sylvia Ratnasamy , Paul Francis , Mark Handley , Richard Karp , Scott Schenker, A scalable content-addressable network, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.161-172, August 2001, San Diego, California, United States
|
| |
19
|
J. Ritter. Why gnutella can't scale. no, really. In http://www.darkridge.com/~jpr5/doc/ gnutella.html, 2001.
|
 |
20
|
Antony Rowstron , Peter Druschel, Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
|
| |
21
|
K. Sripanidkulchai. The popularity of gnutella queries and its implications on scalability. In O'Reilly's www.openp2p.com, Feb. 2001.
|
| |
22
|
S. D. G. Stefan~Saroiu, P. Krishna Gummadi. A measurement study of peer-to-peer file sharing systems. Technical Report UW-CSE-01-06-02, Department of Computer Science & Engineering, University of Washington, 2002.
|
 |
23
|
Ion Stoica , Robert Morris , David Karger , M. Frans Kaashoek , Hari Balakrishnan, Chord: A scalable peer-to-peer lookup service for internet applications, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.149-160, August 2001, San Diego, California, United States
|
| |
24
|
K. Truelove. Gnutella: Alive, well, and changing fast. In http://www.openp2p.com/pub/a/p2p/2001/01/25/ truelove0101.html, Jan. 2001.
|
| |
25
|
|
| |
26
|
|
CITED BY 178
|
|
|
|
|
|
|
|
|
|
|
Karl Aberer , Philippe Cudré-Mauroux , Anwitaman Datta , Zoran Despotovic , Manfred Hauswirth , Magdalena Punceva , Roman Schmidt, P-Grid: a self-organizing structured P2P system, ACM SIGMOD Record, v.32 n.3, September 2003
|
|
|
|
|
|
|
|
|
|
|
|
Yatin Chawathe , Sylvia Ratnasamy , Lee Breslau , Nick Lanham , Scott Shenker, Making gnutella-like P2P systems scalable, Proceedings of the 2003 conference on Applications, technologies, architectures, and protocols for computer communications, August 25-29, 2003, Karlsruhe, Germany
|
|
|
|
|
|
Hsinping Wang , Tsungnan Lin , Chia Hung Chen , Yennan Shen, Dynamic search in peer-to-peer networks, Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters, May 19-21, 2004, New York, NY, USA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Chunqiang Tang , Zhichen Xu , Sandhya Dwarkadas, Peer-to-peer information retrieval using self-organizing semantic overlay networks, Proceedings of the 2003 conference on Applications, technologies, architectures, and protocols for computer communications, August 25-29, 2003, Karlsruhe, Germany
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Steffen Staab , Francis Heylighen , Carlos Gershenson , Gary William Flake , David M. Pennock , Daniel C. Fain , David De Roure , Karl Aberer , Wei-Min Shen , Olivier Dousse , Patrick Thiran, Neurons, Viscose Fluids, Freshwater Polyp Hydra-and Self-Organizing Information Systems, IEEE Intelligent Systems, v.18 n.4, p.72-86, July/August 2003
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Ruggero Morselli , Bobby Bhattacharjee , Aravind Srinivasan , Michael A. Marsh, Efficient lookup on unstructured topologies, Proceedings of the twenty-fourth annual ACM symposium on Principles of distributed computing, July 17-20, 2005, Las Vegas, NV, USA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Joon Ahn , Shyam Kapadia , Sundeep Pattem , Avinash Sridharan , Marco Zuniga , Jung-Hyun Jun , Chen Avin , Bhaskar Krishnamachari, Empirical evaluation of querying mechanisms for unstructured wireless sensor networks, ACM SIGCOMM Computer Communication Review, v.38 n.3, July 2008
|
|
|
|
|
|
Salma Ktari , Mathieu Zoubert , Artur Hecker , Houda Labiod, Performance evaluation of replication strategies in DHTs under churn, Proceedings of the 6th international conference on Mobile and ubiquitous multimedia, p.90-97, December 12-14, 2007, Oulu, Finland
|
|
|
Jaime Lloret , Juan R. Diaz , Jose M. Jiménez , Manuel Esteve, The popularity parameter in unstructured P2P file sharing networks, Proceedings of the 4th WSEAS International Conference on Applied Informatics and Communications, p.1-6, December 17-19, 2004, Tenerife, Canary Islands, Spain
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Daniel Stutzbach , Reza Rejaie , Nick Duffield , Subhabrata Sen , Walter Willinger, On unbiased sampling for unstructured peer-to-peer networks, Proceedings of the 6th ACM SIGCOMM on Internet measurement, October 25-27, 2006, Rio de Janeriro, Brazil
|
|
|
|
|
|
|
|
|
Shambhu Shrestha , Aki Kobayashi , Katsunori Yamaoka , Yoshinori Sakai , Noboru Sonehara, Efficient content location algorithm for content distribution networks based on distributed construction of search tree from contents of proximal nodes, Proceedings of the 24th IASTED international conference on Database and applications, p.101-108, February 13-15, 2006, Innsbruck, Austria
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
P. Trunfio , D. Talia , H. Papadakis , P. Fragopoulou , M. Mordacchini , M. Pennanen , K. Popov , V. Vlassov , S. Haridi, Peer-to-Peer resource discovery in Grids: Models and systems, Future Generation Computer Systems, v.23 n.7, p.864-878, August, 2007
|
|
|
|
|
|
|
|
|
Ozalp Babaoglu , Geoffrey Canright , Andreas Deutsch , Gianni A. Di Caro , Frederick Ducatelle , Luca M. Gambardella , Niloy Ganguly , Márk Jelasity , Roberto Montemanni , Alberto Montresor , Tore Urnes, Design patterns from biology for distributed computing, ACM Transactions on Autonomous and Adaptive Systems (TAAS), v.1 n.1, p.26-66, September 2006
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Yu Wu , Taisuke Izumi , Fukuhito Ooshita , Hirotsugu Kakugawa , Toshimitsu Masuzawa, An adaptive randomized search protocol in peer-to-peer systems, Proceedings of the 2007 ACM symposium on Applied computing, March 11-15, 2007, Seoul, Korea
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Andrea E.F. Clementi , Claudio Macci , Angelo Monti , Francesco Pasquale , Riccardo Silvestri, Flooding time in edge-Markovian dynamic graphs, Proceedings of the twenty-seventh ACM symposium on Principles of distributed computing, August 18-21, 2008, Toronto, Canada
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Yuhui Deng , Frank Wang , Na Helian , Sining Wu , Chenhan Liao, Dynamic and scalable storage management architecture for Grid Oriented Storage devices, Parallel Computing, v.34 n.1, p.17-31, January, 2008
|
|
|
Nikolaos D. Doulamis , Pantelis N. Karamolegkos , Anastasios D. Doulamis , Ioannis G. Nikolakopoulos, Optimal decomposition of P2P networks based on file exchange patterns for multimedia content search & replication, Proceedings of the international workshop on Workshop on multimedia information retrieval, September 24-29, 2007, Augsburg, Bavaria, Germany
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Cong Shi , Dingyi Han , Yuanjie Liu , Shicong Meng , Yong Yu, A dynamic routing protocol for keyword search in unstructured peer-to-peer networks, Computer Communications, v.31 n.2, p.318-331, February, 2008
|
|
|
Edward Bortnikov , Maxim Gurevich , Idit Keidar , Gabriel Kliot , Alexander Shraer, Brahms: byzantine resilient random membership sampling, Proceedings of the twenty-seventh ACM symposium on Principles of distributed computing, August 18-21, 2008, Toronto, Canada
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Elena Meshkova , Janne Riihijärvi , Marina Petrova , Petri Mähönen, A survey on resource discovery mechanisms, peer-to-peer and service discovery frameworks, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.52 n.11, p.2097-2128, August, 2008
|
|
|
Elena Meshkova , Janne Riihijärvi , Marina Petrova , Petri Mähönen, A survey on resource discovery mechanisms, peer-to-peer and service discovery frameworks, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.52 n.11, p.2097-2128, August, 2008
|
|
|
|
|
|
|
|
|
|
|
|
Matteo Agosti , Francesco Zanichelli , Michele Amoretti , Gianni Conte, P2PAM: a framework for peer-to-peer architectural modeling based on PeerSim, Proceedings of the 1st international conference on Simulation tools and techniques for communications, networks and systems & workshops, March 03-07, 2008, Marseille, France
|
|
|
|
|
|
Katja Hose , Armin Roth , André Zeitz , Kai-Uwe Sattler , Felix Naumann, A research agenda for query processing in large-scale peer data management systems, Information Systems, v.33 n.7-8, p.597-610, November, 2008
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Christof Leng , Wesley W. Terpstra , Bettina Kemme , Wilhelm Stannat , Alejandro P. Buchmann, Maintaining replicas in unstructured P2P systems, Proceedings of the 2008 ACM CoNEXT Conference, p.1-12, December 09-12, 2008, Madrid, Spain
|
|
|
|
|
|
|
|
|
Diego N. da Hora , Daniel F. Macedo , Leonardo B. Oliveira , Isabela G. Siqueira , Antonio A. F. Loureiro , José M. Nogueira , Guy Pujolle, Enhancing peer-to-peer content discovery techniques over mobile ad hoc networks, Computer Communications, v.32 n.13-14, p.1445-1459, August, 2009
|
|
|
Edward Bortnikov , Maxim Gurevich , Idit Keidar , Gabriel Kliot , Alexander Shraer, Brahms: Byzantine resilient random membership sampling, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.53 n.13, p.2340-2359, August, 2009
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|