ProtoPeer: a P2P toolkit bridging the gap between simulation and live deployement

ABSTRACT

Simulators are a commonly used tool in peer-to-peer systems research. However, they may not be able to capture all the details of a system operating in a live network. Transitioning from the simulation to the actual system implementation is a non-trivial and time-consuming task.

We present ProtoPeer, a peer-to-peer systems prototyping toolkit that allows for switching between the event-driven simulation and live network deployment without changing any of the application code. ProtoPeer defines a set of APIs for message passing, message queuing, timer operations as well as overlay routing and managing the overlay neighbors. Users can plug in their own custom implementations of most of the parts of ProtoPeer including custom network models for simulation and custom message passing over different network stacks.

ProtoPeer is not only a framework for building systems but also for evaluating them. It has a unified system-wide infrastructure for event injection, measurement logging, measurement aggregation and managing evaluation scenarios.

The simulator scales to tens of thousands of peers and gives accurate predictions closely matching the live network measurements.

REFERENCES

• 1: Jist/swans. http://jist.ece.cornell.edu/, Mar 2008.
• 2: Narses. http://sourceforge.net/projects/narses, Mar 2008.
• 3: Neurogrid. http://www.neurogrid.net/, Mar 2008.
• 4: ns2 network simulator. http://www.isi.edu/nsnam/ns/, Mar 2008.
• 5: Overlay weaver. http://overlayweaver.sourceforge.net/, Mar 2008.
• 6: P2psim. http://pdos.csail.mit.edu/p2psim, Mar 2008.
• 7: Peersim. http://peersim.sourceforge.net/, Mar 2008.
• 8: Planetsim. http://www.planetsim.net/, Mar 2008.
• 9: C. Arad, O. Kafray, A. Ghodsi, S. Haridi, N. Finne, J. Eriksson, A. Dunkels, and T. Voigt. GODS: Global observatory for distributed systems. Technical Report Technical Report T2007-09, Swedish Institute of Computer Science.
• 10: Henri Casanova , Arnaud Legrand , Martin Quinson, SimGrid: A Generic Framework for Large-Scale Distributed Experiments, Proceedings of the Tenth International Conference on Computer Modeling and Simulation, p.126-131, April 01-03, 2008 [doi>10.1109/UKSIM.2008.28]
• 11: Brent Chun , David Culler , Timothy Roscoe , Andy Bavier , Larry Peterson , Mike Wawrzoniak , Mic Bowman, PlanetLab: an overlay testbed for broad-coverage services, ACM SIGCOMM Computer Communication Review, v.33 n.3, July 2003 [doi>10.1145/956993.956995]
• 12: Frank Dabek , Jinyang Li , Emil Sit , James Robertson , M. Frans Kaashoek , Robert Morris, Designing a DHT for low latency and high throughput, Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation, p.7-7, March 29-31, 2004, San Francisco, California
• 13: W. Galuba and K. Aberer. Generic emergent overlays in arbitrary peer identifier spaces. In 2nd International Workshop on Self-Organizing Systems (IWSOS 2007), volume 4725, pages 88--102, 2007.
• 14: Charles Edwin Killian , James W. Anderson , Ryan Braud , Ranjit Jhala , Amin M. Vahdat, Mace: language support for building distributed systems, ACM SIGPLAN Notices, v.42 n.6, June 2007
• 15: Fabius Klemm , Jean-Yves Le Boudec , Karl Aberer, Congestion Control for Distributed Hash Tables, Proceedings of the Fifth IEEE International Symposium on Network Computing and Applications, p.189-195, July 24-26, 2006 [doi>10.1109/NCA.2006.19]
• 16: Boon Thau Loo , Tyson Condie , Joseph M. Hellerstein , Petros Maniatis , Timothy Roscoe , Ion Stoica, Implementing declarative overlays, ACM SIGOPS Operating Systems Review, v.39 n.5, December 2005
• 17: Makoto Matsumoto , Takuji Nishimura, Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator, ACM Transactions on Modeling and Computer Simulation (TOMACS), v.8 n.1, p.3-30, Jan. 1998 [doi>10.1145/272991.272995]
• 18: P. Maymounkov and D. Mazieres. Kademlia: A peer-to-peer information system based on the xor metric, 2002.
• 19: S. Naicken, B. Basu, A. and Livingston, and S. Rodhetbhai. A survey of peer-to-peer network simulators. In Proceedings of The Seventh Annual Postgraduate Symposium, 2006.
• 20: S. Naicken , B. Livingston , A. Basu , S. Rodhetbhai , I. Wakeman , D. Chalmers, The state of peer-to-peer simulators and simulations, ACM SIGCOMM Computer Communication Review, v.37 n.2, April 2007 [doi>10.1145/1232919.1232932]
• 21: M. Quinson. GRAS: A research & development framework for grid and P2P infrastructures. In International Conference on Parallel and Distributed Computing and Systems, 2006.
• 22: H. J. Song , X. Liu , D. Jakobsen , R. Bhagwan , X. Zhang , K. Taura , A. Chien, The MicroGrid: A scientific tool for modeling Computational Grids, Scientific Programming, v.8 n.3, p.127-141, August 2000
• 23: Ion Stoica , Robert Morris , David Karger , M. Frans Kaashoek , Hari Balakrishnan, Chord: A scalable peer-to-peer lookup service for internet applications, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.149-160, August 2001, San Diego, California, United States
• 24: Peter Urban , Andre Schiper , Xavier Defago, Neko: A Single Environment to Simulate and Prototype Distributed Algorithms, Proceedings of the The 15th International Conference on Information Networking, p.503, January 31-February 02, 2001
• 25: Amin Vahdat , Ken Yocum , Kevin Walsh , Priya Mahadevan , Dejan Kostić , Jeff Chase , David Becker, Scalability and accuracy in a large-scale network emulator, ACM SIGOPS Operating Systems Review, v.36 n.SI, Winter 2002 [doi>10.1145/844128.844154]
• 26: B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar. An integrated experimental environment for distributed systems and networks. pages 255--270. Boston, MA, Dec. 2002.
• 27: Weishuai Yang , Nael Abu-Ghazaleh, GPS: A General Peer-to-Peer Simulator and its Use for Modeling BitTorrent, Proceedings of the 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, p.425-434, September 27-29, 2005 [doi>10.1109/MASCOT.2005.31]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.7 Simulation Support Systems

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

Keywords:
distributed systems, framework, peer-to-peer systems, prototyping, simulator, toolkit