Satellitelab: adding heterogeneity to planetary-scale network testbeds

ABSTRACT

Planetary-scale network testbeds like PlanetLab and RON have become indispensable for evaluating prototypes of distributed systems under realistic Internet conditions. However, current testbeds lack the heterogeneity that characterizes the commercial Internet. For example, most testbed nodes are connected to well-provisioned research networks, whereas most Internet nodes are in edge networks.

In this paper, we present the design, implementation, and evaluation of SatelliteLab, a testbed that includes nodes from a diverse set of Internet edge networks. SatelliteLab has a two-tier architecture, in which well-provisioned nodes called planets form the core, and lightweight nodes called satellites connect to the planets from the periphery. The application code of an experiment runs on the planets, whereas the satellites only forward network traffic. Thus, the traffic is subjected to the network conditions of the satellites, which greatly improves the testbed's network heterogeneity. The separation of code execution and traffic forwarding enables satellites to remain lightweight, which lowers the barrier to entry for Internet edge nodes.

Our prototype of SatelliteLab uses PlanetLab nodes as planets and a set of 32 volunteered satellites with diverse network characteristics. These satellites consist of desktops, laptops, and handhelds connected to the Internet via cable, DSL, ISDN, Wi-Fi, Bluetooth, and cellular links. We evaluate SatelliteLab's design, and we demonstrate the benefits of evaluating applications on SatelliteLab.

REFERENCES

• 1: David Andersen , Hari Balakrishnan , Frans Kaashoek , Robert Morris, Resilient overlay networks, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 2: David P. Anderson, BOINC: A System for Public-Resource Computing and Storage, Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, p.4-10, November 08-08, 2004 [doi>10.1109/GRID.2004.14]
• 3: David P. Anderson , Jeff Cobb , Eric Korpela , Matt Lebofsky , Dan Werthimer, SETI@home: an experiment in public-resource computing, Communications of the ACM, v.45 n.11, p.56-61, November 2002 [doi>10.1145/581571.581573]
• 4: Hari Balakrishnan , Venkata N. Padmanabhan , Srinivasan Seshan , Randy H. Katz, A comparison of mechanisms for improving TCP performance over wireless links, IEEE/ACM Transactions on Networking (TON), v.5 n.6, p.756-769, Dec. 1997 [doi>10.1109/90.650137]
• 5: S. Banerjee, T. G. Griffin, and M. Pias. The Interdomain Connectivity of PlanetLab Nodes. In Proc. of the Passive and Active Measurement Conference, Antibes Juan-les-Pins, France, Apr 2004.
• 6: Andy Bavier , Nick Feamster , Mark Huang , Larry Peterson , Jennifer Rexford, In VINI veritas: realistic and controlled network experimentation, Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications, September 11-15, 2006, Pisa, Italy
• 7: Miguel Castro , Peter Druschel , Anne-Marie Kermarrec , Animesh Nandi , Antony Rowstron , Atul Singh, SplitStream: high-bandwidth multicast in cooperative environments, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 8: CoTop Monitoring Tool. http://codeen.cs.princeton.edu/cotop/.
• 9: Marcel Dischinger , Andreas Haeberlen , Krishna P. Gummadi , Stefan Saroiu, Characterizing residential broadband networks, Proceedings of the 7th ACM SIGCOMM conference on Internet measurement, October 24-26, 2007, San Diego, California, USA [doi>10.1145/1298306.1298313]
• 10: John R. Douceur , Thomas Moscibroda, Lottery trees: motivational deployment of networked systems, Proceedings of the 2007 conference on Applications, technologies, architectures, and protocols for computer communications, August 27-31, 2007, Kyoto, Japan
• 11: FIRE: Future Internet Research and Experimentation. http://cordis.europa.eu/fp7/ict/fire/.
• 12: Michael J. Freedman , Eric Freudenthal , David Mazières, Democratizing content publication with coral, Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation, p.18-18, March 29-31, 2004, San Francisco, California
• 13: The FreePastry web site. http://freepastry.org/.
• 14: GENI: Global Environment for Network Innovations. http://www.geni.net.
• 15: Krishna P. Gummadi , Harsha V. Madhyastha , Steven D. Gribble , Henry M. Levy , David Wetherall, Improving the reliability of internet paths with one-hop source routing, Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, p.13-13, December 06-08, 2004, San Francisco, CA
• 16: Yang-hua Chu , Aditya Ganjam , T. S. Eugene Ng , Sanjay G. Rao , Kunwadee Sripanidkulchai , Jibin Zhan , Hui Zhang, Early experience with an internet broadcast system based on overlay multicast, Proceedings of the annual conference on USENIX Annual Technical Conference, p.12-12, June 27-July 02, 2004, Boston, MA
• 17: J. Ledlie, P. Gardner, and M. Seltzer. Network Coordinates in the Wild. In Proc. of NSDI'07, Cambridge, MA, Apr 2007.
• 18: M. Litzkow, M. Livny, and M. Mutka. Condor - A Hunter of Idle Workstations. In Proc. of ICDCS'88, San Jose, CA, Jun 1988.
• 19: Alan Mislove , Ansley Post , Andreas Haeberlen , Peter Druschel, Experiences in building and operating ePOST, a reliable peer-to-peer application, Proceedings of the 1st ACM SIGOPS/EuroSys European Conference on Computer Systems 2006, April 18-21, 2006, Leuven, Belgium
• 20: NETI@home. http://neti.gatech.edu/.
• 21: ns-2 Network Simulator. http://www.isi.edu/nsnam/ns/.
• 22: V. Paxson , A. Adams , M. Mathis, Experiences with NIMI, Proceedings of the 2002 Symposium on Applications and the Internet (SAINT) Workshops, p.108, January 28-February 01, 2002
• 23: PlanetLab. http://www.planet-lab.org/.
• 24: Planetlab hosting requirements. http://www.planet-lab.org/hosting/.
• 25: Himabindu Pucha , Y. Charlie Hu , Z. Morley Mao, On the impact of research network based testbeds on wide-area experiments, Proceedings of the 6th ACM SIGCOMM conference on Internet measurement, October 25-27, 2006, Rio de Janeriro, Brazil [doi>10.1145/1177080.1177097]
• 26: R. Ricci, J. Duerig, P. Sanaga, D. Gebhardt, M. Hibler, K. Atkinson, J. Zhang, S. Kasera, and J. Lepreau. The Flexlab Approach to Realistic Evaluation of Networked Systems. In Proc. of NSDI'07, Cambridge, MA, Apr 2007.
• 27: Antony I. T. Rowstron , Peter Druschel, Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems, Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg, p.329-350, November 12-16, 2001
• 28: Neil Spring , Larry Peterson , Andy Bavier , Vivek Pai, Using PlanetLab for network research: myths, realities, and best practices, ACM SIGOPS Operating Systems Review, v.40 n.1, January 2006 [doi>10.1145/1113361.1113368]
• 29: Neil Spring , David Wetherall , Tom Anderson, Scriptroute: a public internet measurement facility, Proceedings of the 4th conference on USENIX Symposium on Internet Technologies and Systems, p.17-17, March 26-28, 2003, Seattle, WA
• 30: Kunwadee Sripanidkulchai , Aditya Ganjam , Bruce Maggs , Hui Zhang, The feasibility of supporting large-scale live streaming applications with dynamic application end-points, Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications, August 30-September 03, 2004, Portland, Oregon, USA
• 31: Lakshminarayanan Subramanian , Ion Stoica , Hari Balakrishnan , Randy H. Katz, OverQoS: offering Internet QoS using overlays, ACM SIGCOMM Computer Communication Review, v.33 n.1, p.11-16, January 2003 [doi>10.1145/774763.774764]
• 32: The 3rd Generation Partnership Project. http://www.3gpp.org/.
• 33: Universal TUN/TAP driver. http://vtun.sourceforge.net/tun/index.html.
• 34: Amin Vahdat , Ken Yocum , Kevin Walsh , Priya Mahadevan , Dejan Kostić , Jeff Chase , David Becker, Scalability and accuracy in a large-scale network emulator, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060315]
• 35: Limin Wang , Vivek Pai , Larry Peterson, The effectiveness of request redirection on CDN robustness, ACM SIGOPS Operating Systems Review, v.36 n.SI, Winter 2002 [doi>10.1145/844128.844160]
• 36: Limin Wang , Kyoung Soo Park , Ruoming Pang , Vivek Pai , Larry Peterson, Reliability and security in the CoDeeN content distribution network, Proceedings of the annual conference on USENIX Annual Technical Conference, p.14-14, June 27-July 02, 2004, Boston, MA

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Measurement techniques

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Network communications; Network topology
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Modeling techniques

General Terms:
Experimentation, Measurement, Performance

Keywords:
distributed systems, internet, network testbed