High accuracy failure injection in parallel and distributed systems using virtualization

ABSTRACT

Emulation sits between simulation and experimentation to complete the set of tools available for software designers to evaluate their software and predict behavior under conditions usually unachievable in a laboratory experiment. It consists in running the real application in an emulated environment. Thus, it behaves more realistically than a simulation, but under a controlled and reproducible environment, more suitable for behavior analysis.

In this paper, we propose an emulation platform for parallel and distributed systems where both the machines and the network are virtualized at a low level. We demonstrate that the use of virtual machines allows us to test highly accurate failure injection by "destroying" virtual machines. Failure accuracy is a criteria that demonstrates how realistic a fault is. The platform accuracy is evaluated using Pastry, a fault-tolerant distributed hash-table.

REFERENCES

• 1: Paul Barham , Boris Dragovic , Keir Fraser , Steven Hand , Tim Harris , Alex Ho , Rolf Neugebauer , Ian Pratt , Andrew Warfield, Xen and the art of virtualization, ACM SIGOPS Operating Systems Review, v.37 n.5, December 2003
• 2: Erik Buchmann and Klemens Böhm. How to run experiments with large peer-to-peer data structures. Parallel and Distributed Processing Symposium, International, 1:27b, 2004.
• 3: F. Cappello , E. Caron , M. Dayde , F. Desprez , Y. Jegou , P. Primet , E. Jeannot , S. Lanteri , J. Leduc , N. Melab , G. Mornet , R. Namyst , B. Quetier , O. Richard, Grid'5000: A Large Scale and Highly Reconfigurable Grid Experimental Testbed, Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, p.99-106, November 13-14, 2005 [doi>10.1109/GRID.2005.1542730]
• 4: Miguel Castro, Peter Druschel, Ayalvadi Ganesh, Antony Rowstron, and Dan S. Wallach. Security for structured peer-to-peer overlay networks. In 5th Symposium on Operating Systems Design and Implementaion (OSDI'02), December 2002.
• 5: Miguel Castro, Peter Druschel, Y. Charlie Hu, and Antony I.T. Rowstron. Topology-aware routing in structured peer-to-peer overlay networks. In André Schiper, Alexander A. Shvartsman, Hakim Weatherspoon, and Ben Y. Zhao, editors, Future Directions in Distributed Computing, volume 2584 of Lecture Notes in Computer Science, pages 103--107. Springer, 2003.
• 6: Brent Chun , David Culler , Timothy Roscoe , Andy Bavier , Larry Peterson , Mike Wawrzoniak , Mic Bowman, PlanetLab: an overlay testbed for broad-coverage services, ACM SIGCOMM Computer Communication Review, v.33 n.3, July 2003 [doi>10.1145/956993.956995]
• 7: Andreas Haeberlen, Alan Mislove, Ansley Post, and Peter Druschel. Fallacies in evaluating decentralized systems. In Proceedings of IPTPS, 2006.
• 8: R. Housley , S. Hollenbeck, EtherIP: Tunneling Ethernet Frames in IP Datagrams, RFC Editor, 2002
• 9: Ralph Niederberger. DEISA: Motivations, strategies, technologies. In Proc. of the Int. Supercomputer Conference (ISC'04), 2004.
• 10: Lucas Nussbaum , Olivier Richard, Lightweight emulation to study peer-to-peer systems, Concurrency and Computation: Practice & Experience, v.20 n.6, p.735-749, April 2008 [doi>10.1002/cpe.v20:6]
• 11: Benjamin Quétier, Vincent Neri, and Franck Cappello. Scalability Comparison of Four Host Virtualization Tools. Journal of Grid Computing, 5:83--98, 2006.
• 12: Luigi Rizzo, Dummynet: a simple approach to the evaluation of network protocols, ACM SIGCOMM Computer Communication Review, v.27 n.1, p.31-41, Jan. 1997 [doi>10.1145/251007.251012]
• 13: Antony I. T. Rowstron , Peter Druschel, Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems, Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg, p.329-350, November 12-16, 2001
• 14: Quinn O. Snell, Armin R. Mikler, and John L. Gustafson. Netpipe: A network protocol independent performace evaluator. In Proceedings of the IASTED International Conference on Intelligent Information Management and Systems, 1996.
• 15: Amin Vahdat , Ken Yocum , Kevin Walsh , Priya Mahadevan , Dejan Kostić , Jeff Chase , David Becker, Scalability and accuracy in a large-scale network emulator, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060315]
• 16: Brian White , Jay Lepreau , Leigh Stoller , Robert Ricci , Shashi Guruprasad , Mac Newbold , Mike Hibler , Chad Barb , Abhijeet Joglekar, An integrated experimental environment for distributed systems and networks, ACM SIGOPS Operating Systems Review, v.36 n.SI, Winter 2002 [doi>10.1145/844128.844152]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Distributed applications

Additional Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Fault tolerance

General Terms:
Experimentation, Measurement, Reliability

Keywords:
emulation, fault injection, large-scale applications, virtualization