Staged deployment in mirage, an integrated software upgrade testing and distribution system

ABSTRACT

Despite major advances in the engineering of maintainable and robust software over the years, upgrading software remains a primitive and error-prone activity. In this paper, we argue that several problems with upgrading software are caused by a poor integration between upgrade deployment, user-machine testing, and problem reporting. To support this argument, we present a characterization of softwareupgrades resulting from a survey we conducted of 50 system administrators. Motivated by the survey results, we present Mirage, a distributed framework for integrating upgrade deployment, user-machine testing, and problem reporting into the overall upgrade development process. Our evaluation focuses on the most novel aspect of Mirage, namely its staged upgrade deployment based on the clustering of usermachines according to their environments and configurations. Our results suggest that Mirage's staged deployment is effective for real upgrade problems.

REFERENCES

• 1: Mukesh Agrawal , Srinivasan Seshan, Development tools for distributed applications, Proceedings of the 9th conference on Hot Topics in Operating Systems, p.9-9, May 18-21, 2003, Lihue, Hawaii
• 2: Sameer Ajmani , Barbara Liskov , Liuba Shrira, Scheduling and simulation: how to upgrade distributed systems, Proceedings of the 9th conference on Hot Topics in Operating Systems, p.8-8, May 18-21, 2003, Lihue, Hawaii
• 3: ASF Bugzilla Bug 10073 upgrade from 1.3.24 to 1.3.26 breaks include directive. http://issues.apache.org/bugzilla/show_bug.cgi?id=10073.
• 4: Timing the Application of Security Patches for Optimal Uptime, Proceedings of the 16th USENIX conference on System administration, November 03-08, 2002, Philadelphia, PA
• 5: Premysl Brada, Metadata Support for Safe Component Upgrades, Proceedings of the 26th International Computer Software and Applications Conference on Prolonging Software Life: Development and Redevelopment, p.1017-1021, August 26-19, 2002
• 6: David L. Chaum, Untraceable electronic mail, return addresses, and digital pseudonyms, Communications of the ACM, v.24 n.2, p.84-90, Feb. 1981 [doi>10.1145/358549.358563]
• 7: Jonathan Cook , Alessandro Orso, MonDe: safe updating through monitored deployment of new component versions, Proceedings of the 6th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering, September 05-06, 2005, Lisbon, Portugal
• 8: Landon P. Cox , Christopher D. Murray , Brian D. Noble, Pastiche: making backup cheap and easy, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060316]
• 9: John Dunagan , Brad Daniels , Aaron Johnson , Chad Verbowski, Towards a Self-Managing Software Patching Process Using Black-Box Persistent-State Manifests, Proceedings of the First International Conference on Autonomic Computing, p.106-113, May 17-18, 2004
• 10: George W. Dunlap , Samuel T. King , Sukru Cinar , Murtaza A. Basrai , Peter M. Chen, ReVirt: enabling intrusion analysis through virtual-machine logging and replay, ACM SIGOPS Operating Systems Review, v.36 n.SI, Winter 2002 [doi>10.1145/844128.844148]
• 11: Fixing A Troubled Firefox 2.0 Upgrade. http://softwaregadgets.gridspace.net/2006/10/30/fixing-a-troubled-firefox-20-upgrade/.
• 12: Firefox crashes after 1.5.0.9 update. http://www.ubuntuforums.org/showthread.php?t=331274.
• 13: Christos Gkantsidis , Thomas Karagiannis , Milan VojnoviC, Planet scale software updates, Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications, September 11-15, 2006, Pisa, Italy
• 14: Allan Heydon , Roy Levin , Timothy Mann , Yuan Yu, Software Configuration Management System Using Vesta (Monographs in Computer Science), Telos Pr, 2004
• 15: L. J. Heyer, S. Kruglyak, and S. Yooseph. Exploring Expression Data: Identification and Analysis of Coexpressed Genes. In Genome Research, pages 1106--1115, 1999.
• 16: Flavio Junqueira , Ranjita Bhagwan , Alejandro Hevia , Keith Marzullo , Geoffrey M. Voelker, Surviving internet catastrophes, Proceedings of the annual conference on USENIX Annual Technical Conference, p.4-4, April 10-15, 2005, Anaheim, CA
• 17: Kaseya Patch Management. http://www.kaseya.com/products/patch-management.php.
• 18: Samuel T. King , Peter M. Chen, Backtracking intrusions, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 19: Behavior Capture and Test: Automated Analysis of Component Integration, Proceedings of the 10th IEEE International Conference on Engineering of Complex Computer Systems, p.292-301, June 16-20, 2005 [doi>10.1109/ICECCS.2005.25]
• 20: Stephen McCamant , Michael D. Ernst, Predicting problems caused by component upgrades, Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering, September 01-05, 2003, Helsinki, Finland
• 21: Microsoft Online Crash Analysis. http://oca.microsoft.com/en/Welcome.aspx.
• 22: Kiran-Kumar Muniswamy-Reddy , David A. Holland , Uri Braun , Margo Seltzer, Provenance-aware storage systems, Proceedings of the annual conference on USENIX '06 Annual Technical Conference, p.4-4, May 30-June 03, 2006, Boston, MA
• 23: Athicha Muthitacharoen , Benjie Chen , David Mazières, A low-bandwidth network file system, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 24: Report of PHP problem after MySQL upgrade. http://www.linuxquestions.org/questions/showthread.php?t=425535.
• 25: Kiran Nagaraja , Fábio Oliveira , Ricardo Bianchini , Richard P. Martin , Thu D. Nguyen, Understanding and dealing with operator mistakes in internet services, Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, p.5-5, December 06-08, 2004, San Francisco, CA
• 26: Fábio Oliveira , Kiran Nagaraja , Rekha Bachwani , Ricardo Bianchini , Richard P. Martin , Thu D. Nguyen, Understanding and validating database system administration, Proceedings of the annual conference on USENIX '06 Annual Technical Conference, p.19-19, May 30-June 03, 2006, Boston, MA
• 27: PatchLink. http://www.patchlink.com/.
• 28: PHP5 Migration guide. http://ch2.php.net/manual/en/migration5.incompatible.php.
• 29: Yasushi Saito, Jockey: a user-space library for record-replay debugging, Proceedings of the sixth international symposium on Automated analysis-driven debugging, p.69-76, September 19-21, 2005, Monterey, California, USA [doi>10.1145/1085130.1085139]
• 30: Secunia "Security Watchdog" Blog. http://secunia.com/blog/11.
• 31: Ladislav Sobr , Petr Tuma, SOFAnet: Middleware for Software Distribution over Internet, Proceedings of the The 2005 Symposium on Applications and the Internet, p.48-53, January 31-February 04, 2005 [doi>10.1109/SAINT.2005.60]
• 32: Sudarshan M. Srinivasan , Srikanth Kandula , Christopher R. Andrews , Yuanyuan Zhou, Flashback: a lightweight extension for rollback and deterministic replay for software debugging, Proceedings of the annual conference on USENIX Annual Technical Conference, p.3-3, June 27-July 02, 2004, Boston, MA
• 33: Software upgrade survey. http://mirage.epfl.ch/webdav/site/mirage/users/128770/public/survey.pdf.
• 34: User-Mode Linux. http://user-mode-linux.sourceforge.net/.
• 35: Tao Xie , David Notkin, Checking Inside the Black Box: Regression Testing Based on Value Spectra Differences, Proceedings of the 20th IEEE International Conference on Software Maintenance, p.28-37, September 11-14, 2004

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.5 Reliability

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

  D. Software
  D.4 OPERATING SYSTEMS
      D.4.9 Systems Programs and Utilities

General Terms:
Management, Reliability

Keywords:
clustering of machines, staged software upgrade deployment, upgrade testing