Lessons and challenges in automating data dependability

ABSTRACT

Designing and managing dependable systems is a difficult endeavor. In this paper, we describe challenges in this vast problem space, including provisioning and allocating shared resources, adaptively managing system dependability, expressing dependability goals, interactively exploring the design space, and designing end-to-end service dependability. We outline the optimization-based approach we've used to tackle the data dependability portion of this space, and describe how we can extend that approach to address an even larger dependability scope.

REFERENCES

• 1: Eric Anderson , Michael Hobbs , Kimberly Keeton , Susan Spence , Mustafa Uysal , Alistair C. Veitch, Hippodrome: Running Circles Around Storage Administration, Proceedings of the Conference on File and Storage Technologies, p.175-188, January 28-30, 2002
• 2: J. Bent, D. Thain, A. Arpaci-Dusseau, R. Arpaci-Dusseau, and M. Livny. Explicit control in the batch-aware distributed file system. In Proc. 1st Symp. on Networked Systems Design and Implementation (NSDI), pages 365--378, San Francisco, CA, USA, March 2004.
• 3: R. Bhagwan, K. Tati, Y. Cheng, S. Savage, and G. Voelker. Total Recall: System support for automated availability management. In Proc. NSDI, pages 337--350, San Francisco, CA, USA, March 2004.
• 4: C. Brooks, M. Bedernjak, I. Juran, and J. Merryman. Disaster recovery strategies with Tivoli storage management. IBM International Technical Support Organization, version 2 edition, November 2002.
• 5: Hewlett-Packard Company. Free business continuity readiness assessment. http://www.hp.com/large/promo/bcsurvey/index.html, Last accessed September 2004.
• 6: Hewlett-Packard. Utility data center. http://www.hp.com/large/infrastructure/utilitydata/overview/, Last accessed September 2004.
• 7: IBM. On demand business. http://www.ibm.com/ondemand, Last accessed September 2004.
• 8: G. (John) Janakiraman , Jose Renato Santos , Yoshio Turner, Automated System Design for Availability, Proceedings of the 2004 International Conference on Dependable Systems and Networks (DSN'04), p.411, June 28-July 01, 2004
• 9: D. Kandlur and J. Killela eds. Utility computing. IBM Systems Journal special issue, 43(1), 2004.
• 10: Kimberly Keeton , Arif Merchant, A Framework for Evaluating Storage System Dependability, Proceedings of the 2004 International Conference on Dependable Systems and Networks (DSN'04), p.877, June 28-July 01, 2004
• 11: Kimberley Keeton , Cipriano Santos , Dirk Beyer , Jeffrey Chase , John Wilkes, Designing for Disasters, Proceedings of the 3rd USENIX Conference on File and Storage Technologies, March 31-31, 2004, San Francisco, CA
• 12: Kimberly Keeton , John Wilkes, Automating data dependability, Proceedings of the 10th workshop on ACM SIGOPS European workshop: beyond the PC, July 01-01, 2002, Saint-Emilion, France [doi>10.1145/1133373.1133391]
• 13: C. Lee. On quality of service management. Technical report CMU-CS-99-165, Carnegie Mellon University, August 1999.
• 14: Sun Microsystems. N1 grid --- introducing just in time computing. http://wwws.sun.com/software/solutions/n1/wp-n1.pdf.
• 15: H. Vladimirou and S. Zenios. "Stochastic Programming and Robust Optimization" in Advances in Sensitivity Analysis and Parametric Programming, edited by T. Gal and H. Greenberg, chapter 12. Kluwer Academic Press, 1997.
• 16: John Wilkes , Jeffrey Mogul , Jaap Suermondt, Utilification, Proceedings of the 11th workshop on ACM SIGOPS European workshop: beyond the PC, September 19-22, 2004, Leuven, Belgium [doi>10.1145/1133572.1133603]
• 17: L. Wolsey. Integer Programming. John Wiley and Sons, Inc., 1998.