Autonomic distributed data management with update accesses

ABSTRACT

This paper discusses and motivates autonomic replication in a data management layer for network management systems. The data management layer simultaneously supports multiple update protocols for single logical data-item, allowing different levels of performance and consistency to be offered to different groups of users. How replication is applied is key to maximising system performance. The challenge lies in the fact that the optimal scheme depends on dynamic characteristics of the workload. Autonomically reconfiguring replication in response to the changing workload using feedback control.

The goal of the paper is to demonstrate the applicability of feedback control to maintaining a given performance metric in a changing environment. The presented work is intended as an investigation and proof of concept into the feasibility of autonomically managing a facet of replication: specifically, the number of replicas. Replica placement and optimality of management decisions is currently considered out of scope and part of future work.

REFERENCES

• 1: Paul Barford , Mark Crovella, Generating representative Web workloads for network and server performance evaluation, Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, p.151-160, June 22-26, 1998, Madison, Wisconsin, United States
• 2: M. Burgess and G. Canright. Scalability of Peer Configuration Management in Partially Reliable and ad hoc Networks. In Proceedings of the 7^th IFIP/IEEE Conference on Network Management, volume 246, pages 293--305, Colorado Springs, USA, March 2003. IFIP/IEEE, Kluwer.
• 3: Ann Chervenak , Ewa Deelman , Ian Foster , Leanne Guy , Wolfgang Hoschek , Adriana Iamnitchi , Carl Kesselman , Peter Kunszt , Matei Ripeanu , Bob Schwartzkopf , Heinz Stockinger , Kurt Stockinger , Brian Tierney, Giggle: a framework for constructing scalable replica location services, Proceedings of the 2002 ACM/IEEE conference on Supercomputing, p.1-17, November 16, 2002, Baltimore, Maryland
• 4: Ann L. Chervenak , Naveen Palavalli , Shishir Bharathi , Carl Kesselman , Robert Schwartzkopf, Performance and Scalability of a Replica Location Service, Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing, p.182-191, June 04-06, 2004 [doi>10.1109/HPDC.2004.27]
• 5: Frank Dabek , M. Frans Kaashoek , David Karger , Robert Morris , Ion Stoica, Wide-area cooperative storage with CFS, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 6: A. J. Demers, K. Petersen, M. J. Spreitzer, D. B. Terry, M. M. Theimer, and B. B. Welch. The bayou architecture: Support for data sharing among mobile users. In Proceedings IEEE Workshop on Mobile Computing Systems & Applications, pages 2--7, Santa Cruz, California, August-September 1994.
• 7: C. Doherty and N. Hurley. Policy-based autonomic replication for next generation network management systems. In Proceedings 1st Annual Workshop on Distributed Autonomous Network Management Systems (DANMS), Dublin, Ireland, June 2006.
• 8: C. J. Doherty and N. J. Hurley. Hierarchical policy-based replication. In Proc. 26th IEEE International Performance, Computing and Communication Systems (IPCCC'07), New Orleans, Louisiana, USA, April 2007.
• 9: Peter Druschel , Antony Rowstron, PAST: A Large-Scale, Persistent Peer-to-Peer Storage Utility, Proceedings of the Eighth Workshop on Hot Topics in Operating Systems, p.75, May 20-22, 2001
• 10: Venkata Duvvuri , Prashant Shenoy , Renu Tewari, Adaptive Leases: A Strong Consistency Mechanism for the World Wide Web, IEEE Transactions on Knowledge and Data Engineering, v.15 n.5, p.1266-1276, September 2003 [doi>10.1109/TKDE.2003.1232277]
• 11: Joseph L. Hellerstein , Yixin Diao , Sujay Parekh , Dawn M. Tilbury, Feedback Control of Computing Systems, John Wiley & Sons, 2004
• 12: R. Jain. The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. John Wiley and Sons, New York, NY, USA, 1 edition, April 1991.
• 13: Leonard Kleinrock, Theory, Volume 1, Queueing Systems, Wiley-Interscience, 1975
• 14: Craig Labovitz , G. Robert Malan , Farnam Jahanian, Internet routing instability, Proceedings of the ACM SIGCOMM '97 conference on Applications, technologies, architectures, and protocols for computer communication, p.115-126, September 14-18, 1997, Cannes, France
• 15: Jean-Philippe Martin-Flatin , Simon Znaty , Jean-Pierre Hubaux, A Survey of Distributed Enterprise Network andSystems Management Paradigms, Journal of Network and Systems Management, v.7 n.1, p.9-26, March 01, 1999 [doi>10.1023/A:1018761615354]
• 16: Athicha Muthitacharoen , Robert Morris , Thomer M. Gil , Benjie Chen, Ivy: a read/write peer-to-peer file system, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060293]
• 17: B. Noble, B. Fleis, and M. Kim. A Case for Fluid Replication. In Netstore '99: Network Storage Symposium, Internet2, December 1999.
• 18: Venugopalan Ramasubramanian , Emin Gün Sirer, Beehive: O(1)lookup performance for power-law query distributions in peer-to-peer overlays, Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation, p.8-8, March 29-31, 2004, San Francisco, California
• 19: Haifeng Yu, TACT: tunable availability and consistency tradeoffs for replicated Internet services, ACM SIGOPS Operating Systems Review, v.34 n.2, p.33, April, 2000 [doi>10.1145/346152.346227]
• 20: M. Zach, D. Parker, L. Fallon, C. Unfried, M. P. de Leon, and J. N. Sven van der Meer, Nektarios Georgalas. Celtic initiative project madeira: A p2p approach to network management. In Eurescom Summit 2005: Ubiquitous Services and Applications, pages 27--29, Heidelberg, German, April 2005.