Workload decomposition for QoS in hosted storage services

ABSTRACT

The growing popularity of hosted storage services and shared storage infrastructure in data centers is driving the recent interest in performance isolation and QoS in storage systems. Due to the bursty nature of storage workloads, meeting the traditional response-time Service Level Agreements requires significant over provisioning of the server capacity. We present a graduated, distribution-based QoS specification for storage servers that provides cost benefits over traditional QoS models. Our method RTT partitions the workload to minimize the capacity required to meet response time requirements of any specified fraction of the requests.

REFERENCES

• 1: Amazon simple storage service (amazon s3). http://www.amazon.com/gp/browse.html?node=16427261.
• 2: T. Dumitras and P. Narasimhan. Fault-tolerant middleware and the magical 1%. In Proc. 6th International Middleware Conference, 2005.
• 3: Tong Gao , Hui Ma , I-Ling Yen , Farokh Bastani , Wei-Tek Tsai, Toward QoS Analysis of Adaptive Service-Oriented Architecture, Proceedings of the IEEE International Workshop, p.227-236, October 20-21, 2005 [doi>10.1109/SOSE.2005.37]
• 4: Pawan Goyal , Harrick M. Vin , Haichen Cheng, Start-time fair queueing: a scheduling algorithm for integrated services packet switching networks, IEEE/ACM Transactions on Networking (TON), v.5 n.5, p.690-704, Oct. 1997 [doi>10.1109/90.649569]
• 5: Ajay Gulati , Arif Merchant , Peter J. Varman, pClock: an arrival curve based approach for QoS guarantees in shared storage systems, Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, June 12-16, 2007, San Diego, California, USA
• 6: Radu Jurca , Boi Faltings , Walter Binder, Reliable QoS monitoring based on client feedback, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242708]
• 7: Christopher R. Lumb , Arif Merchant , Guillermo A. Alvarez, Façade: Virtual Storage Devices with Performance Guarantees, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
• 8: Mac mobile me. http://www.apple.com/mobileme/features/idisk.html.
• 9: Public software (storage systems department at hp labs), 2007. http://tesla.hpl.hp.com/publicsoftware/.
• 10: Scheduling for quality of service guarantees via service curves, Proceedings of the 4th International Conference on Computer Communications and Networks, p.512, September 20-23, 1995
• 11: A. Sheth and et al. Qos for service-oriented middleware. In Proc. Conf. Systemics, Cybernetics and Informatics, July 2002.
• 12: Storage performance council (umass trace repository), 2007. http://traces.cs.umass.edu/index.php/Storage.
• 13: Bhuvan Urgaonkar , Prashant Shenoy , Timothy Roscoe, Resource overbooking and application profiling in shared hosting platforms, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060312]
• 14: Windows live sky drive. http://skydrive.live.com/.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.2 Storage Management
          Subjects: Secondary storage

General Terms:
Algorithms, Management, Performance

Keywords:
QoS, capacity provisioning, response time, storage service, workload decomposition