DARAW: a new write buffer to improve parallel I/O energy-efficiency

ABSTRACT

In the past decades, parallel I/O systems have been used widely to support scientific and commercial applications. New data centers today employ huge quantities of I/O systems, which consume a large amount of energy. Most large-scale I/O systems have an array of hard disks working in parallel to meet performance requirements. Traditional energy conservation techniques attempt to place disks into low-power states when possible. In this paper we propose a novel strategy, which aims to significantly conserve energy while reducing average I/O response times. This goal is achieved by making use of buffer disks in parallel I/O systems to accumulate small writes to form a log, which can be transferred to data disks in a batch way. We develop an algorithm - dynamic request allocation algorithm for writes or DARAW - to energy efficiently allocate and schedule write requests in a parallel I/O system. DARAW is able to improve parallel I/O energy efficiency by the virtue of leveraging buffer disks to serve a majority of incoming write requests, thereby keeping data disks in low-power state for longer period times. Buffered requests are then written to data disks at a predetermined time. Experimental results show that DARAW can significantly reduce energy dissipation in parallel I/O systems without adverse impacts on I/O performance.

REFERENCES

• 1: Enrique V. Carrera , Eduardo Pinheiro , Ricardo Bianchini, Conserving disk energy in network servers, Proceedings of the 17th annual international conference on Supercomputing, June 23-26, 2003, San Francisco, CA, USA [doi>10.1145/782814.782829]
• 2: Ravi Wijayaratne , A. L. Narasimha Reddy, Integrated QOS Management for Disk I/O, Proceedings of the IEEE International Conference on Multimedia Computing and Systems, p.9487, June 07-11, 1999 [doi>10.1109/MMCS.1999.779250]
• 3: P. Goyal, D. Jadav, D. S. Modha, and R. Tewari, "CacheCOW: Qos for Storage System Caches," Proc. Int'l Workshop QoS, 2003
• 4: J. C. Chuang and M. A. Sirbu, "Distributed Network Storage Service with Quality-of Service Guarantees," Proc. Conf. Internet Society INET'99, June 1999.
• 5: Z. Zong, M. Briggs, N. O'Connor, and X. Qin, "An Energy-Efficient Framework for Large-Scale Parallel Storage Systems," Proc. Int'l Conf. Parallel and Distributed Processing Symp., Mar. 2007.
• 6: Xiao Qin, Performance comparisons of load balancing algorithms for I/O-intensive workloads on clusters, Journal of Network and Computer Applications, v.31 n.1, p.32-46, January, 2008 [doi>10.1016/j.jnca.2006.07.001]
• 7: S. Lakshmanan, M. Ahamad, and H. Venkateswaran, "Responsive Security for Stored Data," IEEE Trans. Parallel and Distr. Sys., vol. 14, no. 9, Sep. 2003.
• 8: M. I. Lutwyche and M. Despont, et al, "Highly Parallel Data Storage System Based on Scanning Probe Arrays," American Institute of Physics, 2000.
• 9: Brian C. Forney , Andrea C. Arpaci-Dusseau , Remzi H. Arpaci-Dusseau, Storage-Aware Caching: Revisiting Caching for Heterogeneous Storage Systems, Proceedings of the Conference on File and Storage Technologies, p.61-74, January 28-30, 2002
• 10: H. Zhang, W. Wu, X. Dong, D. Qian and L. Dai, "A Study on Data Placement of Extensible Parallel Storage System," Proc. Int'l Conf. Computer and Information Science, 2007.
• 11: Willy Sisilo , Fangguo Zhang , Yi Mu, Privacy-Enhanced Internet Storage, Proceedings of the 19th International Conference on Advanced Information Networking and Applications, p.603-608, March 25-30, 2005 [doi>10.1109/AINA.2005.284]
• 12: Chris Ruemmler , John Wilkes, An introduction to disk drive modeling, Computer, v.27 n.3, p.17-28, March 1994 [doi>10.1109/2.268881]
• 13: Rakesh Barve , Mahesh Kallahalla , Peter J. Varman , Jeffrey Scott Vitter, Competitive parallel disk prefetching and buffer management, Proceedings of the fifth workshop on I/O in parallel and distributed systems, p.47-56, November 17-17, 1997, San Jose, California, United States [doi>10.1145/266220.266225]
• 14: Mahesh Kallahalla , Peter J. Varman, Improving Parallel-Disk Buffer Management using Randomized Writeback, Proceedings of the 1998 International Conference on Parallel Processing, p.270-277, August 10-14, 1998
• 15: Binny S. Gill , Dharmendra S. Modha, WOW: wise ordering for writes - combining spatial and temporal locality in non-volatile caches, Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies, p.10-10, December 13-16, 2005, San Francisco, CA
• 16: Dean Hildebrand , Lee Ward , Peter Honeyman, Large files, small writes, and pNFS, Proceedings of the 20th annual international conference on Supercomputing, June 28-July 01, 2006, Cairns, Queensland, Australia [doi>10.1145/1183401.1183419]
• 17: Sung Hoon Baek , Kyu Ho Park, Matrix-Stripe-Cache-Based Contiguity Transform for Fragmented Writes in RAID-5, IEEE Transactions on Computers, v.56 n.8, p.1040-1054, August 2007 [doi>10.1109/TC.2007.70758]
• 18: R. Rangaswami, Z. Dimitrijevic, E. Chang and K. Schauser, "MEMS-based Disk Buffer for Streaming Media Servers," Proc. Int'l Conf. Data Eng., 2003.
• 19: A. L. N. Reddy , Jim Wyllie , K. B. R. Wijayaratne, Disk scheduling in a multimedia I/O system, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.1 n.1, p.37-59, February 2005 [doi>10.1145/1047936.1047941]
• 20: S. W. Son , M. Kandemir , A. Choudhary, Software-Directed Disk Power Management for Scientific Applications, Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers, p.4.2, April 04-08, 2005 [doi>10.1109/IPDPS.2005.404]
• 21: Mais Nijim , Xiao Qin , Tao Xie, Modeling and improving security of a local disk system for write-intensive workloads, ACM Transactions on Storage (TOS), v.2 n.4, p.400-423, November 2006 [doi>10.1145/1210596.1210598]