Migrating server storage to SSDs: analysis of tradeoffs

ABSTRACT

Recently, flash-based solid-state drives (SSDs) have become standard options for laptop and desktop storage, but their impact on enterprise server storage has not been studied. Provisioning server storage is challenging. It requires optimizing for the performance, capacity, power and reliability needs of the expected workload, all while minimizing financial costs. In this paper we analyze a number of workload traces from servers in both large and small data centers, to decide whether and how SSDs should be used to support each. We analyze both complete replacement of disks by SSDs, as well as use of SSDs as an intermediate tier between disks and DRAM. We describe an automated tool that, given device models and a block-level trace of a workload, determines the least-cost storage configuration that will support the workload's performance, capacity, and fault-tolerance requirements. We found that replacing disks by SSDs is not a costeffective option for any of our workloads, due to the low capacity per dollar of SSDs. Depending on the workload, the capacity per dollar of SSDs needs to increase by a factor of 3-3000 for an SSD-based solution to break even with a diskbased solution. Thus, without a large increase in SSD capacity per dollar, only the smallest volumes, such as system boot volumes, can be cost-effectively migrated to SSDs. The benefit of using SSDs as an intermediate caching tier is also limited: fewer than 10% of our workloads can reduce provisioning costs by using an SSD tier at today's capacity per dollar, and fewer than 20% can do so at any SSD capacity per dollar. Although SSDs are much more energy-efficient than enterprise disks, the energy savings are outweighed by the hardware costs, and comparable energy savings are achievable with low-power SATA disks.

REFERENCES

• 1: Nitin Agrawal , Vijayan Prabhakaran , Ted Wobber , John D. Davis , Mark Manasse , Rina Panigrahy, Design tradeoffs for SSD performance, USENIX 2008 Annual Technical Conference on Annual Technical Conference, p.57-70, June 22-27, 2008, Boston, Massachusetts
• 2: Dave Anderson , Jim Dykes , Erik Riedel, More Than an Interface---SCSI vs. ATA, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
• 3: Eric Anderson , Susan Spence , Ram Swaminathan , Mahesh Kallahalla , Qian Wang, Quickly finding near-optimal storage designs, ACM Transactions on Computer Systems (TOCS), v.23 n.4, p.337-374, November 2005 [doi>10.1145/1113574.1113575]
• 4: Mary Baker , Satoshi Asami , Etienne Deprit , John Ouseterhout , Margo Seltzer, Non-volatile memory for fast, reliable file systems, Proceedings of the fifth international conference on Architectural support for programming languages and operating systems, p.10-22, October 12-15, 1992, Boston, Massachusetts, United States
• 5: Andrew Birrell , Michael Isard , Chuck Thacker , Ted Wobber, A design for high-performance flash disks, ACM SIGOPS Operating Systems Review, v.41 n.2, p.88-93, April 2007 [doi>10.1145/1243418.1243429]
• 6: John S. Bucy, Jiri Schindler, Steven W. Schlosser, and Gregory R. Ganger. The DiskSim simulation environment version 4.0 reference manual. Technical Report CMU-PDL-08-101, Carnegie Mellon University, May 2008.
• 7: Eran Gal , Sivan Toledo, Algorithms and data structures for flash memories, ACM Computing Surveys (CSUR), v.37 n.2, p.138-163, June 2005 [doi>10.1145/1089733.1089735]
• 8: Richard Golding , Peter Bosch , Carl Staelin , Tim Sullivan , John Wilkes, Idleness is not sloth, Proceedings of the USENIX 1995 Technical Conference Proceedings on USENIX 1995 Technical Conference Proceedings, p.17-17, January 16-20, 1995, New Orleans, Louisiana
• 9: Steven R. Hetzler. The storage chasm: Implications for the future of HDD and solid state storage. http://www.idema.org/, December 2008.
• 10: Intel News Release. Intel, STMicroelectronics deliver industry's first phase change memory prototypes. http://www.intel.com/pressroom/archive/releases/20080206corp.htm, February 2008.
• 11: Weihang Jiang , Chongfeng Hu , Yuanyuan Zhou , Arkady Kanevsky, Are disks the dominant contributor for storage failures?: a comprehensive study of storage subsystem failure characteristics, Proceedings of the 6th USENIX Conference on File and Storage Technologies, p.1-15, February 26-29, 2008, San Jose, California
• 12: Taeho Kgil , Trevor Mudge, FlashCache: a NAND flash memory file cache for low power web servers, Proceedings of the 2006 international conference on Compilers, architecture and synthesis for embedded systems, October 22-25, 2006, Seoul, Korea [doi>10.1145/1176760.1176774]
• 13: Ioannis Koltsidas and Stratis Viglas. Flashing up the storage layer. In Proc. International Conference on Very Large Data Bases (VLDB), pages 514--525, Auckland, New Zealand, August 2008.
• 14: Sang-Won Lee , Bongki Moon , Chanik Park , Jae-Myung Kim , Sang-Woo Kim, A case for flash memory ssd in enterprise database applications, Proceedings of the 2008 ACM SIGMOD international conference on Management of data, June 09-12, 2008, Vancouver, Canada [doi>10.1145/1376616.1376723]
• 15: Ethan L. Miller , Scott A. Brandt , Darrell D. E. Long, HeRMES: High-Performance Reliable MRAM-Enabled Storage, Proceedings of the Eighth Workshop on Hot Topics in Operating Systems, p.95, May 20-22, 2001
• 16: Dushyanth Narayanan , Austin Donnelly , Antony Rowstron, Write off-loading: practical power management for enterprise storage, Proceedings of the 6th USENIX Conference on File and Storage Technologies, p.1-15, February 26-29, 2008, San Jose, California
• 17: Dushyanth Narayanan, Austin Donnelly, Eno Thereska, Sameh Elnikety, and Antony Rowstron. Everest: Scaling down peak loads through I/O off-loading. In Proc. Symposium on Operating Systems Design and Implementation (OSDI), pages 15--28, San Diego, CA, December 2008.
• 18: Suman Nath , Aman Kansal, FlashDB: dynamic self-tuning database for NAND flash, Proceedings of the 6th international conference on Information processing in sensor networks, April 25-27, 2007, Cambridge, Massachusetts, USA [doi>10.1145/1236360.1236412]
• 19: Ruston Panabaker. Hybrid hard disk and Ready-Drive technology: Improving performance and power for Windows Vista mobile PCs. http://www.microsoft.com/whdc/winhec/pres06.mspx, May 2006.
• 20: Florentina I. Popovici, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. Robust, portable I/O scheduling with the Disk Mimic. In Proc. USENIX Annual Technical Conference, pages 297--310, San Antonio, TX, June 2003.
• 21: Vijayan Prabhakaran, Thomas L. Rodeheffer, and Lidong Zhou. Transactional flash. In Proc. Symposium on Operating Systems Design and Implementation (OSDI), pages 147--160, San Diego, CA, December 2008.
• 22: Mendel Rosenblum , John K. Ousterhout, The design and implementation of a log-structured file system, Proceedings of the thirteenth ACM symposium on Operating systems principles, p.1-15, October 13-16, 1991, Pacific Grove, California, United States
• 23: Samsung. MH80 SATA product data sheet, June 2006.
• 24: Bianca Schroeder , Garth A. Gibson, Disk failures in the real world: what does an MTTF of 1,000,000 hours mean to you?, Proceedings of the 5th USENIX conference on File and Storage Technologies, p.1-es, February 13-16, 2007, San Jose, CA
• 25: SNIA. IOTTA repository. http://iotta.snia.org/, January 2009.
• 26: John D. Strunk , Eno Thereska , Christos Faloutsos , Gregory R. Ganger, Using utility to provision storage systems, Proceedings of the 6th USENIX Conference on File and Storage Technologies, p.1-16, February 26-29, 2008, San Jose, California
• 27: US Department of Energy. Average retail price of electricity to ultimate customers by end-use sector, by state, April 2008 and 2007. http://www.eia.doe.gov/cneaf/electricity/epm/table5_6_a.html, August 2008.
• 28: Mustafa Uysal , Arif Merchant , Guillermo A. Alvarez, Awarded Best Paper! - Using MEMS-Based Storage in Disk Arrays, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
• 29: David Woodhouse. JFFS: The journalling flash file system. http://sources.redhat.com/jffs2/jffs2.pdf, July 2001.
• 30: Bruce Worthington, Swaroop Kavalanekar, Qi Zhang, and Vishal Sharda. Characterization of storage workload traces from productionWindows servers. In Proc. IEEE International Symposium on Workload Characterization (IISWC), pages 119--128, Austin, TX, October 2008.
• 31: Chin-Hsien Wu, Li-Pin Chang, and Tei-Wei Kuo. An efficient B-tree layer for flash-memory storage systems. In Proc. Real-Time and Embedded Computing Systems and Applications (RTCSA), pages 409--430, Gothenburg, Sweden, August 2004.
• 32: Michael Wu , Willy Zwaenepoel, eNVy: a non-volatile, main memory storage system, Proceedings of the sixth international conference on Architectural support for programming languages and operating systems, p.86-97, October 05-07, 1994, San Jose, California, United States
• 33: Demetrios Zeinalipour-Yazti , Song Lin , Vana Kalogeraki , Dimitrios Gunopulos , Walid A. Najjar, Microhash: an efficient index structure for fash-based sensor devices, Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies, p.3-3, December 13-16, 2005, San Francisco, CA

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

General Terms:
Measurement

Keywords:
SSD, enterprise storage, enterprise storage workloads, flash, solid-state storage