Energy and performance evaluation of lossless file data compression on server systems

ABSTRACT

Data compression has been claimed to be an attractive solution to save energy consumption in high-end servers and data centers. However, there has not been a study to explore this. In this paper, we present a comprehensive evaluation of energy consumption for various file compression techniques implemented in software. We apply various compression tools available on Linux to a variety of data files, and we try them on server class and workstation class systems. We compare their energy and performance results against raw reads and writes. Our results reveal that software based data compression cannot be considered as a universal solution to reduce energy consumption. Various factors like the type of the data file, the compression tool being used, the read-to-write ratio of the workload, and the hardware configuration of the system impact the efficacy of this technique. In some cases, however, we found compression to save substantial energy and improve performance.

REFERENCES

• 1: K. Y. Alina Oprea, Michael K. Reiter. Space-efficient block storage integrity. In Proceedings of the NDSS Symposium, 2005.
• 2: P. A. Alsberg. Space and time savings through large data base compression and dynamic restructuring. Proceedings of the IEEE, 63(8):1114--1122, 1975.
• 3: Kenneth C. Barr , Krste Asanović, Energy-aware lossless data compression, ACM Transactions on Computer Systems (TOCS), v.24 n.3, p.250-291, August 2006 [doi>10.1145/1151690.1151692]
• 4: Luca Benini , Alessandro Bogliolo , Stefano Cavallucci , Bruno Riccó, Monitoring system activity for OS-directed dynamic power management, Proceedings of the 1998 international symposium on Low power electronics and design, p.185-190, August 10-12, 1998, Monterey, California, United States [doi>10.1145/280756.280887]
• 5: L. Benini , D. Bruni , A. Macii , E. Macii, Hardware-Assisted Data Compression for Energy Minimization in Systems with Embedded Processors, Proceedings of the conference on Design, automation and test in Europe, p.449, March 04-08, 2002
• 6: L. Benini, D. Bruni, B. Ricco, A. Macii, and E. Macii. An adaptive data compression scheme for memory traffic minimization in processor-based systems. IEEE International Symposium on Circuits and Systems (ISCAS '02), 4:IV-866-IV-869, 2002.
• 7: Luca Benini , Alberto Macii , Enrico Macii , Massimo Poncino, Selective instruction compression for memory energy reduction in embedded systems, Proceedings of the 1999 international symposium on Low power electronics and design, p.206-211, August 16-17, 1999, San Diego, California, United States [doi>10.1145/313817.313927]
• 8: Luca Benini , Alberto Macii , Alberto Nannarelli, Cached-code compression for energy minimization in embedded processors, Proceedings of the 2001 international symposium on Low power electronics and design, p.322-327, August 2001, Huntington Beach, California, United States [doi>10.1145/383082.383177]
• 9: Luca Benini , Francesco Menichelli , Mauro Olivieri, A Class of Code Compression Schemes for Reducing Power Consumption in Embedded Microprocessor Systems, IEEE Transactions on Computers, v.53 n.4, p.467-482, April 2004 [doi>10.1109/TC.2004.1268405]
• 10: P. Bohrer, E. N. Elnozahy, T. Keller, M. Kistler, and L. C. Mcdowell. The case for Power Management in Web Servers, 2002. www.research.ibm.com/people/1/lefurgy/Publications/pac2002.pdf.
• 11: Dennis Colarelli , Dirk Grunwald, Massive arrays of idle disks for storage archives, Proceedings of the 2002 ACM/IEEE conference on Supercomputing, p.1-11, November 16, 2002, Baltimore, Maryland
• 12: CompuGreen, LLC. The Green500 List. www.green500.org, 2008.
• 13: D. J. Craft, A fast hardware data compression algorithm and some algorithmic extensions, IBM Journal of Research and Development, v.42 n.6, p.733-745, November 1998
• 14: D. C. Montgomery. Engineering Statistics. Wiley, 3 edition, 2004.
• 15: G. Debnath , K. Debnath , R. Fernando, The Pentium processor-90/100, microarchitecture and low power circuit design, Proceedings of the 8th International Conference on VLSI Design, p.185, January 04-07, 1995
• 16: Fred Douglis , P. Krishnan , Brian N. Bershad, Adaptive Disk Spin-down Policies for Mobile Computers, Proceedings of the 2nd Symposium on Mobile and Location-Independent Computing, p.121-137, April 10-11, 1995
• 17: Fred Douglis , P. Krishnan , Brian Marsh, Thwarting the power-hungry disk, Proceedings of the USENIX Winter 1994 Technical Conference on USENIX Winter 1994 Technical Conference, p.23-23, January 17-21, 1994, San Francisco, California
• 18: David Essary , Ahmed Amer, Predictive data grouping: Defining the bounds of energy and latency reduction through predictive data grouping and replication, ACM Transactions on Storage (TOS), v.4 n.1, p.1-23, May 2008 [doi>10.1145/1353452.1353454]
• 19: Jason Flinn , M. Satyanarayanan, Energy-aware adaptation for mobile applications, Proceedings of the seventeenth ACM symposium on Operating systems principles, p.48-63, December 12-15, 1999, Charleston, South Carolina, United States
• 20: Fluke 289 Digital Multimeter. http://assets.fluke.com/manuals/287_289_umeng0100.pdf.
• 21: Fluke i410 AC/DC Current Clamp. http://assets.fluke.com/manuals/i4101010iseng0200.pdf.
• 22: Sonya Gary , Pete Ippolito , Gianfranco Gerosa , Carl Dietz , Jim Eno , Hector Sanchez, PowerPC 603, A Microprocessor for Portable Computers, IEEE Design & Test, v.11 n.4, p.14-23, October 1994 [doi>10.1109/54.329447]
• 23: R. Gonzalez and M. Horowitz. Energy Dissipation in General Purpose Microprocessors. IEEE Journal of Solid-state Circuits, 31(9):1277--1284, September 1996.
• 24: B. Gordon and T. Meng. A low power subband video decoder architecture. In Proceeding of the IEEE International Conference on Acoustics, Speech, and Signal Processing, volume ii, pages 409--412, 1994.
• 25: Michael K. Gowan , Larry L. Biro , Daniel B. Jackson, Power considerations in the design of the Alpha 21264 microprocessor, Proceedings of the 35th annual Design Automation Conference, p.726-731, June 15-19, 1998, San Francisco, California, United States [doi>10.1145/277044.277226]
• 26: Hai Huang , Wanda Hung , Kang G. Shin, FS2: dynamic data replication in free disk space for improving disk performance and energy consumption, Proceedings of the twentieth ACM symposium on Operating systems principles, October 23-26, 2005, Brighton, United Kingdom
• 27: Emmanuel Jeannot , Björn Knutsson , Mats Björkman, Adaptive Online Data Compression, Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, p.379, July 24-26, 2002
• 28: Nikolai Joukov , Josef Sipek, GreenFS: making enterprise computers greener by protecting them better, Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems 2008, April 01-04, 2008, Glasgow, Scotland UK
• 29: M. Kandemir, O. Ozturk, M. Irwin, and I. Kolcu. Using data compression to increase energy savings in multi-bank memories. In Proceedings of the 10th International Euro-Par Conference on Parallel Processing (Euro-Par '04), volume 3149 of Lecture Notes in Computer Science, pages 310--317. Springer-Verlag Berlin Heidelberg, 2004.
• 30: G. Keramidas, K. Aisopos, and S. Kaxiras. Dynamic Dictionary-Based Data Compression for Level-1 Caches. In Proceedings of the 19th International Conference on Architecture of Computing Systems (ARCS '06), pages 114--129, 2006.
• 31: N. Kim, T. Austin, and T. Mudge. Low-Energy Data Cache using Sign Compression and Cache Line Bisection. In Proceedings of the 2nd Annual Workshop on Memory Performance Issues (WMPI '02), 2002.
• 32: Chandra Krintz , Brad Calder, Reducing Delay with Dynamic Selection of Compression Formats, Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, p.266, August 07-09, 2001
• 33: Alvin R. Lebeck , Xiaobo Fan , Heng Zeng , Carla Ellis, Power aware page allocation, Proceedings of the ninth international conference on Architectural support for programming languages and operating systems, p.105-116, November 2000, Cambridge, Massachusetts, United States
• 34: Haris Lekatsas , Jörg Henkel , Wayne Wolf, Code compression for low power embedded system design, Proceedings of the 37th Annual Design Automation Conference, p.294-299, June 05-09, 2000, Los Angeles, California, United States [doi>10.1145/337292.337423]
• 35: Andrew W. Leung , Shankar Pasupathy , Garth Goodson , Ethan L. Miller, Measurement and analysis of large-scale network file system workloads, USENIX 2008 Annual Technical Conference on Annual Technical Conference, p.213-226, June 22-27, 2008, Boston, Massachusetts
• 36: Kester Li , Roger Kumpf , Paul Horton , Thomas Anderson, A Quantitative analysis of disk drive power management in portable computers, Proceedings of the USENIX Winter 1994 Technical Conference on USENIX Winter 1994 Technical Conference, p.22-22, January 17-21, 1994, San Francisco, California
• 37: W.-C. Lin and C.-H. Chen. An energy-delay efficient power management scheme for embedded system in multimedia applications. In Proceedings of The IEEE Asia Pacific Conference on Circuit and System (APCCAS), pages 869--872, 2004.
• 38: J. R. Lorch and A. J. Smith. Software strategies for portable computer energy management. IEEE Personal Communications, 5:48--63, 1998.
• 39: Yung-Hsiang Lu , Luca Benini , Giovanni De Micheli, Operating-system directed power reduction, Proceedings of the 2000 international symposium on Low power electronics and design, p.37-42, July 25-27, 2000, Rapallo, Italy [doi>10.1145/344166.344189]
• 40: R. Manohar and N. Nystrom. Implications of voltage scaling in asynchronous architectures. Technical Report CSL-TR-2001-1013, Departament of Computer Science, Cornell University, 2001.
• 41: Dushyanth Narayanan , Austin Donnelly , Antony Rowstron, Write off-loading: practical power management for enterprise storage, Proceedings of the 6th USENIX Conference on File and Storage Technologies, p.1-15, February 26-29, 2008, San Jose, California
• 42: José Luis Núñez , Simon Jones, Gbit/s lossless data compression hardware, IEEE Transactions on Very Large Scale Integration (VLSI) Systems, v.11 n.3, p.499-510, June 2003 [doi>10.1109/TVLSI.2003.812288]
• 43: M. Oberhumer. lzop data compression utility. www.lzop.org/.
• 44: Eduardo Pinheiro , Ricardo Bianchini, Energy conservation techniques for disk array-based servers, Proceedings of the 18th annual international conference on Supercomputing, June 26-July 01, 2004, Malo, France [doi>10.1145/1006209.1006220]
• 45: R. Jain. The Art of Computer System Performance Analysis. Wiley, 1991.
• 46: T. Raita. An automatic system for file compression. The Computer Journal, pages 80--86, 1987.
• 47: Drew Roselli , Jacob R. Lorch , Thomas E. Anderson, A comparison of file system workloads, Proceedings of the annual conference on USENIX Annual Technical Conference, p.4-4, June 18-23, 2000, San Diego, California
• 48: Steve B. Furber, ARM System Architecture, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1996
• 49: Sudhanva Gurumurthi , Anand Sivasubramaniam , Mahmut Kandemir , Hubertus Franke, DRPM: dynamic speed control for power management in server class disks, Proceedings of the 30th annual international symposium on Computer architecture, June 09-11, 2003, San Diego, California
• 50: Christopher M. Sadler , Margaret Martonosi, Data compression algorithms for energy-constrained devices in delay tolerant networks, Proceedings of the 4th international conference on Embedded networked sensor systems, October 31-November 03, 2006, Boulder, Colorado, USA [doi>10.1145/1182807.1182834]
• 51: D. Shkarin. PPMd data compression utility. www.compression.ru/ds/.
• 52: Ching-Long Su , Alvin M. Despain, Cache design trade-offs for power and performance optimization: a case study, Proceedings of the 1995 international symposium on Low power design, p.63-68, April 23-26, 1995, Dana Point, California, United States [doi>10.1145/224081.224093]
• 53: Ching-Long Su , A. M. Despain, Cache designs for energy efficiency, Proceedings of the 28th Hawaii International Conference on System Sciences, p.306, January 04-07, 1995
• 54: Kiyofumi Tanaka , Takahiro Kawahara, Leakage energy reduction in cache memory by data compression, ACM SIGARCH Computer Architecture News, v.35 n.5, December 2007 [doi>10.1145/1360464.1360472]
• 55: R. B. Tremaine, P. A. Franaszek, J. T. Robinson, C. O. Schulz, T. B. Smith, M. E. Wazlowski, and P. M. Bland. IBM Memory Expansion Technology (MXT). IBM Journal of Research and Development, 45(2):271--286, 2001.
• 56: Luis Villa , Michael Zhang , Krste Asanović, Dynamic zero compression for cache energy reduction, Proceedings of the 33rd annual ACM/IEEE international symposium on Microarchitecture, p.214-220, December 2000, Monterey, California, United States [doi>10.1145/360128.360150]
• 57: Watts up? PRO ES Power Meter. www.wattsupmeters. com/secure/products.php.
• 58: Mark Weiser , Brent Welch , Alan Demers , Scott Shenker, Scheduling for reduced CPU energy, Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation, p.2-es, November 14-17, 1994, Monterey, California
• 59: M. Weiser, B. Welsh, A. Demers, and S. Shenker. Scheduling for reduced CPU energy. Mobile Computing, 353:449--471, 1996.
• 60: D. Wheeler. Linux utility for wattsup pro es power meter. www.wattsupmeters.com/forum/index.php?topic=7.0.
• 61: J. Wilkes. Predictive power conservation. Technical Report HPL-CSP-92-5, Hewlett-Packard Laboratories, February 1992.
• 62: Yair Wiseman , Karsten Schwan , Patrick Widener, Efficient end to end data exchange using configurable compression, ACM SIGOPS Operating Systems Review, v.39 n.3, p.4-23, July 2005 [doi>10.1145/1075395.1075396]
• 63: Charles P. Wright , Nikolai Joukov , Devaki Kulkarni , Yevgeniy Miretskiy , Erez Zadok, Auto-pilot: a platform for system software benchmarking, Proceedings of the annual conference on USENIX Annual Technical Conference, p.53-53, April 10-15, 2005, Anaheim, CA
• 64: Rong Xu , Zhiyuan Li , Cheng Wang , Peifeng Ni, Impact of Data Compression on Energy Consumption of Wireless-Networked Handheld Devices, Proceedings of the 23rd International Conference on Distributed Computing Systems, p.302, May 19-22, 2003
• 65: Yukihiro Yoshida , Bao-Yu Song , Hiroyuki Okuhata , Takao Onoye , Isao Shirakawa, An object code compression approach to embedded processors, Proceedings of the 1997 international symposium on Low power electronics and design, p.265-268, August 18-20, 1997, Monterey, California, United States [doi>10.1145/263272.263349]
• 66: Erez Zadok , Johan M. Andersen , Ion Badulescu , Jason Nieh, Fast Indexing: Support for Size-Changing Algorithms in Stackable File Systems, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.289-304, June 25-30, 2001
• 67: Heng Zeng , Carla S. Ellis , Alvin R. Lebeck , Amin Vahdat, ECOSystem: managing energy as a first class operating system resource, Proceedings of the 10th international conference on Architectural support for programming languages and operating systems, October 05-09, 2002, San Jose, California
• 68: Qingbo Zhu , Francis M. David , Christo F. Devaraj , Zhenmin Li , Yuanyuan Zhou , Pei Cao, Reducing Energy Consumption of Disk Storage Using Power-Aware Cache Management, Proceedings of the 10th International Symposium on High Performance Computer Architecture, p.118, February 14-18, 2004 [doi>10.1109/HPCA.2004.10022]
• 69: V. Zyuban , P. Kogge, Optimization of high-performance superscalar architectures for energy efficiency, Proceedings of the 2000 international symposium on Low power electronics and design, p.84-89, July 25-27, 2000, Rapallo, Italy [doi>10.1145/344166.344522]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

Additional Classification:
  E. Data
  E.4 CODING AND INFORMATION THEORY

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)

General Terms:
Measurement, Performance

Keywords:
data compression, energy, performance evaluation, storage