Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Main memory in clusters may dominate total system power. The resulting energy consumption increases system operating cost and the heat produced reduces reliability. Emergent memory technology will provide servers with the ability to dynamically turn-on (online) and turn-off (offline) memory devices at runtime. This technology, coupled with slack in memory demand, offers the potential for significant energy savings in clusters of servers. Enabling power-aware memory and conserving energy in clusters are non-trivial. First, power-aware memory techniques must be scalable to thousands of devices. Second, techniques must not negatively impact the performance of parallel scientific applications. Third, techniques must be transparent to the user to be practical. We propose a Memory Management Infra-Structure for Energy Reduction (Memory MISER). Memory MISER is transparent, performance-neutral, and scalable. It consists of a prototype Linux kernel that manages memory at device granularity and a userspace daemon that monitors memory demand systemically to control devices and implement energy- and performance-constrained policies. Experiments on an 8-node cluster show our control daemon reduces memory energy up to 56.8% with <1% performance degradation for several classes of parallel scientific codes. Our daemon uses a PID controller to conservatively offline memory and aggressively online memory at runtime. For multi-user workloads where memory demand often spikes dramatically, Memory MISER can save up to 67.94% of memory energy with <1% performance degradation. Current IBM eServer systems support up to 2 terabytes of SDRAM per node and 16 processors. For a server-based cluster with 8 90-watt processors and 32 GB of SDRAM per processor, Memory MISER can save about 30% total system energy for multi-user parallel workloads.

REFERENCES

• 1: N. Adiga, G. Almasi, et al., "An Overview of the BlueGene/L Supercomputer," Proceedings of IEEE/ACM SC 2002, Baltimore, MD, 2003.
• 2: Karl Johan Astrom , Bjorn Wittenmark, Adaptive Control, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1994
• 3: Luca Benini , Giovanni de Micheli, System-level power optimization: techniques and tools, ACM Transactions on Design Automation of Electronic Systems (TODAES), v.5 n.2, p.115-192, April 2000 [doi>10.1145/335043.335044]
• 4: Rong Ge , Xizhou Feng , Kirk W. Cameron, Performance-constrained Distributed DVS Scheduling for Scientific Applications on Power-aware Clusters, Proceedings of the 2005 ACM/IEEE conference on Supercomputing, p.34, November 12-18, 2005 [doi>10.1109/SC.2005.57]
• 5: Kirk W. Cameron , Rong Ge , Xizhou Feng, High-Performance, Power-Aware Distributed Computing for Scientific Applications, Computer, v.38 n.11, p.40-47, November 2005 [doi>10.1109/MC.2005.380]
• 6: G. Chen, K. Malkowski, and P. Raghavan, "Reducing Power with Performance Constraints for Parallel Sparse Applications," Proceedings of 1st Workshop on High-performance, power-aware computing, Denver, CO, 2005.
• 7: Victor Delaluz , Mahmut Kandemir , N. Vijaykrishnan , Anand Sivasubramaniam , Mary Jane Irwin, Hardware and Software Techniques for Controlling DRAM Power Modes, IEEE Transactions on Computers, v.50 n.11, p.1154-1173, November 2001 [doi>10.1109/12.966492]
• 8: W. Feng , M. Warren , E. Weigle, The Bladed Beowulf: A Cost-Effective Alternative to Traditional Beowulfs, Proceedings of the IEEE International Conference on Cluster Computing, p.245, September 23-26, 2002
• 9: Xizhou Feng , Rong Ge , Kirk W. Cameron, Power and Energy Profiling of Scientific Applications on Distributed Systems, Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers, p.34, April 04-08, 2005 [doi>10.1109/IPDPS.2005.346]
• 10: Vincent W. Freeh , David K. Lowenthal, Using multiple energy gears in MPI programs on a power-scalable cluster, Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, June 15-17, 2005, Chicago, IL, USA [doi>10.1145/1065944.1065967]
• 11: J. Haas and P. Vogt, "Fully-buffered DIMM Technology Moves Enterprise Platforms to the Next Level," in Technology@Intel Magazine, vol. 3, 2005.
• 12: C.-H. Hsu and U. Kremer, "Compiler-directed dynamic voltage scaling for memory-bound applications," Department of Computer Science Rutgers University, Piscataway August 2002.
• 13: H. Huang, C. Lefurgy, T. Keller, and K. G. Shin, "Memory Traffic Reshaping for Energy-Efficient Memory," Proceedings of International Symposium on Low Power Electronics and Design (ISLPED), San Diego, CA, 2005.
• 14: Alvin R. Lebeck , Xiaobo Fan , Heng Zeng , Carla Ellis, Power aware page allocation, Proceedings of the ninth international conference on Architectural support for programming languages and operating systems, p.105-116, November 2000, Cambridge, Massachusetts, United States
• 15: Charles Lefurgy , Karthick Rajamani , Freeman Rawson , Wes Felter , Michael Kistler , Tom W. Keller, Energy Management for Commercial Servers, Computer, v.36 n.12, p.39-48, December 2003 [doi>10.1109/MC.2003.1250880]
• 16: P. Mochel, "The sysfs Filesystem," Proceedings of Annual Linux Symposium, Ottawa, Canada, 2005.
• 17: Rambus, "Rambus RDRAM," 1999.
• 18: M. E. Tolentino, "Flexible Operating System Structure for Dynamic Memory Management," M.S. Thesis in Computer Science: University of Washington, 2004, pp. 88.
• 19: M. E. Tolentino, J. Turner, and K. W. Cameron, "An Implementation of Page Allocation Shaping for Energy Efficiency," Proceedings of 3rd Workshop on High-Performance, Power-Aware Computing, Long Beach, CA, 2007.

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.2 Storage Management
          Subjects: Allocation/deallocation strategies

Additional Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.2 Storage Management
          Subjects: Main memory

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)

General Terms:
Management, Measurement, Performance, Reliability

Keywords:
control, memory, power management, resource allocation