A hardware-driven profiling scheme for identifying program hot spots to support runtime optimization

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

A hardware-driven profiling scheme for identifying program hot spots to support runtime optimization

Full text

Pdf (350 KB)

Source

International Symposium on Computer Architecture archive
Proceedings of the 26th annual international symposium on Computer architecture table of contents

Atlanta, Georgia, United States

Pages: 136 - 147

Year of Publication: 1999

ISBN:0-7695-0170-2

Also published in ...

Authors

Matthew C. Merten	Center for Reliable and High-Performance Computing, Department of Electrical and Computer Engineering, University of Illinois, Urbana, IL
Andrew R. Trick	Center for Reliable and High-Performance Computing, Department of Electrical and Computer Engineering, University of Illinois, Urbana, IL
Christopher N. George	Center for Reliable and High-Performance Computing, Department of Electrical and Computer Engineering, University of Illinois, Urbana, IL
John C. Gyllenhaal	Center for Reliable and High-Performance Computing, Department of Electrical and Computer Engineering, University of Illinois, Urbana, IL
Wen-mei W. Hwu	Center for Reliable and High-Performance Computing, Department of Electrical and Computer Engineering, University of Illinois, Urbana, IL

Sponsors

IEEE-CS\TCCA : TC on Computer Arhitecture
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

IEEE Computer Society Washington, DC, USA

Bibliometrics

Downloads (6 Weeks): 2, Downloads (12 Months): 40, Citation Count: 39

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/300979.300991 What is a DOI?

ABSTRACT

This paper presents a novel hardware-based approach for identifying, profiling, and monitoring hot spots in order to support runtime optimization of general purpose programs. The proposed approach consists of a set of tightly coupled hardware tables and control logic modules that are placed in the retirement stage of a processor pipeline removed from the critical path. The features of the proposed design include rapid detection of program hot spots after changes in execution behavior, runtime-tunable selection criteria for hot spot detection, and negligible overhead during application execution. Experiments using several SPEC95 benchmarks, as well as several large WindowsNT applications, demonstrate the promise of the proposed design.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Jennifer M. Anderson , Lance M. Berc , Jeffrey Dean , Sanjay Ghemawat , Monika R. Henzinger , Shun-Tak A. Leung , Richard L. Sites , Mark T. Vandevoorde , Carl A. Waldspurger , William E. Weihl, Continuous profiling: where have all the cycles gone?, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.1-14, October 05-08, 1997, Saint Malo, France
	2	Thomas M. Conte , Burzin A. Patel , Kishore N. Menezes , J. Stan Cox, Hardware-based profiling: an effective technique for profile-driven optimization, International Journal of Parallel Programming, v.24 n.2, p.187-206, April 1996
	3	Xiaolan Zhang , Zheng Wang , Nicholas Gloy , J. Bradley Chen , Michael D. Smith, System support for automatic profiling and optimization, Proceedings of the sixteenth ACM symposium on Operating systems principles, p.15-26, October 05-08, 1997, Saint Malo, France
	4	Glenn Ammons , Thomas Ball , James R. Larus, Exploiting hardware performance counters with flow and context sensitive profiling, ACM SIGPLAN Notices, v.32 n.5, p.85-96, May 1997
	5	Brad Calder , Peter Feller , Alan Eustace, Value profiling, Proceedings of the 30th annual ACM/IEEE international symposium on Microarchitecture, p.259-269, December 01-03, 1997, Research Triangle Park, North Carolina, United States
	6	Joel Auslander , Matthai Philipose , Craig Chambers , Susan J. Eggers , Brian N. Bershad, Fast, effective dynamic compilation, Proceedings of the ACM SIGPLAN 1996 conference on Programming language design and implementation, p.149-159, May 21-24, 1996, Philadelphia, Pennsylvania, United States
	7	Thomas Kistler, Dynamic Runtime Optimization, Proceedings of the Joint Modular Languages Conference on Modular Programming Languages, p.53-66, March 19-21, 1997
	8	Brian Lee Deitrich , Wen-Mei W. Hwu, Static program analysis to enhance profile independence in instruction-level parallelism compilation, 1998
	9	Thomas Ball , James R. Larus, Branch prediction for free, Proceedings of the ACM SIGPLAN 1993 conference on Programming language design and implementation, p.300-313, June 21-25, 1993, Albuquerque, New Mexico, United States
	10	W. Y. Chen , P. P. Chang , T. M. Conte , W. W. Hwu, The Effect of Code Expanding Optimizations on Instruction Cache Design, IEEE Transactions on Computers, v.42 n.9, p.1045-1057, September 1993 [doi>10.1109/12.241594]
	11	Dennis C. Lee , Patrick J. Crowley , Jean-Loup Baer , Thomas E. Anderson , Brian N. Bershad, Execution characteristics of desktop applications on Windows NT, Proceedings of the 25th annual international symposium on Computer architecture, p.27-38, June 27-July 02, 1998, Barcelona, Spain
	12	D. Wall, "Predicting program behavior using real or estimated profiles," Tech. Rep. TN-18, Digital Equipment Corporation WRL Technical Note, Polo Alto, CA, Decemeber 1990.
	13	Thomas M. Conte , Kishore N. Menezes , Mary Ann Hirsch, Accurate and practical profile-driven compilation using the profile buffer, Proceedings of the 29th annual ACM/IEEE international symposium on Microarchitecture, p.36-45, December 02-04, 1996, Paris, France
	14	Jeffrey Dean , James E. Hicks , Carl A. Waldspurger , William E. Weihl , George Chrysos, ProfileMe: hardware support for instruction-level profiling on out-of-order processors, Proceedings of the 30th annual ACM/IEEE international symposium on Microarchitecture, p.292-302, December 01-03, 1997, Research Triangle Park, North Carolina, United States
	15	Richard E. Hank , Wen-Mei W. Hwu , B. Ramakrishna Rau, Region-based compilation: an introduction and motivation, Proceedings of the 28th annual international symposium on Microarchitecture, p.158-168, November 29-December 01, 1995, Ann Arbor, Michigan, United States
	16	Robert Cohn , P. Geoffrey Lowney, Hot cold optimization of large Windows/NT applications, Proceedings of the 29th annual ACM/IEEE international symposium on Microarchitecture, p.80-89, December 02-04, 1996, Paris, France

CITED BY 39

	Ronald D. Barnes , Erik M. Nystrom , Matthew C. Merten , Wen-mei W. Hwu, Vacuum packing: extracting hardware-detected program phases for post-link optimization, Proceedings of the 35th annual ACM/IEEE international symposium on Microarchitecture, November 18-22, 2002, Istanbul, Turkey
	Tao Li , Lizy Kurian John , Vijaykrishnan Narayanan , Anand Sivasubramaniam , Jyotsna Sabarinathan , Anupama Murthy, Using complete system simulation to characterize SPECjvm98 benchmarks, Proceedings of the 14th international conference on Supercomputing, p.22-33, May 08-11, 2000, Santa Fe, New Mexico, United States
	Timothy Heil , James E. Smith, Relational profiling: enabling thread-level parallelism in virtual machines, Proceedings of the 33rd annual ACM/IEEE international symposium on Microarchitecture, p.281-290, December 2000, Monterey, California, United States
	S. Subramanya Sastry , Rastislav Bodík , James E. Smith, Rapid profiling via stratified sampling, ACM SIGARCH Computer Architecture News, v.29 n.2, p.278-289, May 2001
	Daniel A. Connors , Hillery C. Hunter , Ben-Chung Cheng , Wen-Mei W. Hwu, Hardware support for dynamic activation of compiler-directed computation reuse, ACM SIGPLAN Notices, v.35 n.11, p.222-233, Nov. 2000
	Ramesh Radhakrishnan , N. Vijaykrishnan , Lizy Kurian John , Anand Sivasubramaniam , Juan Rubio , Jyotsna Sabarinathan, Java Runtime Systems: Characterization and Architectural Implications, IEEE Transactions on Computers, v.50 n.2, p.131-146, February 2001
	Evelyn Duesterwald , Vasanth Bala, Software profiling for hot path prediction: less is more, ACM SIGPLAN Notices, v.35 n.11, p.202-211, Nov. 2000
	A. Iyer , D. Marculescu, Power aware microarchitecture resource scaling, Proceedings of the conference on Design, automation and test in Europe, p.190-196, March 2001, Munich, Germany
	Anoop Iyer , Diana Marculescu, Microarchitecture-level power management, IEEE Transactions on Very Large Scale Integration (VLSI) Systems, v.10 n.3, p.230-239, June 2002
	Matthew C. Merten , Andrew R. Trick , Erik M. Nystrom , Ronald D. Barnes , Wen-mei W. Hmu, A hardware mechanism for dynamic extraction and relayout of program hot spots, ACM SIGARCH Computer Architecture News, v.28 n.2, p.59-70, May 2000
	Evelyn Duesterwald , Vasanth Bala, Software profiling for hot path prediction: less is more, ACM SIGOPS Operating Systems Review, v.34 n.5, p.202-211, Dec. 2000
	Diana Marculescu , Anoop Iyer, Application-driven processor design exploration for power-performance trade-off analysis, Proceedings of the 2001 IEEE/ACM international conference on Computer-aided design, November 04-08, 2001, San Jose, California
	Alex Ramirez , Oliverio J. Santana , Josep L. Larriba-Pey , Mateo Valero, Fetching instruction streams, Proceedings of the 35th annual ACM/IEEE international symposium on Microarchitecture, November 18-22, 2002, Istanbul, Turkey
	Ann Gordon-Ross , Frank Vahid, Frequent loop detection using efficient non-intrusive on-chip hardware, Proceedings of the 2003 international conference on Compilers, architecture and synthesis for embedded systems, October 30-November 01, 2003, San Jose, California, USA
	Matthew C. Merten , Andrew R. Trick , Ronald D. Barnes, An Architectural Framework for Runtime Optimization, IEEE Transactions on Computers, v.50 n.6, p.567-589, June 2001
	Daniel A. Connors , Hillery C. Hunter , Ben-Chung Cheng , Wen-mei W. Hwu, Hardware support for dynamic activation of compiler-directed computation reuse, ACM SIGOPS Operating Systems Review, v.34 n.5, p.222-233, Dec. 2000
	Wei Liu , Michael C. Huang, EXPERT: expedited simulation exploiting program behavior repetition, Proceedings of the 18th annual international conference on Supercomputing, June 26-July 01, 2004, Malo, France
	Chia-Lin Yang , Chien-Hao Lee, HotSpot cache: joint temporal and spatial locality exploitation for i-cache energy reduction, Proceedings of the 2004 international symposium on Low power electronics and design, August 09-11, 2004, Newport Beach, California, USA
	Roni Rosner , Micha Moffie , Yiannakis Sazeides , Ronny Ronen, Selecting long atomic traces for high coverage, Proceedings of the 17th annual international conference on Supercomputing, June 23-26, 2003, San Francisco, CA, USA
	José L. Ayala , Alexander Veidenbaum , Marisa López-Vallejo, Power-aware compilation for register file energy reduction, International Journal of Parallel Programming, v.31 n.6, p.451-467, December 2003
	Giuseppe Desoli , Nikolay Mateev , Evelyn Duesterwald , Paolo Faraboschi , Joseph A. Fisher, DELI: a new run-time control point, Proceedings of the 35th annual ACM/IEEE international symposium on Microarchitecture, November 18-22, 2002, Istanbul, Turkey
	Ravi Bhargava , Juan Rubio , Srikanth Kannan , Lizy K. John , David Christie , Leo Klaes, Understanding the impact of X86/NT computing on microarchitecture, Workload characterization of emerging computer applications, Kluwer Academic Publishers, Norwell, MA, 2001
	Francesco Spadini , Brian Fahs , Sanjay Patel , Steven S. Lumetta, Improving quasi-dynamic schedules through region slip, Proceedings of the international symposium on Code generation and optimization: feedback-directed and runtime optimization, March 23-26, 2003, San Francisco, California
	Priya Nagpurkar , Hussam Mousa , Chandra Krintz , Timothy Sherwood, Efficient remote profiling for resource-constrained devices, ACM Transactions on Architecture and Code Optimization (TACO), v.3 n.1, p.35-66, March 2006
	Jeffry T. Russell , Margarida F. Jacome, Scenario-based software characterization as a contingency to traditional program profiling, Proceedings of the 2002 international conference on Compilers, architecture, and synthesis for embedded systems, October 08-11, 2002, Grenoble, France
	Huihui Shi , Yi Wang , Haibing Guan , Alei Liang, An intermediate language level optimization framework for dynamic binary translation, ACM SIGPLAN Notices, v.42 n.5, p.3-9, May 2007
	Yoav Almog , Roni Rosner , Naftali Schwartz , Ari Schmorak, Specialized Dynamic Optimizations for High-Performance Energy-Efficient Microarchitecture, Proceedings of the international symposium on Code generation and optimization: feedback-directed and runtime optimization, p.137, March 20-24, 2004, Palo Alto, California
	G. Agosta , S. Crespi Reghizzi , P. Palumbo , M. Sykora, Selective compilation via fast code analysis and bytecode tracing, Proceedings of the 2006 ACM symposium on Applied computing, April 23-27, 2006, Dijon, France
	Roni Rosner , Yoav Almog , Micha Moffie , Naftali Schwartz , Avi Mendelson, Power Awareness through Selective Dynamically Optimized Traces, ACM SIGARCH Computer Architecture News, v.32 n.2, p.162, March 2004
	Priya Nagpurkar , Chandra Krintz , Michael Hind , Peter F. Sweeney , V. T. Rajan, Online Phase Detection Algorithms, Proceedings of the International Symposium on Code Generation and Optimization, p.111-123, March 26-29, 2006
	Abhinav Das , Jiwei Lu , Wei-Chung Hsu, Region Monitoring for Local Phase Detection in Dynamic Optimization Systems, Proceedings of the International Symposium on Code Generation and Optimization, p.124-134, March 26-29, 2006
	Hyesoon Kim , M. Aater Suleman , Onur Mutlu , Yale N. Patt, 2D-Profiling: Detecting Input-Dependent Branches with a Single Input Data Set, Proceedings of the International Symposium on Code Generation and Optimization, p.159-172, March 26-29, 2006
	Venkata Syam P. Rapaka , Diana Marculescu, Pre-Characterization Free, Efficient Power/Performance Analysis of Embedded and General Purpose Software Applications, Proceedings of the conference on Design, Automation and Test in Europe, p.10504, March 03-07, 2003
	Kapil Vaswani , Matthew J. Thazhuthaveetil , Y. N. Srikant, A Programmable Hardware Path Profiler, Proceedings of the international symposium on Code generation and optimization, p.217-228, March 20-23, 2005
	Tipp Moseley , Alex Shye , Vijay Janapa Reddi , Dirk Grunwald , Ramesh Peri, Shadow Profiling: Hiding Instrumentation Costs with Parallelism, Proceedings of the International Symposium on Code Generation and Optimization, p.198-208, March 11-14, 2007
	Zhelong Pan , Rudolf Eigenmann, PEAK—a fast and effective performance tuning system via compiler optimization orchestration, ACM Transactions on Programming Languages and Systems (TOPLAS), v.30 n.3, p.1-43, May 2008
	Ajay Nair , Roman Lysecky, Non-intrusive dynamic application profiler for detailed loop execution characterization, Proceedings of the 2008 international conference on Compilers, architectures and synthesis for embedded systems, October 19-24, 2008, Atlanta, GA, USA
	Tyler Sondag , Hridesh Rajan, Phase-guided thread-to-core assignment for improved utilization of performance-asymmetric multi-core processors, Proceedings of the 2009 ICSE Workshop on Multicore Software Engineering, p.73-80, May 18-18, 2009
	Raymond P. L. Buse , Westley Weimer, The road not taken: Estimating path execution frequency statically, Proceedings of the 2009 IEEE 31st International Conference on Software Engineering, p.144-154, May 16-24, 2009