Measuring the dynamic behaviour of AspectJ programs

ABSTRACT

This paper proposes and implements a rigorous method for studying the dynamic behaviour of AspectJ programs. As part of this methodology several new metrics specific to AspectJ programs are proposed and tools for collecting the relevant metrics are presented. The major tools consist of: (1) a modified version of the AspectJ compiler that tags bytecode instructions with an indication of the cause of their generation, such as a particular feature of AspectJ; and (2) a modified version of the *J dynamic metrics collection tool which is composed of a JVMPI-based trace generator and an analyzer which propagates tags and computes the proposed metrics. This dynamic propagation is essential, and thus this paper contributes not only new metrics, but also non-trivial ways of computing them.

We furthermore present a set of benchmarks that exercise a wide range of AspectJ's features, and the metrics that we measured on these benchmarks. The results provide guidance to AspectJ users on how to avoid efficiency pitfalls, to AspectJ implementors on promising areas for future optimization, and to tool builders on ways to understand the runtime behaviour of AspectJ.

REFERENCES

• 1: André Arnes. Certificate revocations performance simulation project. http://www.pvv.ntnu.no/~andrearn/certrev/sim.html, 2000.
• 2: R. Dale Asberry. Aspect oriented programming (AOP): Using AspectJ to implement and enforce coding standards. http://www.daleasberry.com/newsletters/200210/20021002.shtml, 2002.
• 3: AspectJ Eclipse Home. The AspectJ home page. http://eclipse.org/aspectj/, 2003.
• 4: Nick Benton , Andrew Kennedy , George Russell, Compiling standard ML to Java bytecodes, Proceedings of the third ACM SIGPLAN international conference on Functional programming, p.129-140, September 26-29, 1998, Baltimore, Maryland, United States
• 5: Curtis Clifton. MultiJava: Design, implementation and evaluation of a Java-compatible language supporting modular open classes and symmetric multiple dispatch. Technical Report 01-10, Department of Computer Science, Iowa State University, Ames, Iowa, 2001.
• 6: J. Andrés Díaz Pace , Marcelo R. Campo, Analyzing the role of aspects in software design, Communications of the ACM, v.44 n.10, p.66-73, Oct. 2001 [doi>10.1145/383845.383859]
• 7: Sylvia Dieckmann , Urs Hölzle, A Study of the Allocation Behavior of the SPECjvm98 Java Benchmark, Proceedings of the 13th European Conference on Object-Oriented Programming, p.92-115, June 14-18, 1999
• 8: Bruno Dufour , Karel Driesen , Laurie Hendren , Clark Verbrugge, Dynamic metrics for java, Proceedings of the 18th annual ACM SIGPLAN conference on Object-oriented programing, systems, languages, and applications, October 26-30, 2003, Anaheim, California, USA
• 9: Gustav Evertsson. Tetris in AspectJ, 2003. http://www.guzzzt.com/coding/aspecttetris.shtml.
• 10: Joseph D. Gradecki , Nicholas Lesiecki , Joe Gradecki, Mastering AspectJ: Aspect-Oriented Programming in Java, John Wiley & Sons, Inc., New York, NY, 2003
• 11: Robert J. Hall, CPPROFJ: Aspect-Capable Call Path Profiling of Multi-Threaded Java Applications, Proceedings of the 17th IEEE international conference on Automated software engineering, p.107, September 23-27, 2002
• 12: Youssef Hassoun , Roger Johnson , Steve Counsell, A Dynamic Runtime Coupling Metric for Meta-Level Architectures, Proceedings of the Eighth Euromicro Working Conference on Software Maintenance and Reengineering (CSMR'04), p.339, March 24-26, 2004
• 13: Youssef Hassoun, Roger Johnson, and Steve Counsell. Emprical validation of a dynamic coupling metric. Technical Report BBKCS-04-03, Birbeck College London, March 2004.
• 14: Erik Hilsdale , Jim Hugunin, Advice weaving in AspectJ, Proceedings of the 3rd international conference on Aspect-oriented software development, p.26-35, March 22-24, 2004, Lancaster, UK [doi>10.1145/976270.976276]
• 15: Gregor Kiczales , Erik Hilsdale , Jim Hugunin , Mik Kersten , Jeffrey Palm , William Griswold, Getting started with ASPECTJ, Communications of the ACM, v.44 n.10, p.59-65, Oct. 2001 [doi>10.1145/383845.383858]
• 16: Gregor Kiczales , Erik Hilsdale , Jim Hugunin , Mik Kersten , Jeffrey Palm , William G. Griswold, An Overview of AspectJ, Proceedings of the 15th European Conference on Object-Oriented Programming, p.327-353, June 18-22, 2001
• 17: Gregor Kiczales, John Lamping, Anurag Menhdekar, Chris Maeda, Cristina Lopes, Jean-Marc Loingtier, and John Irwin. Aspect-oriented programming. In Mehmet Aksit and Satoshi Matsuoka, editors, European Conference on Object-oriented Programming, volume 1241 of Lecture Notes in Computer Science, pages 220--242. Springer, 1997.
• 18: Ivan Kiselev, Aspect-Oriented Programming with AspectJ, Sams, Indianapolis, IN, 2002
• 19: Ramnivas Laddad. AspectJ in Action. Manning, 2003.
• 20: Karl Lieberherr , David H. Lorenz , Pengcheng Wu, A case for statically executable advice: checking the law of demeter with AspectJ, Proceedings of the 2nd international conference on Aspect-oriented software development, p.40-49, March 17-21, 2003, Boston, Massachusetts [doi>10.1145/643603.643608]
• 21: Karl Lieberherr, David H. Lorenz, and Pengcheng Wu. A case for statically executable advice: Checking the law of demeter with AspectJ. Code available from URL: http://www.ccs.neu.edu/home/lorenz/papers/aosd2003lod/, 2003.
• 22: Roberto E. Lopez-Herrejon and Don Batory. Using AspectJ to implement product-lines: A case study. Technical report, University of Texis at Austin, September 2002.
• 23: Hidehiko Masuhara, Gregor Kiczales, and Chris Dutchyn. A compilation and optimization model for aspect-oriented programs. In Compiler Construction, volume 2622 of Springer Lecture Notes in Computer Science, pages 46--60, 2003.
• 24: Jean Mayrand , Jean-François Patenaude , Ettore Merlo , Michel Dagenais , Bruno Laguë, Software assessment using metrics: A comparison across large C++ and Java systems, Annals of Software Engineering, v.9 n.1-4, p.117-141, 2000 [doi>10.1023/A:1018924724621]
• 25: Jerome Miecznikowski , Laurie J. Hendren, Decompiling Java Bytecode: Problems, Traps and Pitfalls, Proceedings of the 11th International Conference on Compiler Construction, p.111-127, April 08-12, 2002
• 26: Todd Millstein , Mark Reay , Craig Chambers, Relaxed MultiJava: balancing extensibility and modular typechecking, Proceedings of the 18th annual ACM SIGPLAN conference on Object-oriented programing, systems, languages, and applications, October 26-30, 2003, Anaheim, California, USA
• 27: Andrei Popovici , Gustavo Alonso , Thomas Gross, Just-in-time aspects: efficient dynamic weaving for Java, Proceedings of the 2nd international conference on Aspect-oriented software development, p.100-109, March 17-21, 2003, Boston, Massachusetts [doi>10.1145/643603.643614]
• 28: Andrei Popovici , Thomas Gross , Gustavo Alonso, Dynamic weaving for aspect-oriented programming, Proceedings of the 1st international conference on Aspect-oriented software development, April 22-26, 2002, Enschede, The Netherlands [doi>10.1145/508386.508404]
• 29: McGill University Sable Research Group. Soot: a Java optimization framework, 1998-2003.
• 30: Damien Sereni , Oege de Moor, Static analysis of aspects, Proceedings of the 2nd international conference on Aspect-oriented software development, p.30-39, March 17-21, 2003, Boston, Massachusetts [doi>10.1145/643603.643607]
• 31: Yefim Shuf , Mauricio J. Serrano , Manish Gupta , Jaswinder Pal Singh, Characterizing the memory behavior of Java workloads: a structured view and opportunities for optimizations, Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.194-205, June 2001, Cambridge, Massachusetts, United States
• 32: Raja Vallée-Rai , Etienne Gagnon , Laurie J. Hendren , Patrick Lam , Patrice Pominville , Vijay Sundaresan, Optimizing Java Bytecode Using the Soot Framework: Is It Feasible?, Proceedings of the 9th International Conference on Compiler Construction, p.18-34, March 25-April 02, 2000
• 33: Mitchell Wand, Gregor Kiczales, and Christopher Dutchyn. A semantics for advice and dynamic join points in aspect-oriented programming. In Foundations of Aspect-Oriented Languages (FOAL), Workshop at AOSD 2002, Technical Report TR #02-06, pages 1--8. Iowa State University, 2002.
• 34: Michalis Xenos, D. Stavrinoudis, K. Zikouli, and D. Christodoulakis. Object-oriented metrics -a survey.In Proceedings of the FESMA 2000, Federation of European Software Measurement Associations, 2000.
• 35: Xerox Corporation. Frequently asked questions about AspectJ, revision 1.8, 2003. http://dev.eclipse.org/viewcvs/indextech.cgi/aspectj-home/doc/faq.html.
• 36: Sherif M. Yacoub , Hany H. Ammar , Tom Robinson, Dynamic Metrics for Object Oriented Designs, Proceedings of the 6th International Symposium on Software Metrics, p.50, November 04-06, 1999
• 37: Charles Zhang , Hans-Arno. Jacobsen, Quantifying aspects in middleware platforms, Proceedings of the 2nd international conference on Aspect-oriented software development, p.130-139, March 17-21, 2003, Boston, Massachusetts [doi>10.1145/643603.643617]
• 38: Jianjun Zhao. Towards a metrics suite for aspect-oriented software. Technical Report SE-136-25, Information Processing Society of Japan (IPSJ), March 2002. http://citeseer.nj.nec.com/zhao02towards.html.

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.3 Language Constructs and Features

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics

General Terms:
Experimentation, Languages, Measurement, Performance

Keywords:
AspectJ, aspect-oriented programming, dynamic metrics, java, optimization, performance, program analysis