A framework and tool supports for generating test inputs of AspectJ programs

ABSTRACT

Aspect-oriented software development is gaining popularity with the wider adoption of languages such as AspectJ. To reduce the manual effort of testing aspects in AspectJ programs, we have developed a framework, called Aspectra, that automates generation of test inputs for testing aspectual behavior, i.e., the behavior implemented in pieces of advice or intertype methods defined in aspects. To test aspects, developers construct base classes into which the aspects are woven to form woven classes. Our approach leverages existing test-generation tools to generate test inputs for the woven classes; these test inputs indirectly exercise the aspects. To enable aspects to be exercised during test generation, Aspectra automatically synthesizes appropriate wrapper classes for woven classes. To assess the quality of the generated tests, Aspectra defines and measures aspectual branch coverage (branch coverage within aspects). To provide guidance for developers to improve test coverage, Aspectra also defines interaction coverage. We have developed tools for automating Aspectra's wrapper synthesis and coverage measurement, and applied them on testing 12 subjects taken from a variety of sources. Our experience has shown that Aspectra effectively provides tool supports in enabling existing test-generation tools to generate test inputs for improving aspectual branch coverage.

REFERENCES

• 1: AspectJ compiler 1.2, May 2004, http://eclipse.org/aspectj/.
• 2: abc: The AspectBench Compiler for AspectJ, version 1.0.2, Feburary 2005. http://aspectbench.org/.
• 3: Apache Avalon Framework, August 2005. http://excalibur.apache.org/.
• 4: R. T. Alexander, J. M. Bieman, and A. A. Andrews. Towards the systematic testing of aspect-oriented programs. Technical Report CS-4-105, Department of Computer Science, Colorado State University, Fort Collins, Colorado, 2004.
• 5: Ken Arnold , James Gosling , David Holmes, The Java Programming Language, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2000
• 6: R. D. Asberry. Aspect oriented programming (AOP): Using AspectJ to implement and enforce coding standards. Draft manuscript, 2002.
• 7: Pavel Avgustinov , Aske Simon Christensen , Laurie Hendren , Sascha Kuzins , Jennifer Lhoták , Ondřej Lhoták , Oege de Moor , Damien Sereni , Ganesh Sittampalam , Julian Tibble, abc: an extensible AspectJ compiler, Proceedings of the 4th international conference on Aspect-oriented software development, p.87-98, March 14-18, 2005, Chicago, Illinois [doi>10.1145/1052898.1052906]
• 8: Boris Beizer, Software Testing Techniques, John Wiley & Sons, Inc., New York, NY, 1990
• 9: Lodewijk Bergmans , Mehmet Aksit, Composing crosscutting concerns using composition filters, Communications of the ACM, v.44 n.10, p.51-57, Oct. 2001 [doi>10.1145/383845.383857]
• 10: Christoph Csallner , Yannis Smaragdakis, JCrasher: an automatic robustness tester for Java, Software—Practice & Experience, v.34 n.11, p.1025-1050, September 2004 [doi>10.1002/spe.602]
• 11: M. Dahm and J. van Zyl. Byte Code Engineering Library, April 2003. http://jakarta.apache.org/bcel/.
• 12: Bruno Dufour , Christopher Goard , Laurie Hendren , Oege de Moor , Ganesh Sittampalam , Clark Verbrugge, Measuring the dynamic behaviour of AspectJ programs, Proceedings of the 19th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, October 24-28, 2004, Vancouver, BC, Canada
• 13: Jan Hannemann , Gregor Kiczales, Design pattern implementation in Java and aspectJ, Proceedings of the 17th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, November 04-08, 2002, Seattle, Washington, USA
• 14: Youssef Hassoun , Roger Johnson , Steve Counsell, A Dynamic Runtime Coupling Metric for Meta-Level Architectures, Proceedings of the Eighth Euromicro Working Conference on Software Maintenance and Reengineering (CSMR'04), p.339, March 24-26, 2004
• 15: Y. Hassoun, R. Johnson, and S. Counsell. Emprical validation of a dynamic coupling metric. Technical Report BBKCS-04-03, Birbeck College London, March 2004.
• 16: Erik Hilsdale , Jim Hugunin, Advice weaving in AspectJ, Proceedings of the 3rd international conference on Aspect-oriented software development, p.26-35, March 22-24, 2004, Lancaster, UK [doi>10.1145/976270.976276]
• 17: JUnit, 2003. http://www.junit.org.
• 18: G. Kiczales, J. Lamping, A. Menhdhekar, C. Maeda, C. Lopes, J.-M. Loingtier, and J. Irwin. Aspect-oriented programming. In Proc. 11th European Conference on Object-Oriented Programming, pages 220--242. 1997.
• 19: James C. King, Symbolic execution and program testing, Communications of the ACM, v.19 n.7, p.385-394, July 1976 [doi>10.1145/360248.360252]
• 20: R. Laddad. AspectJ in Action. Manning, 2003.
• 21: Karl Lieberherr , David H. Lorenz , Pengcheng Wu, A case for statically executable advice: checking the law of demeter with AspectJ, Proceedings of the 2nd international conference on Aspect-oriented software development, p.40-49, March 17-21, 2003, Boston, Massachusetts [doi>10.1145/643603.643608]
• 22: Karl Lieberherr , Doug Orleans , Johan Ovlinger, Aspect-oriented programming with adaptive methods, Communications of the ACM, v.44 n.10, p.39-41, Oct. 2001 [doi>10.1145/383845.383855]
• 23: C. V. Lopes and T. Ngo. Unit testing aspectual behavior. In Proc. AOSD 05 Workshop on Testing Aspect-Oriented Programs, March 2005.
• 24: R. E. Lopez-Herrejon and D. Batory. Using AspectJ to implement product-lines: A case study. Technical report, University of Texis at Austin, September 2002.
• 25: Nathan McEachen , Roger T. Alexander, Distributing classes with woven concerns: an exploration of potential fault scenarios, Proceedings of the 4th international conference on Aspect-oriented software development, p.192-200, March 14-18, 2005, Chicago, Illinois [doi>10.1145/1052898.1052915]
• 26: Parasoft. Jtest manuals version 4.5. Online manual, April 2003. http://www.parasoft.com/.
• 27: Hridesh Rajan , Kevin Sullivan, Aspect language features for concern coverage profiling, Proceedings of the 4th international conference on Aspect-oriented software development, p.181-191, March 14-18, 2005, Chicago, Illinois [doi>10.1145/1052898.1052914]
• 28: Martin Rinard , Alexandru Salcianu , Suhabe Bugrara, A classification system and analysis for aspect-oriented programs, Proceedings of the 12th ACM SIGSOFT twelfth international symposium on Foundations of software engineering, October 31-November 06, 2004, Newport Beach, CA, USA
• 29: Amie L. Souter , David Shepherd , Lori L. Pollock, Testing with Respect to Concerns, Proceedings of the International Conference on Software Maintenance, p.54, September 22-26, 2003
• 30: Peri Tarr , Harold Ossher , William Harrison , Stanley M. Sutton, Jr., N degrees of separation: multi-dimensional separation of concerns, Proceedings of the 21st international conference on Software engineering, p.107-119, May 16-22, 1999, Los Angeles, California, United States [doi>10.1145/302405.302457]
• 31: Willem Visser , Corina S. Pǎsǎreanu , Sarfraz Khurshid, Test input generation with java PathFinder, Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis, July 11-14, 2004, Boston, Massachusetts, USA
• 32: T. Xie, D. Marinov, and D. Notkin. Improving generation of object-oriented test suites by avoiding redundant tests. Technical Report UW-CSE-04-01-05, University of Washington Department of Computer Science and Engineering, Seattle, WA, Jan. 2004.
• 33: Tao Xie , Darko Marinov , David Notkin, Rostra: A Framework for Detecting Redundant Object-Oriented Unit Tests, Proceedings of the 19th IEEE international conference on Automated software engineering, p.196-205, September 20-24, 2004 [doi>10.1109/ASE.2004.61]
• 34: T. Xie, D. Marinov, W. Schulte, and D. Noktin. Symstra: A framework for generating object-oriented unit tests using symbolic execution. In Proc. the International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2005), April 2005.
• 35: D. Xu, W. Xu, and K. Nygard. A state-based approach to testing aspect-oriented programs. In Proc. 17th International Conference on Software Engineering and Knowledge Engineering, July 2005.
• 36: J. Zhao. Tool support for unit testing of aspect-oriented software. In Proc. OOPSLA'2002 Workshop on Tools for Aspect-Oriented Software Development, Nov. 2002.
• 37: Jianjun Zhao, Data-Flow-Based Unit Testing of Aspect-Oriented Programs, Proceedings of the 27th Annual International Conference on Computer Software and Applications, p.188, November 03-06, 2003
• 38: Y. Zhou, D. Richardson, and H. Ziv. Towards a practical approach to test aspect-oriented software. In Proc. 2004 Workshop on Testing Component-based Systems (TECOS 2004), Net.ObjectiveDays, Sept. 2004.
• 39: Hong Zhu , Patrick A. V. Hall , John H. R. May, Software unit test coverage and adequacy, ACM Computing Surveys (CSUR), v.29 n.4, p.366-427, Dec. 1997 [doi>10.1145/267580.267590]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing)

General Terms:
Experimentation, Measurement, Reliability, Verification

Keywords:
AspectJ, aspect-oriented programs, aspect-oriented software development, coverage criteria, coverage measurement, software testing, test generation