ConTest listeners: a concurrency-oriented infrastructure for Java test and heal tools

ABSTRACT

With the proliferation of the new multi-core personal computers, and the explosion of the usage of highly concurrent machine configuration, concurrent code moves from being written by the select few to the masses. As anyone who has written such code knows, there are many traps awaiting. This increases the need for good concurrency-aware tools to be used in the program quality cycle: monitoring, testing, debugging, and the emerging field of self-healing.

Academics who build such tools face two main difficulties; writing the instrumentation infrastructure for the tool, and integrating it into real user environments to obtain meaningful results. As these difficulties are hard to overcome, most academic tools do not make it past the toy stage.

The ConTest Listener architecture provides instrumentation and runtime engines to which writers of test and heal tools, especially concurrency-oriented, can easily plug their code. This paper describes this architecture, mainly from the point of view of a user intending to create a testing/healing tool. This architecture enables tool creators to focus on the concurrent problem they are trying to solve without writing the entire infrastructure. In addition, once they create a tool within the ConTest Listeners framework the tool can be used by the framework users with no additional work, enabling access to real industrial applications. We show how to create tools using the architecture and describe some work that has already taken place.

REFERENCES

• 1: C. Artho, K. Havelund, and A. Biere. High-level data races. In VVEIS'03, The First International Workshop on Verification and Validation of Enterprise Information Systems, April 2003.
• 2: AspectJ Team. The AspectJ programming guide. Version 1.5.3. Available from http://eclipse.org/aspectj, 2006.
• 3: Jason Baker , Wilson Hsieh, Runtime aspect weaving through metaprogramming, Proceedings of the 1st international conference on Aspect-oriented software development, April 22-26, 2002, Enschede, The Netherlands [doi>10.1145/508386.508396]
• 4: Arkady Bron , Eitan Farchi , Yonit Magid , Yarden Nir , Shmuel Ur, Applications of synchronization coverage, Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, June 15-17, 2005, Chicago, IL, USA [doi>10.1145/1065944.1065972]
• 5: Jong-Deok Choi , Harini Srinivasan, Deterministic replay of Java multithreaded applications, Proceedings of the SIGMETRICS symposium on Parallel and distributed tools, p.48-59, August 03-04, 1998, Welches, Oregon, United States [doi>10.1145/281035.281041]
• 6: S. Copty and S. Ur. Multi-threaded testing with aop is easy, and it finds bugs! In Proc. 11th International Euro-Par Conference, pages 740--749. LNCS, 2005.
• 7: S. Copty and S. Ur. Toward automatic concurrent debugging via minimal program mutant generation with aspectj. In TV06, 2006.
• 8: Eclipse Organization. Welcome to eclipse (plugin developer guide). http://eclipse.org/documentation, 2005.
• 9: O. Edelstein, E. Farchi, Y. Nir, G. Ratzaby, and S. Ur. Multithreaded java program test generation. IBM Systems Journal, 41(3):111--125, 2002.
• 10: Yaniv Eytani , Klaus Havelund , Scott D. Stoller , Shmuel Ur, Towards a framework and a benchmark for testing tools for multi-threaded programs: Research Articles, Concurrency and Computation: Practice & Experience, v.19 n.3, p.267-279, March 2007 [doi>10.1002/cpe.v19:3]
• 11: E. Farchi, Y. Nir-Buchbinder, and S. Ur. Cross-run lock discipline checker for java. In Parallel and Distributed Systems: Testing and Debugging (PADTAD - 3), November 2005.
• 12: Klaus Havelund , Scott D. Stoller , Shmuel Ur, Benchmark and Framework for Encouraging Research on Multi-Threaded Testing Tools, Proceedings of the 17th International Symposium on Parallel and Distributed Processing, p.286.1, April 22-26, 2003
• 13: Mozilla FireFox. developer center. http://developer.mozilla.org/en/docs/Main_Page.
• 14: Stefan Savage , Michael Burrows , Greg Nelson , Patrick Sobalvarro , Thomas Anderson, Eraser: a dynamic data race detector for multithreaded programs, ACM Transactions on Computer Systems (TOCS), v.15 n.4, p.391-411, Nov. 1997 [doi>10.1145/265924.265927]
• 15: Jim Shore, Fail Fast, IEEE Software, v.21 n.5, p.21-25, September 2004 [doi>10.1109/MS.2004.1331296]
• 16: Scott D. Stoller, Model-Checking Multi-threaded Distributed Java Programs, Proceedings of the 7th International SPIN Workshop on SPIN Model Checking and Software Verification, p.224-244, August 30-September 01, 2000

INDEX TERMS

Keywords:
Java, concurrency, instrumentation, self-healing, testing