Using JULE to generate a compliance test suite for the UML standard

ABSTRACT

The Java-UML Lightweight Enumerator (JULE) tool implements a vitally important aspect of the framework for software tool certification - test suite generation. The framework uses UML models as the test inputs for the bounded exhaustive-testing approach. Within a size bound for the metamodel types, JULE enumerates only the set of non-isomorphic models in the form of relational structures. These models are classified into two sets - demonstration and counterexample - using Binary Decision Diagrams (BDDs). The power of JULE lies in its model enumeration and its use of a high-performance grid infrastructure. Hence, JULE efficiently generates a very small test suite while increasing the bound on the input size to the extent that is practical for certification purpose.

REFERENCES

• 1: Bernhard K. Aichernig , Percy Antonio Pari Salas, Test Case Generation by OCL Mutation and Constraint Solving, Proceedings of the Fifth International Conference on Quality Software, p.64-71, September 19-20, 2005 [doi>10.1109/QSIC.2005.63]
• 2: Dirk Beyer, Relational programming with CrocoPat, Proceedings of the 28th international conference on Software engineering, May 20-28, 2006, Shanghai, China [doi>10.1145/1134285.1134420]
• 3: Chandrasekhar Boyapati , Sarfraz Khurshid , Darko Marinov, Korat: automated testing based on Java predicates, Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis, July 22-24, 2002, Roma, Italy
• 4: Bunyakiati, P., Finkelstein, A. and Rosenblum, D. 2007. The Certification of Software Tools with respect to Software Standards. In Proceedings of the IEEE IRI, Las Vegas, USA, 724--729.
• 5: Chapman, C, Goonatilake, C., Emmerich, W., Farrellee, M., Tannenbaum, T., Livny, M., Calleja, M. and Dove, M. 2005. Condor Birdbath - Web Service interface to Condor. In Proceedings of the UK E-Science All Hands Meeting, Nottingham, UK.
• 6: Jeremy Dick , Alain Faivre, Automating the Generation and Sequencing of Test Cases from Model-Based Specifications, Proceedings of the First International Symposium of Formal Methods Europe on Industrial-Strength Formal Methods, p.268-284, April 19-23, 1993
• 7: John Fitzgerald , Peter Gorm Larsen, Modelling systems: practical tools and techniques in software development, Cambridge University Press, New York, NY, 1998
• 8: Emden R. Gansner , Stephen C. North, An open graph visualization system and its applications to software engineering, Software—Practice & Experience, v.30 n.11, p.1203-1233, Sept. 2000 [doi>10.1002/1097-024X(200009)30:11<1203::AID-SPE338>3.3.CO;2-E]
• 9: Gogolla, M., Bohling, J. and Richters, M. 2003. Validation of UML and OCL Models by Automatic Snapshot Generation. In Proceedings of the UML''2003, Lecture Notes in Computer Science, Vol. 2863, Springer, Berlin.
• 10: Daniel Jackson, Software Abstractions: Logic, Language, and Analysis, The MIT Press, 2006
• 11: JUnit, November 2007, DOI=http://www.junit.org/
• 12: Darko Marinov , Sarfraz Khurshid, TestEra: A Novel Framework for Automated Testing of Java Programs, Proceedings of the 16th IEEE international conference on Automated software engineering, p.22, November 26-29, 2001
• 13: Meudec, C. 1998 Automatic Generation of Software Test Cases from Formal Specifications. Doctoral Thesis, the Queen''s University of Belfast.
• 14: The Object Management Group (OMG), The Object Constraint Language (OCL) specification, DOI=http://www.omg.org/.
• 15: The Object Management Group (OMG), The Unified Modeling Language (UML) specification, DOI=http://www.omg.org/.
• 16: James Skene , Wolfgang Emmerich, Specifications, not meta-models, Proceedings of the 2006 international workshop on Global integrated model management, May 22-22, 2006, Shanghai, China [doi>10.1145/1138304.1138315]
• 17: Kevin Sullivan , Jinlin Yang , David Coppit , Sarfraz Khurshid , Daniel Jackson, Software assurance by bounded exhaustive testing, Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis, July 11-14, 2004, Boston, Massachusetts, USA
• 18: Wong, K. 1998. The Rigi User''s Manual - Version 5.4.4. DOI=http://www.rigi.cs.uvic.ca/downloads/rigi/doc/

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: Object-oriented design methods

General Terms:
Design, Languages, Standardization, Verification

Keywords:
binary decision diagram, certification, metamodel, ocl, test generation, uml