Data-flow testing of declarative programs

ABSTRACT

We propose a novel notion of data-flow coverage for testing declarative programs. Moreover, we extend an automatic test-case generator such that it can achieve data-flow coverage. The coverage information is obtained by instrumenting a program such that it collects coverage information during its execution. Finally, we show the benefits of data-flow based testing for a couple of example applications.

REFERENCES

• 1: Elvira Albert, Miguel Gómez-Zamalloa, Laurent Hubert, and Germán Puebla. Verification of Java bytecode using analysis and transformation of logic programs. In Proc. PADL, LNCS 4354, pages 124--139, 2007.
• 2: B. Beizer. Black-Box Testing. Wiley, 1995.
• 3: Olaf Chitil, Colin Runciman, and Malcolm Wallace. Transforming Haskell for tracing. In Ricardo Pena and Thomas Arts, editors, Implementation of Functional Languages: 14th International Workshop, IFL 2002, LNCS 2670, pages 165--181, March 2003. ISBN 3-540-40190-3. URL http://www.cs.kent.ac.uk/pubs/2003/1770. Madrid, Spain, 16-18 September 2002.
• 4: Jan Christiansen and Sebastian Fischer. EasyCheck -- test data for free. In FLOPS '08: Proceedings of the 9th International Symposium on Functional and Logic Programming. Springer LNCS 4989, 2008.
• 5: Koen Claessen , John Hughes, QuickCheck: a lightweight tool for random testing of Haskell programs, Proceedings of the fifth ACM SIGPLAN international conference on Functional programming, p.268-279, September 2000
• 6: Thomas T. Cormen , Charles E. Leiserson , Ronald L. Rivest, Introduction to algorithms, MIT Press, Cambridge, MA, 1990
• 7: Sebastian Fischer , Herbert Kuchen, Systematic generation of glass-box test cases for functional logic programs, Proceedings of the 9th ACM SIGPLAN international conference on Principles and practice of declarative programming, July 14-16, 2007, Wroclaw, Poland [doi>10.1145/1273920.1273930]
• 8: Andy Gill , Colin Runciman, Haskell program coverage, Proceedings of the ACM SIGPLAN workshop on Haskell workshop, September 30-30, 2007, Freiburg, Germany [doi>10.1145/1291201.1291203]
• 9: M. Hanus et al. Curry: An integrated functional logic language (version 0.8.2). Available at URL http://www.informatik.uni-kiel.de/~curry, 2006.
• 10: Pieter W. M. Koopman, Artem Alimarine, Jan Tretmans, and Marinus J. Plasmeijer. Gast: Generic automated software testing. In Proc. IFL, LNCS 2670, pages 84--100, 2002.
• 11: H. Kuchen and S. Fischer. CyTest benchmarks web pages. URL http://danae.uni-muenster.de/lehre/kuchen/ICFP08/, 2008.
• 12: Fredrik Lindblad, Matthew Naylor, and Colin Runciman. A logic programming library for test-data generation. Available at http://www-users.cs.york.ac.uk/~mfn/lazysmallcheck/, 2007.
• 13: Roger A. Müller, Christoph Lembeck, and Herbert Kuchen. A symbolic Java virtual machine for test-case generation. In IASTED Conf. on Software Engineering, pages 365--371, 2004.
• 14: N. Mweze andW. Vanhoof. Automatic generation of test inputs for Mercury programs. In Proc. LOPSTR, 2006.
• 15: Matthew Naylor. A logic programming library for test-data generation. Available at http://www-users.cs.york.ac.uk/~mfn/sparsecheck/, 2007.
• 16: S. Peyton Jones, editor. Haskell 98 Language and Libraries-The Revised Report. Cambridge University Press, 2003.
• 17: Fethi Rabhi , Guy Lapalme, Algorithms; A Functional Programming Approach, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 18: Don Stewart , Spencer Sjanssen, Xmonad, Proceedings of the ACM SIGPLAN workshop on Haskell workshop, September 30-30, 2007, Freiburg, Germany [doi>10.1145/1291201.1291218]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging
          Subjects: Testing tools (e.g., data generators, coverage testing)

General Terms:
Measurement

Keywords:
code coverage, curry, data flow