Report on the First International Workshop on Comparative Evaluation in Requirements Engineering

ABSTRACT

Requirements Engineering (RE) research is believed to be mature enough for the community to be able to make comparative evaluations of alternative tools, techniques, approaches and methods. Commonly used exemplars in RE that have emerged over the years all suffer from well-defined and widely accepted evaluation criteria which makes comparison of the effectiveness of different research outcomes impossible. The first International Workshop on Comparative Evaluation on Requirements Engineering was held in conjunction with the 11^th IEEE International Requirements Engineering Conference in Monterey Bay, California. This workshop was conceived to address these issues and facilitate a community initiative in developing a common understanding of evaluation criteria and developing benchmarks for comparative evaluation in RE. Content, of course, is important.

REFERENCES

• 1: Martin S. Feather , Stephen Fickas , Anthony Finkelstein , Axel Van Lamsweerde, Requirements and Specification Exemplars, Automated Software Engineering, v.4 n.4, p.419-438, October 1997 [doi>10.1023/A:1008680612960]
• 2: Robert L. Glass, Pilot studies: what, why, and how, Journal of Systems and Software, v.36 n.1, p.85-97, Jan. 1997 [doi>10.1016/0164-1212(95)00197-2]
• 3: Susan Elliott Sim , Steve Easterbrook , Richard C. Holt, Using benchmarking to advance research: a challenge to software engineering, Proceedings of the 25th International Conference on Software Engineering, May 03-10, 2003, Portland, Oregon

INDEX TERMS

Keywords:
benchmarking, evaluation, requirements