Principles of survey research part 4: questionnaire evaluation

ABSTRACT

This article discusses how to avoid biased questions in survey instruments, how to motivate people to complete instruments and how to evaluate instruments. In the context of survey evaluation, we discuss how to assess survey reliability i.e. how reproducible a survey's data is and survey validity i.e. how well a survey instrument measures what it sets out to measure.

REFERENCES

• 1: Linda Bourque and Eve Fielder, How to conduct self-administered and mail surveys, Sage Publications Inc., 1995.
• 2: L.J. Cronbach, "Coefficient alpha and internal structure of tests," Psychometrika, 16(2), 1951, pp. 297--334.
• 3: K. El Emam , D. R. Goldenson , L. Briand , P. Marshall, Interrater agreement in SPICE-based assessments: some preliminary results, Proceedings of the Fourth International Conference on the Software Process (ICSP '96), p.149, December 02-06, 1996
• 4: Khaled El Emam , Jean-Martin Simon , Sonia Rousseau , Eric Jacquet, Cost Implications of Interrater Agreement for Software Process Assessments, Proceedings of the 5th International Symposium on Software Metrics, p.38, March 20-21, 1998
• 5: Watts S. Humphrey , Bill Curtis, Comments on 'A Critical Look', IEEE Software, v.8 n.4, p.42-46, July 1991 [doi>10.1109/52.300033]
• 6: Timothy C. Lethbridge, A Survey of the Relevance of Computer Science and Software Engineering Education, Proceedings of the 11th Conference on Software Engineering Education and Training, p.0056, February 22-25, 1998
• 7: Timothy C. Lethbridge, What Knowledge Is Important to a Software Professional?, Computer, v.33 n.5, p.44-50, May 2000 [doi>10.1109/2.841783]
• 8: Janne Ropponen , Kalle Lyytinen, Components of Software Development Risk: How to Address Them? A Project Manager Survey, IEEE Transactions on Software Engineering, v.26 n.2, p.98-112, February 2000 [doi>10.1109/32.841112]
• 9: Howard Schuman and Stanley Presser, Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording and Context. Sage Publications, Inc. 1996.

INDEX TERMS

Keywords:
researcher bias, respondent motivation, survey reliability, survey validity