Test theory: Some basic notions

Bu makalede klasik ve modern test kuramlarındaki temel kavramlar tartışılmaktadır. Klasik test kuramı bağlamında gözlenen ve gerçek puan, gözlenen puanların güvenirliği ve madde indisleri üzerinde durulmuştur. Ayrıca bu indislerin genel olarak nasıl yorumlandığıyla ilgili bilgiler verilerek muhtemel bazı yanılgılara dikkat çekilmiştir. Madde tepki kuramı bağlamında ise temel olarak lojistik modeller üzerinde durulmuştur; kullanılan ölçme modelinin uygunluğuna karar verirken göz önünde bulundurulması gereken pratik bilgiler de ayrıca ele alınmıştır.

Test teorisi: Bazı temel kavramlar

This article discusses basic concepts in Classical Test Theory and Item Response Theory. In the context of Classical Test Theory the concepts of observed and true score, reliability of observed scores, and item indices are discussed. Some common rules of thumb to interpret numeric values of these indices are also presented in line with some caveats. Some problems with Classical Test Theory are also summarized. In the context of Item Response Theory, basically, the logistic models are discussed highlighting the importance of the concept to be measured. Practical guidelines in taking the decision to accept the IRT model are discussed.

PDF

___

Ebel, R.L. (1954),. Procedures for the Analysis of Classroom Tests, Educational and Psychological Measurement, 14, 352-364.
Glas, C.A.W. & Verhelst, N.D. (1995). Testing the Rasch Model. In: G.H. Fischer and I.W. Molenaar (Eds), Rasch Models: Foundations, Recent Developments and Applications, pp. 69-95. New York: Springer-Verlag.
Gulliksen, H. (1950). Theory of Mental Tests. New York: Wiley. (reprinted in 1987 by Lawrence Erlbaum Associates, Hillsdale, New Jersey)
Guttman, L.A. (1950). The Basis of Scalogram Analysis. In: S.A. Stouffer, L.A. Guttman. E.A. Suchman, P.F. Lazarsfeld, S.A. Star & J.A. Clausen (Eds). Measurement and Prediction: Studies in Social Psychology in World War II. Vol 4. Princeton: Princeton University Press.
Rasch, G. (1960). Probabilistic Models for some Intelligence and Attainment Tests. Copenhagen: The Danish Institute for Educational Research. (This book has been published again in 1980 by the University of Chicago Press, extended with a foreword and an afterword by B.D. Wright.)
Sijtsma, K. (2009).On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74, 107–120.
Verhelst, N.D. (2001). Testing the unidimensionality assumption of the Rasch model. Methods of Psychological Research Online, 6, 231-271.
Verhelst, N.D. (2004a). Classical Test Theory. In: Council of Europe, Reference Supplement to the Manual for Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, Teaching, Assessment (Section C). Strasbourg: Council of Europe. (download from http://www.coe.int/t/dg4/linguistic/manuel1_en.asp
Verhelst, N.D. (2004b). Item Response Theory. In: Council of Europe, Reference Supplement to the Manual for Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, Teaching, Assessment (Section G). Strasbourg: Council of Europe. (download from http://www.coe.int/t/dg4/linguistic/manuel1_en.asp
Verhelst, N.D. & Glas,C.A.W. (1995). The One Parameter Logistic Model. In: G.H. Fischer and I.W. Molenaar (Eds), Rasch Models: Foundations, Recent Developments and Applications, pp. 215-237. New York: Springer-Verlag.
Verhelst, N.D., Glas,C.A.W. & Verstralen, H.H.F.M. (1995). One Parameter Logistic Model (OPLM). Arnhem: Cito.