The Proposal of a New Conceptualization for Validity and Criterion-Referenced Assessment

Murphy ve Davidshofer (2001) geçerliğin, ölçme geçerliği ve karar geçerliği olarak iki ana grup altında değerlendirilmesi gerektiğini önermişlerdir. Fakat bu sınıflama, bilinen geçerlik türlerine yeni bir şey katmamakta, özellikle karar geçerliğinin yeniden ele alınması gerekmektedir. Bu konudan ayrı olarak, ölçüt-dayanaklı değerlendirme kapsamında, eğitim alanında verilecek sınıflama kararlarının tutarlığını belirlemek amacıyla geliştirilen, ancak nereye yerleştirilecekleri konusunda üzerinde bir türlü anlaşmaya varılamayan bir çok indeks bulunmaktadır. Buradaki yeni sınıflamada, bu indekslerin “sınıflama geçerliği” olarak adlandırılması ve karar geçerliği altında yer alması gerektiği önerilmiştir. Bu şekliyle yeni geçerlik sınıflamasının daha işlevsel olacağı ve ölçüt-dayanaklı değerlendirme alanında yaşanan sorunu çözeceği ileri sürülebilir.

Geçerlik ve Ölçü-Dayanıklı Değerlendirme Konusunda Yeni Bir Kavramlaştırma Önerisi

Murphy & Davidshofer (2001) propose the strategies for assessing validity under two groups as the validity of measurement and validity for decisions. But, this classification requires re-regulation and expansion; because the content of validity for decisions doesn’t seem appropriate. On the other hand, a lot of indices have been developed in the criterion-referenced assessment context. Also where these indices will be classified is not clear yet. In the new proposed classification, these indices have been placed into “classification validity”. It can be suggested that trial conceptualization for validity is functional and can solve the conceptual confusion in the criterion-referenced assessment field.

PDF

___

American Psychological Association (1954). Technical recommendations for psychological tests and diagnostic techniques. Washington, DC: Author.
Berk, R. A. (1980). A consumers’ guide to criterion-referenced test reliability. Journal of Educational Measurement, 17 (4), 323-349.
Berry, K. J. & Mielke, P. W. (1997). Spearman’s footrule as a measure of agreement. Psychological Reports, 80, 839-846.
Brennan, R. L. & Kane, M. T. (1977). An index of dependability for mastery tests. Journal of Educational Measurement, 14 (3), 277-289.
Breyer, F. J. & Lewis, C. (1994). Pass-fail reliability for tests with cut scores: A simplified method. New Jersey: ETS, Research Report.
Crocker, L. & Algina, J. (1986). Introduction to classical and modern test theory. New York: CBS College Pub. Co.
Cronbach, L. J. (1971). Essentials of psychological tests (3rd ed). New York: Harper and Row Pub.
Glaser, R. (1994a). Criterion-referenced tests: Part I. Origins. Educational Measurement: Issues and Practice, 1, 9-11.
Glaser, R. (1994b). Criterion-referenced tests: Part II. Unfinished business. Educational Measurement: Issues and Practice, 1, 27-30.
Hambleton, R. K. & Novick, M. R. (1973). Toward an integration of theory and method for criterion-referenced tests. Journal of Educational Measurement, 10 (3), 159-170.
Hambleton, R. K. (1994). The rise and fall of criterion-referenced measurement. Educational Measurement: Issues and Practice, 1, 21-26.
Huynh, H. (1976). Statistical consideration of mastery scores. Psychometrika, 41 (1), 65-78.
Huynh, H. (1978). Reliability of multiple classifications. Psychometrika, 43 (3), 317-325.
Linn, R. L. (1994). Criterion-referenced measurement: A valuable perspective clouded by surplus meaning. Educational Measurement: Issues and Practice, 1, 12-14.
Livingston, S. A. (1972). Criterion-referenced applications of classical test theory. Journal of Educational Measurement, 9, 13-26
Livingston, S. A. & Lewis, C. (1995). Estimating the consistency and accuracy of classifications based on test scores. Journal of Educational Measurement, 32, 179-198.
Millman, J. (1994). Criterion-referenced testing 30 years: Promise broken, promise kept. Educational Measurement: Issues and Practice, 1, 19-39.
Murphy, K. R. & Davidshofer, C. O. (2001). Psychological testing (5th ed.). New Jersey: Prentice-Hall, Inc.
Peng, C-Y. J. & Subkoviak, M. J. (1980). A note on Huynh’s normal approximation procedure for estimating criterion-referenced reliability. Journal of Educational Measurement, 17, 359-368.
Subkoviak, M. J. (1976). Estimating reliability from a single administration of a mastery test. Journal of Educational Measurement, 13, 265-276.
Subkoviak, M. J. (1980). Decision-consistency approaches. In R. A. Berk (Ed), criterion-referenced measurement, 129-185. Baltimore: John Hopkins Unv. Press.
Subkoviak, M. J. (1988). A practitioner’s guide to computation and interpretation of reliability indices for mastery tests. Journal of Educational Measurement, 25(1), 47-55.
Swaminathan, H., Hambleton, R. K. & Algina, J. (1974). Reliability of criterion-referenced tests: A decision-theoretic formulation. Journal of Educational Measurement, 11, 263-267.