UNDERSTANDING THE DEVELOPMENT OF LANGUAGE ASSESSMENT LITERACY

Language assessment literacy (LAL) has become an important competencefor English language (EL) teachers to have; however, several studies conductedin the literature indicate that Turkish EL teachers have low levels of LAL. Thosestudies do not focus on how EL teachers develop their LAL. Therefore, the presentstudy aims to find out how Turkish EL teachers have developed their LAL. Thestudy was designed as a small scale qualitative study. Eight EL teachers workingat a Turkish university participated into the study. The researchers used a focusgroup discussion and semi-structured individual interviews to collect data. Theresearchers made the study trustworthy through member check, triangulation,and thick description. The data collected were content-analyzed. The findings ofthe study point out that previous assessment experience, assessment training, andself-improvement influence the development of LAL in the participant EL teachers.Self-improvement in which the participant EL teachers peer-assessed their exams,practiced their theoretical information and gained experience by assessing andevaluating their students is found to be the most effective in developing LAL.

YABANCI DİLDE ÖLÇME DEĞERLENDİRME OKURYAZARLIĞININ GELİŞİMİNİ ANLAMAK

Yabancı dilde ölçme değerlendirme okuryazarlığı, İngilizce öğretmenlerinin sahip olması gereken önemli bir yeterliktir; ancak alınyazında yapılan çalışmalar şunu göstermiştir ki Türk İngilizce öğretmenleri, düşük düzeyde ölçme değerlendirme okuryazarıdır. Bu çalışmalar İngilizce öğretmenlerinin ölçme değerlendirme okuryazarlıklarını nasıl geliştirdiklerine odaklanmamışlardır. Bu yüzden bu çalışma, Türk İngilizce öğretmenlerinin ölçme değerlendirme okuryazarlıklarını nasıl geliştirdiklerini bulmayı amaçlar. Çalışma, küçük ölçekli bir nitel çalışma olarak tasarlanmıştır. Bir Türk üniversitesinde çalışan sekiz İngilizce öğretmeni bu çalışmaya katılmıştır. Yarı-yapılandırılmış kişisel görüşmeler ve odak grup görüşmesi veri toplamak için kullanılmıştır. Çalışma; katılımcı kontrolü, üçgenleme ve yoğun anlatım kullanılarak inandırıcılığı artırılmıştır. Toplanan veri, içerik analizi kullanılarak analiz edilmiştir. Çalışmanın bulguları; önceki ölçme değerlendirme deneyiminin, ölçme değerlendirme eğitiminin ve kişisel gelişimin katılımcı İngilizce öğretmenlerinin yabancı dilde ölçme değerlendirme okuryazarlıklarının gelişimini etkilediklerini göstermiştir. Katılımcılarının; meslektaş değerlendirmeleri yaparak, teorik bilgilerini uygulamada kullanarak ve öğrencilerini ölçerek değerlendirerek kazandıkları deyimle kendilerini geliştirmelerinin, ölçme değerlendirme okuryazarlığının gelişiminde en etkili olan faktör olduğu bulunmuştur.

___

YILDIRIM, A. & ŞİMŞEK, H. (2013). Sosyal bilimlerde nitel araştırma yöntemleri (9th ed.). Ankara: Seçkin Yayıncılık.

WALTERS, F. S. (2010). Cultivating assessment literacy: Standards evaluation through language- test specification reverse engineering. Language Assessment Quarterly, 7(4), 317- 342. doi: 10.1080/15434303.2010.516042

VOGT, K. & TSAGARI, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11, 374-402. doi: 10.1080/15434303.2014.960046

VOGT, K., GUERIN, E., SAHINKARAKAS, S., PAVLOU, P., TSAGARI, D., & AFIRI, Q. (2008). Assessment literacy of foreign language teachers in Europe – current trends and future perspectives. Paper presented at the 5th EALTA Conference, Athens, Greece.

TAHMASBI, S. (2014). Scaffolding and artifacts. Middle-East Journal of Scientific Research, 19(10), 1378-1387.

STIGGINS, R. J. (1995). Assessment literacy for the 21st century. The Phi Delta Kappan, 77(3), 238-245.

STIGGINS, R. J. (1991). Assessment literacy. The Phi Delta Kappan, 72(7), 534-539.

SCARINO, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309-327. doi: 10.1177/0265532213480128

ŞAHIN, S. (2015, May). Language testing and assessment (LTA) literacy of high school English language teachers in Turkey. Paper presented at the 3rd ULEAD Congress, International Congress on Applied Linguistics: Current Issues in Applied Linguistics, Çanakkale, Turkey.

ROGIER, D. (2014). Assessment literacy: Building a base for better teaching and learning. English Teaching Forum, 3, 2-13.

REA-DICKINS, P. (2008). Classroom-based language assessment. In E. Shohamy & N. H. Hornberger (Eds.), Encyclopedia of language and education (2nd ed.) (pp. 257-271). Springer Science+Business Media LLC.

REA-DICKINS, P. (2004). Understanding teachers as agents of assessment. Language Testing, 21(3), 249-258.

PILL, J. & HARDING, L. (2013). Defining the language assessment literacy gap: Evidence from a parliamentary inquiry. Language Testing, 30(3), 381-402. doi: 10.1177/0265532213480337

ÖZ, S. & ATAY, D. (2017). Turkish EFL instructors’in-class language assessment literacy: Perceptions and practices. ELT Research Journal, 6(1), 25-44.

O’LOUGHLIN, K. (2013). Developing the assessment literacy of university proficiency test users. Language Testing, 30(3), 363-380. doi: 10.1177/0265532213480336

NEWFIELDS, T. (the Proceedings of the 5th Annual JALT Pan-SIG Conference, Shizuoka, Japan (pp. 48-73). Tokai University College of Marine Science2006). Teacher development and assessment literacy. Paper presented at

MUNOZ, A. P., PALACIO, M., & ESCOBAR, L. (2012). Teachers’ beliefs about assessment in an EFL context in Colombia. PROFILE, 14(1), 143-158.

MERTLER, C. A. & CAMPBELL, C. (2005, April). Measuring teachers’ knowledge & application of classroom assessment concepts: Development of the Assessment Literacy Inventory. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Quebec, Canada.

MEDE, E. & ATAY, D. (2017). English language teachers’ assessment literacy: The Turkish context. Ankara Üniversitesi TÖMER Dil Dergisi, 168(1), 43-60.

MALONE, M. E. (2013). The essentials of assessment literacy: Contrasts between testers and users. Language Testing, 30(3), 329-344. doi: 10.1177/0265532213480129

MALONE, M. E. (2008). Training in language assessment. In E. Shohamy & N. H. Hornberger (Eds.), Encyclopedia of language and education (2nd ed.) (pp. 225-239). Springer Science+Business Media LLC.

LOMAX, R. G. (1996). On becoming assessment literate: An initial look at preservice teachers’ beliefs and practices. The Teacher Educator, 31(4), 292-303. doi: 10.1080/08878739609555122

LINCOLN, Y. S. & GUBA, E. G. (1985). Naturalistic inquiry. Newbury Park, CA: Sage Publications.

LAM, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 169-197. doi: 10.1177/0265532214554321

IZCI, K. & SIEGEL, M. (2014, April). Investigating high school chemistry teachers’ assessment literacy in theory and practice. Paper presented at the annual meeting of the American Educational Research Association, Philadelphia, PA.

INBAR-LOURIE, O. (2013). Language assessment literacy. In C. A. Chapelle (Ed.), The Encyclopedia of Applied Linguistics (pp. 1-8). Blackwell Publishing Ltd.

INBAR-LOURIE, O. (2008b). Language assessment culture. In E. Shohamy & N. H. Hornberger (Eds.), Encyclopedia of language and education (2nd ed.) (pp. 285-299). Springer Science+Business Media LLC.

INBAR-LOURIE, O. (2008a). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385-402. doi: 10.1177/0265532208090158

HATIPOĞLU, Ç. & ERÇETIN, G. (2016). Türkiye’de yabancı dilde ölçme ve değerlendirme eğitiminin geçmişi ve bugünü. In S. Akcan & Y. Bayyurt (Eds), 3. ulusal yabancı dil eğitimi kurultayı: Türkiye’deki yabancı dil eğitimi üzerine görüş ve düşünceler 23-24 Ekim 2014, konferanstan seçkiler (pp. 72-89). İstanbul, Turkey: Boğaziçi University.

HATIPOĞLU, Ç. (2015, May). Diversity in language testing and assessment literacy of language teachers in Turkey. Paper presented at the 3rd ULEAD Congress, International Congress on Applied Linguistics: Current Issues in Applied Linguistics, Çanakkale, Turkey.

HASSELGREEN, A., CARLSEN, C., & HELNESS, H. (2004). European survey of language testing and assessment needs. Report: Part one – general findings. Retrieved fromhttp:// www.ealta.eu.org/documents/resources/survey-report-pt1.pdf

FULCHER, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132. doi: 10.1080/15434303.2011.642041

DÖRNYEI, Z. (2011). Research methods in applied linguistics. Oxford, UK: Oxford University Press.

DAVISON, C. & LEUNG, C. (2009). Current issues in English language teacher-based assessment. TESOL Quarterly, 43(3), 393-415.

CRESWELL, J. W. (2007). Qualitative inquiry & research design: Choosing among five approaches (2nd ed.). Thousand Oaks, California, the United States of America: Sage Publications

BÜYÜKKARCI, K. (2016). Identifying the areas for English language teacher development: A study of assessment literacy. Pegem Eğitim ve Öğretim Dergisi, 6(3), 333-346.

BROADFOOT, P. M. (2005). Dark alleys and blind bends: Testing the language of learning. Language Testing, 22(2), 123-141. doi: 10.1191/0265532205lt302oa

BRINDLEY, G. (2008). Educational reform and language testing. In E. Shohamy & N. H. Hornberger (Eds.), Encyclopedia of language and education (2nd ed.) (pp. 365-378). Springer Science+Business Media LLC.

AMERICAN FEDERATION OF TEACHERS, NATIONAL COUNCIL ON MEASUREMENT IN EDUCATION, & NATIONAL EDUCATION ASSOCIATION. (1990). Standards for teacher competence in educational assessment of students. Retrieved from http:// buros.org/standards-teacher-competence-educational-assessment-students

ALAS, E. & LIIV, S. (2014). Assessment literacy of national examination interviewers and rater-experience with the CEFR. EESTI RAKENDUSLINGVISTIKA ÜHINGU AASTARAAMAT, 10, 7-22.