Assisting tool for essay grading for Turkish language instructors

When learning languages, writing an essay is one of the main methods for assessing students’knowledge. However, with the development of information and communication technologies,language learning is also being transferred to online platforms. At the same time, as the numberof students increases, the problem of evaluating students’ essays arises. In this paper, we offeran automated system that facilitates instructors while evaluating students’ essays. Currently, thesystem works for essays written in Turkish. The system was built using the Zemberek library.It allows one to extract text features the essay of several people at the same time on severalindicators, namely, morphological analysis, vocabulary, the use of different language structures,etc. Currently, many automated essay grading tools are proposed, and one of the main factorsthat defined their accuracy it the extraction of text features. Thus, as further work, it is plannedto use the data obtained using this essay assessment system together with instructors’ evaluationto create an expert system for automatic essay evaluation using machine learning techniques.

PDF

___

[1]. Akın A.A., Akın M.D. “Zemberek, an open-source NLP framework for Turkic languages”, Structure, 10, (2007), 1-5.
[2]. Bahdanau D., Cho K., Bengio Y. “Neural machine translation by jointly learning to align and translate”, arXiv preprint arXiv:1409.0473, (2014).
[3]. Bird S., Klein E., Loper E. “Natural language processing with Python: analyzing text with the natural language toolkit”, Sebastopol: O'Reilly Media, Inc., (2009).
[4]. Brants T., Popat A.C., Xu P., Och F.J., Dean J. “Large language models in machine translation”, In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLPCoNLL), (2007, June), 858-867.
[5]. Brown P.F., Desouza P.V., Mercer R.L., Pietra V.J. D., Lai J.C., “Class-based n-gram models of natural language”, Computational linguistics, 18(4), (1992), 467-479.
[6]. Burstein J., Chodorow M., Leacock C. “CriterionSM Online Essay Evaluation: An Application for Automated Evaluation of Student Essays”, In IAAI, (2003, August), 3-10.
[7]. Cavnar W.B., Trenkle, J.M. “N-gram-based text categorization”, In Proceedings of SDAIR-94, 3rd annual symposium on document analysis and information retrieval, Vol. 161175, (1994, April).
[8]. Chowdhury G.G. Natural language processing”, Annual review of information science and technology, 37(1), (2003), 51-89.
[9]. Collobert R., Weston J. “A unified architecture for natural language processing: Deep neural networks with multitask learning”, In Proceedings of the 25th international conference on Machine learning. ACM, (2008, July), 160-167.
[10]. Goyal A., Jagarlamudi J. Daumé III, H., & Venkatasubramanian, S. “Sketching techniques for large scale NLP”, In Proceedings of the NAACL HLT 2010 Sixth Web as Corpus Workshop, (2010, June), 17-25. Association for Computational Linguistics.
[11]. Habash N.Y. “Introduction to Arabic natural language processing”, Synthesis Lectures on Human Language Technologies, 3(1), (2010), 1-187.
[12]. Khreisat L. “A machine learning approach for Arabic text classification using N-gram frequency statistics”, Journal of Informetrics, 3(1), (2009), 72-77.
[13]. Koehn P., Hoang H., Birch A., Callison-Burch C., Federico M., Bertoldi N., Cowan B., Shen W., Moran Ch., Zens R., Dyer Ch., Bojar O., Constantin A., Herbst E. “Moses: Open source toolkit for statistical machine translation”, In Proceedings of the 45th annual meeting of the association for computational linguistics companion volume proceedings of the demo and poster sessions, (2007, June), 177-180.
[14]. Page E.B. “The imminence of... grading essays by computer”, The Phi Delta Kappan, 47(5), (1966), 238- 243.
[15]. Page E.B. “Grading essays by computer: Progress report”, In Proceedings of the Invitational Conference on Testing Problems, (1967).
[16]. Page E.B. “Computer grading of student prose, using modern concepts and software”, The Journal of experimental education, 62(2), (1994), 127-142.
[17]. Page E.B. Poggio, J. P., Keith, T. Z., “Computer analysis of student essays: Finding trait differences in the student profile”, Paper presented at the annual meeting of the American Educational Research Association, Chicago, (1997, March).
[18]. Papineni K., Roukos S., Ward, T., Zhu W.J., “BLEU: a method for automatic evaluation of machine translation“, In Proceedings of the 40th annual meeting on association for computational linguistics, (2002, July), 311-318. Association for Computational Linguistics.
[19]. Schraudner M. “The online teacher’s assistant: Using automated correction programs to supplement learning and lesson planning”, CELE Journal, 22, (2014), 128- 140.
[20]. Shermis M.D., Koch C.M., Page E.B., Keith T.Z., Harrington S. “Trait ratings for automated essay grading“, Educational and Psychological Measurement, 62(1), (2002), 5-18.
[21]. Stenetorp P., Pyysalo S., Topić G., Ohta T., Ananiadou S., Tsujii J.I. “BRAT: a web-based tool for NLP-assisted text annotation”, In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics, (2012, April), 102-107. Association for Computational Linguistics.
[22]. Taghipour K., Ng H.T. “A neural approach to automated essay scoring”, In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, (2016, November), 1882-1891.
[23]. Tayirova N., Tekerek M., Brimkulov U. “Statistical machine translation implementation and performance tests between Kyrgyz and Turkish Languages”, MANAS Journal of Engineering, 3 (2), (2015), 59-68.
[24]. Tyers F.M., Alperen M.S. “South-east European times: A parallel corpus of Balkan languages”, In Proceedings of the LREC Workshop on Exploitation of Multilingual Resources and Tools for Central and (South-) Eastern European Languages, (2010), 49-53.
[25]. Van Ewijk R. “Same work, lower grade? Student ethnicity and teachers’ subjective assessments”, Economics of Education Review, 30(5), (2011), 1045- 1058.
[26]. Zupanc K., Bosnić Z. “Automated essay evaluation with semantic analysis”, Knowledge-Based Systems, 120, (2017), 118-132

ISSN: 1694-7398
Yayın Aralığı: Yılda 2 Sayı
Başlangıç: 2001
Yayıncı: KIRGIZİSTAN-TÜRKİYE MANAS ÜNİVERSİTESİ

Arşiv