The Acceptance and Use of an Online Exam System by Online Learners: Implementation of the UTAUT Model*

The achievement of technology depends heavily on its actual use by the target users. Similarly, the success of online exam systems also depends on the acceptance of target learners. In this regard, the purpose of this study was to investigate the factors that affect the acceptance of an online exam system by online learners. The study was conducted at a state university in Turkey during the fall semester of 2019-2020. A total of 277 online learners participated in this study. The research model of the study was based on the Unified Theory of Acceptance and Use of Technology (UTAUT). Participants’ data were collected through a survey, which included items of performance expectancy, effort expectancy, facilitating conditions, and social influence factors from the UTAUT model. Structural equation modelling (SEM) analysis was used to investigate the structure of the research model. The SEM results revealed that performance expectancy and facilitating conditions were positively related to online learners’ acceptance of an online exam system. However, according to the results, effort expectancy and social influence were not significantly related to online learners’ acceptance of an online exam system.

PDF

___

Afacan Adanır, G., İsmailova, R., Omuraliev, A., & Muhametjanova, G. (2020). Learners’ perceptions of online exams: A comparative study in Turkey and Kyrgyzstan. International Review of Research in Open and Distributed Learning, 21(3), 1-17. doi: 10.19173/irrodl.v21i3.4679
Al-Mashaqbeh, I. F., & Al Hamad, A. (2010). Student's perception of an online exam within the Decision Support System Course at Al al Bayt University. In Proceedings Second International Conference on Computer Research and Development, ICCRD 2010 (pp. 131-135). IEEE, https://ieeexplore.ieee.org/document/5489480
Alsadoon, H. (2017). Students' perceptions of e-assessment at Saudi Electronic University. Turkish Online Journal of Educational Technology-TOJET, 16(1), 147-153. Retrieved from: https://files.eric.ed.gov/fulltext/EJ1124924.pdf
Al Salmi, S., Al-Majeed, S., & Karam, J. (2019). Online exams for better students' performance. In: Proceedings of the 9th International Conference on Education, Teaching & Learning (ICE19New York Conference). Globalbizresearch, http://eprints.glos.ac.uk/6803/
Arpaci, I. (2015). A comparative study of the effects of cultural differences on the adoption of mobile learning. British Journal of Educational Technology, 46(4), 699-712. doi: 10.1111/bjet.12160
Cabı, E. (2016). Uzaktan eğitimde e-değerlendirme üzerine öğrenci algıları [The perception of students on e-assessment in distance education]. Journal of Higher Education & Science/Yüksekögretim ve Bilim Dergisi, 6(1), 94-101. doi:10.5961/jhes.2016.146.
Davis, F. D., (1989). Perceived usefulness, perceived ease of use and use acceptance of information technology. MIS Quarterly, 13(3), 319-339. doi: 10.2307/249008
Dermo, J. (2009). e‐Assessment and the student learning experience: A survey of student perceptions of e‐assessment. British Journal of Educational Technology, 40(2), 203- 214. doi: 10.1111/j.1467-8535.2008.00915.x
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. doi: 10.1177/002224378101800104
Granić, A., & Marangunić, N. (2019). Technology acceptance model in educational context: A systematic literature review. British Journal of Educational Technology, 50(5), 2572- 2593. doi: 10.1111/bjet.12864
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis. New York: Pearson.
Hillier, M. (2014). The very idea of e-Exams: Student (pre) conceptions. In B. Hegarty, J. McDonald, & S.-K. Lok (Eds.), Rhetoric and Reality: Critical perspectives on educational technology. Proceedings of the Australasian Society for Computers in Learning in Tertiary Education (Ascilite). (pp. 77-88). Retrieved from https://ascilite.org/conferences/dunedin2014/files/fullpapers/91-Hillier.pdf
Ibabe, I., & Jauregizar, J. (2010). Online self-assessment with feedback and metacognitive knowledge. Higher Education, 59(2), 243-258. doi: 10.1007/s10734-009-9245-6
Ilgaz, H., & Adanır, G. A. (2020). Providing online exams for online learners: Does it really matter for them?. Education and Information Technologies, 25(2), 1255-1269. doi: 10.1007/s10639-019-10020-6
Jawaid, M., Moosa, F. A., Jaleel, F., & Ashraf, J. (2014). Computer based assessment (CBA): Perception of residents at Dow University of Health Sciences. Pakistan Journal of Medical Sciences, 30(4), 688-691. doi: 10.12669/pjms.304.5444.
Karaman, S. (2011). Examining the effects of flexible online exams on students’ engagement in e-learning. Educational Research and Reviews, 6(3), 259-264. doi: 10.5897/ERR.9000156
Karaoğlan Yılmaz, F. G., Yılmaz, R., & Öztürk, T. (2020). Üniversite öğrencilerinin web tabanlı biçimlendirmeye yönelik değerlendirme sistemini kabul durumlarının incelenmesi [Examining university students’ acceptance of web-based formative assessment system]. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 35(Özel Sayı), 25-36. doi:10.16986/HUJE.2020063671
Kline, P. (1999). The handbook of psychological testing (2nd ed.). London: Routledge.
Maqableh, M., Masa’deh, R., & Mohammed, A. (2015). The acceptance and use of computer based assessment in higher education. Journal of Software Engineering and Applications, 8(10), 557-574. doi: 10.4236/jsea.2015.810053.
Maphosa, V., Dube, B., & Jita, T. (2020). A UTAUT evaluation of WhatsApp as a tool for lecture delivery during the COVID-19 lockdown at a Zimbabwean University. International Journal of Higher Education, 9(5), 84-93. doi:10.5430/ijhe.v9n5p84
Okocha, F., Eyiolorunshe, T. A., & Owolabi, S. (2017). Student perception and acceptance of computer based testing: a case study of Landmark University undergraduate students. Journal of Digital Innovations and Contemporary Research in Science and Engineering, 5(1), 25-32. doi: 10.22624
Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press.
Sarrayrih, M. A., & Ilyas, M. (2013). Challenges of online exam, performances and problems for online university exam. International Journal of Computer Science Issues (IJCSI), 10(1), 439-443. Retrieved from: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.698.304&rep=rep1&type =pdf
Schumacker, R. E., & Lomax, R. G. (2010). A beginner's guide to structural equation modeling (3rd ed.). New York: Routledge.
Sriyeni, Y., Antoni, D., & Akbar, M. (2018). Analisis penerimaan dan penggunaan teknologi computer based test (cbt) sebagai media ujian online dengan model uified theory of acceptance and use of technology (UTAUT). Jurnal Teknologi dan Informatika, 8(1), 93- 104. Retrieved from: http://ojs.palcomtech.ac.id/index.php/teknomatika/article/view/100
Sümer, N. (2000). Yapisal eşitlik modelleri: Temel kavramlar ve örnek uygulamalar [Structural equation modeling: Basic concepts and applications]. Türk Psikoloji Yazıları, 3(6), 49-74. Retrieved from: http://www.nebisumer.com/wp- content/uploads/2015/03/SumerN.2000.YEM_TPY.pdf
Taherdoost, H. (2016). Sampling methods in research methodology; How to choose a sampling technique for research. International Journal of Academic Research in Management (IJARM), 5(2), 18-27. doi: 10.2139/ssrn.3205035
Taherdoost, H. (2019). Importance of technology acceptance assessment for successful implementation and development of new technologies. Global Journal of Engineering Sciences, 1(3), 1-3. Retrieved from: https://ssrn.com/abstract=3313984
Tan, P. J. B. (2013). Students’ adoptions and attitudes towards electronic placement tests: A UTAUT analysis. American Journal of Computer Technology and Application, 1(1), 14- 23. Retrieved from: http://www.ajcta.com/
Terzis, V., & Economides, A. A. (2011). The acceptance and use of computer based assessment. Computers & Education, 56(4), 1032-1044. doi: 10.1016/j.compedu.2010.11.017
Terzis, V., Moridis, C. N., Economides, A. A., & Mendez, G. R. (2013). Computer based assessment acceptance: A cross-cultural study in Greece and Mexico. Journal of Educational Technology & Society, 16(3), 411-424. Retrieved from: https://www.jstor.org/stable/jeductechsoci.16.3.411
Trochim, W. M. K. (n.d.). Research Methods Knowledge Base. Retrieved from: https://conjointly.com/kb/
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425-478. doi: 10.2307/30036540
Zheng, M., & Bender, D. (2019). Evaluating outcomes of computer-based classroom testing: Student acceptance and impact on learning and exam performance. Medical Teacher, 41(1), 75-82. doi: 10.1080/0142159X.2018.1441984