Duden SAEPUZAMAN, Heri RETNAWATİ, Edi ISTİYONO, Haryanto

Can Innovative Learning Affect Students’ HOTS Achievements?: A Meta-Analysis Study

This study looks at innovative learnings’ effect on achieving students’ High Order Thinking Skills (HOTS). HOTS is one part of the skills that need to be developed in the 21st Century. This research is a quantitative study with a meta-analysis approach to the mean with random-effects models. Generally, the steps involve formulating research problems meta-analysis to be performed, collecting studies, calculating the effect size, test of heterogeneity, data analysis (summary effect, forest plots, funnel plots, test the potential for publication bias), and concludes. The research sample of 42 research includes international journals and national, international, and nationwide proceedings and a thesis student. The analysis using random models (random-effect model) obtained a mean value of the effect size of aggregation or summary effect amounted to 77.37, standard error weighs the mean 12.36, the upper limit of 53.14, and the lower limit of 101.60. Analysis of the null hypothesis (Ho: actual effect ? = ?) leads to rejecting Ho because the ? value of the summary effect is 77.37 with the one-tailed p-value (0.00) smaller than the α value (0.05). Analysis of publication bias tests from Funnel Plot, Rank Correlation, Regression Method outputs, and “Trim and Fill” shows no potential publication bias regarding conclusions drawn. So the findings made based on the random effect model on the application of innovative learning affect HOTS students achievement (analyzing, evaluating, creating, critical and creative thinking skill aspects) are valid. The implication is that teachers or other practitioners can use innovative learning to improve students’ HOTS.

PDF

___

Agustina, N., Imamora, M., & Chandra, A. N. (2020). Pengembangan Modul Berbasis Pembelajaran CTL Untuk Mencapai HOTS Pada Materi Getaran Harmonis. Proceeding IAIN Batusangkar, 1(3), 169–176.

Akyol, Z., & Garrison, D. R. (2011). Understanding cognitive presence in an online and blended community of inquiry: Assessing outcomes and processes for deep approaches to learning. British Journal of Educational Technology, 42(2), 233–250. https://doi. org/10.1111/j.1467-8535.2009.01029.x

Alandia, R. G., & Suparwoto, S. (2019). Pengembangan Perangkat Pembelajaran Fisika Model Problem-Based Learning Berbantuan Web untuk Meningkatkan Kemampuan Berpikir Kritis dan Keterampilan Proses Sains Peserta Didik SMA. In S2 thesis, Program Pascasarjana. http://eprints.uny.ac.id/id/ eprint/67333

Aljarrah, K., & Khataybeh, A. (2021). Representing teaching staff in Jordanian universities for the 21st century skills. Pegem Journal of Education and Instruction, 11(3), 17–25.

Ambarita, R. A., Yunastiti, Y., & Indriayu, M. (2019). The Application of Group Investigation Based on Hands on Activities to Improve Learning Outcomes Based on Higher Order Thinking Skills of Students at SMA Negeri 2 Pematangsiantar. Budapest International Research and Critics in Linguistics and Education (BirLE) Journal, 2(2), 351–359. https://doi.org/10.33258/birle. v2i2.310

Anazifa, R. D., & Djukri. (2017). Project- based learning and problem- based learning: Are they effective to improve student’s thinking skills? Jurnal Pendidikan IPA Indonesia, 6(2), 346–355. https:// doi.org/10.15294/jpii.v6i2.11100

Anderson, L. W., & Krathwohl, D. R. (2001). A revision of Bloom’s taxonomy of educational objectives. A Taxonomy for Learning, Teaching and Assessing. Longman, New York.

Apino, E., & Retnawati, H. (2017). Developing Instructional Design to Improve Mathematical Higher Order Thinking Skills of Students. Journal of Physics: Conference Series, 812(1), 12100. https://doi.org/10.1088/1742-6596/812/1/012100

Apino, Ezi, & Retnawati, H. (2016). Creative Problem Solving to Improve Students’ Higher Order Thinking Skills in Mathematics Instructions. Proceeding of 3Rd International Conference on Research, Implementation and Education of Mathematics and Science, May, 339–346.

Arends, R. I., & Kilcher, A. (2010). Teaching for student learning: Becoming an accomplished teacher. In Teaching for Student Learning: Becoming an Accomplished Teacher. Routledge. https://doi.org/10.4324/9780203866771

Ariansyah, D., & Soenarto, S. (2019). Pengaruh Pendekatan Contextual Teaching and Learning (CTL) Terhadap Kemampuan Berpikir Kritis Siswa pada Materi Rangkaian RLC. In S2 thesis, Program Pascasarjana. http://eprints.uny.ac.id/id/eprint/65975

Arisandi, G., & Sutrisno, H. (2019). Penerapan Pembelajaran Kimia Berbasis Analogi untuk Menganalis Keterampilan Berpikir Tingkat Tinggi Siswa pada Materi Ikatan Kimia. In S2 thesis, Program Pascasarjana. http://eprints.uny.ac.id/id/eprint/66753

Ateş, A. (2021). The Relationship Between Parental Involvement in Education and Academic Achievement: A Meta-analysis Study. Pegem Egitim ve Ogretim Dergisi, 11(3), 50–66.

Azis Nur, A. (2016). Pengaruh Model Problem Based Learning Terhadap Keterampilan Berpikir Tingkat Tinggi dan hasil Belajar Biologi Siswa SMK-PP Negeri REA Timur Kabupaten Polewali mandar.

Baskoro, I. (2019). Efektivitas Pembelajaran Matematika Berbasis Teori Variasi Ditinjau Dari Keterampilan Berpikir Tingkat Tinggi Siswa Smk.S2 Thesis. Sekolah Pascasarjanan Universitas Negeri Yogyakarta Indonesia.

Bohan, H., & Bohan, S. (2020). Extending the Regular Curriculum Through Creative Problem Solving. The Arithmetic Teacher, 41(2), 83–87. https://doi.org/10.5951/at.41.2.0083

Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. ASCD.

Candra, & Retnawati, H. (2020). A meta-analysis of constructivism learning implementation towards the learning outcomes on civic education lesson. International Journal of Instruction, 13(2), 835–846. https://doi.org/10.29333/iji.2020.13256a

Çoğaltay, N., & Karadağ, E. (2015). Introduction to meta-analysis. In Leadership and organizational outcomes (pp. 19–28). Springer.

Conklin, W. (2012). Higher-Order Thinking Skills to Develop 21st Century Learners. In Shell Education. Teacher Created Materials.

Crumb, L. N. (1983). Taxonomy Of Educational Objectives The Classification of Educational Goals. In Cataloging and Classification Quarterly (Vol. 3, Issue 1). Ann Arbor.

Dasilva, B. E., & Suparno, S. (2019). Pengembangan Interactive Physics Mobile Learning Media Berbasis Android dengan Pendekatan Pembelajaran Scaffolding Pada Materi Termodinamika untuk Meningkatkan Higher Order Thinking Skill dan Self Efficacy Peserta Didik SMA. In S2 thesis, Program Pascasarjana. http:// eprints.uny.ac.id/id/eprint/65804

Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987). Publication bias and clinical trials. Controlled Clinical Trials, 8(4), 343–353. https://doi.org/10.1016/0197- 2456(87)90155-3

Djidu, H., & Jailani. (2016). Aktivitas Pembelajaran Matematika yang Dapat Melatih Kemampuan Berpikir Tingkat Tinggi Siswa. Seminar Nasional Matematika X Universitas Negeri Semarang, 314.

Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel- plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi. org/10.1111/j.0006-341X.2000.00455.x

Erny, Haji, S., & Widada, W. (2017). Pengaruh pendekatan saintifik pada pembelajaran matematika terhadap kemampuan pemecahan masalah dan kemampuan berpikir tingkat tinggi siswa kelas X ipa sma negeri 1 kepahiang. Jurnal Pendidikan Matematika Raflesia, 6(7), 84–95.

Fauziah, S. (2013). The Effectiveness of PBL Online on Physics Students’ Creativity and Critical Thinking : A Case Study at Universiti Malaysia Sabah. International Journal of Education and Research, 1(3), 1–18.

Ferty, Z. N., & Suparno, S. (2019). Pengembangan Interactive Physics Mobile Learning Media Berbasis Android dengan Pendekatan Scaffolding untuk Meningkatkan HOTS dan Sikap Ilmiah Siswa SMA.

Fisher, R. (2010). Thinking Skill Strategies.pdf. In D. J. Arthur & T. Cremin (Eds.), Learning to Teach in The Primary School (2nd ed., pp. 374–387). Routledge.

Folly Eldy, E., & Sulaiman, F. (2013). Integrated PBL Approach: Preliminary Findings towards Physics Students’ Critical Thinking and Creative-Critical Thinking. International Journal of Humanities and Social Science Invention ISSN (Online, 2(3), 2319–7722.

Freeman, P. R., Hedges, L. V., & Olkin, I. (1986). Statistical Methods for Meta-Analysis. In Biometrics (Vol. 42, Issue 2). Academic press. https://doi.org/10.2307/2531069

Goethals, P. L. (2013). The Pursuit of Higher-Order Thinking in the Mathematics Classroom. United States Military Academy, West Point, NY.

Guedri, Z. (2001). Problem-based Learning: Bringing Higher Order Thinking to Business Schools. Cahier de Recherche OIPG No, 2, 002. http://neumann.hec.ca/oipg/fichiers/2001-002_-_ Problem-Based_Learning....pdf

Hadi, S., Retnawati, H., Munadi, S., Apino, E., & Wulandari, N. F. (2018). The difficulties of high school students in solving higher-order thinking skills problems. Problems of Education in the 21st Century, 76(4), 520.

Haryanto, P. C., & Arty, I. S. (2019). Pengembangan Video animasi IPA Berbasis Contextual Teaching And Learning (CTL) Untuk Meningkatkan High Order Thinking Skills (HOTS. In Dan Self Efficacy Peserta Didik SMP. S2 thesis, Program Pascasarjana. http://eprints.uny.ac.id/id/eprint/66366

Hendryarto, J. (2013). Penerapan Model Pembelajaran Inkuiri Untuk Melatih Kemampuan Berpikir Tingkat Tinggi Siswa Pada Materi Pokok Laju Reaksi (Implementation Inquiry Learning Model For Training High Order Thinking Skills Of The Students On Main Material Of Reaction Rate. UNESA Journal of Chemical Education, 2(2).

Hidayati, A. U., & Retnawati, H. (2018). Keefektifan pendekatan PBL dan pendekatan saintifik ditinjau dari HOTS dan karakter. Jurnal Pendidikan Matematika Dan Sains, 6(1), 70–82.

Inayati, U. (2020). Strategi Guru Dalam Menerapkan Pembelajaran HOTS Menggunakan Model Problem Based Learning. Auladuna : Jurnal Prodi Pendidikan Guru Madrasah Ibtidaiyah, 2(2), 27–34. https://doi.org/10.36835/au.v2i2.410

Indiani, V., & Retnawati, H. (2017). Need Assessment To Develop Teaching Set For Improving Higher Order Thinking Skills of Junior High School Students In Learning Mathematics. Proceeding the International Conference on Education Innovation, 1(1), 848–853.

Jailani, J., Sugiman, S., & Apino, E. (2017). Implementing the problem-based learning in order to improve the students’ HOTS and characters. Jurnal Riset Pendidikan Matematika, 4(2), 247. https://doi.org/10.21831/jrpm.v4i2.17674

Jailani, & Retnawati, H. (2016). Keefektifan Pemanfaatan Perangkat Pembelajaran Berbasis Masalah untuk Meningkatkan HOTS dan Karakter Siswa. Jurnal Pendidikan Dan Pembelajaran, 23(2), 111–123. http://journal.um.ac.id/index.php/pendidikan- dan-pembelajaran/article/view/10162/4849

Khoiriah, & Jalmo, T. (2020). Student Worksheet Based on Discovery Learning Combine With Assessment for Learning Higher Order Thinking Skills (AfL-HOTS) to Fostering High Level Thinking Skills of Students. The Online Journal of New Horizons in Education, 10(1), 69–77.

King, F. J., Goodson, L., & Rohani, F. (2010). Higher order thinking skills: Definition, Teaching Strategies, Assessment. http://goo. gl/su233T.

Koza Çiftçi, & Yıldız, P. (2019). The effect of gender on algebra achievement: The meta-analysis of trends in international mathematics and science study (TIMSS). Turkish Journal of Computer and Mathematics Education, 10(3), 617–627. https:// doi.org/10.16949/turkbilmat.568545

Krulik, S., & Rudnick, J. A. (1999). Innovative tasks to improve critical and creative thinking skills. In D. L. V Stiff & F. R. Curcio (Eds.), Developing Mathematical Reasong in Grades K-12 (pp. 138–145). NCTM.

Kurnia, I. A., & Retnowati, E. (2019). Efektivitas Erroneous Worked Example dan Strategi Pengelompokan pada Pembelajaran Aritmetika Sosial Ditinjau dari Kemampuan Berpikir Tingkat Tinggi. In S2 thesis, Program Pascasarjana. http://eprints.uny. ac.id/id/eprint/66457

Lehmann, M., Christensen, P., Du, X., & Thrane, M. (2008). Problem- oriented and project-based learning (POPBL) as an innovative learning strategy for sustainable development in engineering education. European Journal of Engineering Education, 33(3), 283–295. https://doi.org/10.1080/03043790802088566

Limbach, B., & Waugh, W. (2010). Developing higher level thinking. Journal of Instructional Pedagogies, 3, 9. https://aabri.com/ manuscripts/09423.pdf

Liu, S., Yang, X., Zhang, H., Wang, Y., Yoneda, T., & Li, Z. (2018). Study on teaching methods for developing higher order thinking skills for college students in flipping classroom. Proceedings - 6th International Conference of Educational Innovation Through Technology, EITT 2017, 2018-March, 254–257. https://doi.org/10.1109/EITT.2017.69

Liu, X. (2014). Essentials of Science Classroom Assessment. In Essentials of Science Classroom Assessment. Sage Publications. https://doi.org/10.4135/9781483349442

Loewen, A. C. (1995). Creative problem solving. Teaching Children Mathematics, 2(2), 96–99.

Luthfiyah, R. A., Chrisnawati, H. E., Pramesti, G., & Kuswardi, Y. (2019). Development of teaching materials to improve the student’s high order thinking skills. AIP Conference Proceedings, 2194(1), 20057. https://doi.org/10.1063/ 1.5139789

Maghfiroh, L., & Mulyani, E. (2019). Pengembangan Modul Pembelajaran Ekonomi dengan Pendekatan Problem Based Learning yang Berorientasi pada High Order Thinking Skills untuk Meningkatkan Kemampuan Berpikir Kritis dan Kreatif Peserta Didik. In S2 thesis, Program Pascasarjana. http:// eprints.uny.ac.id/id/eprint/65780

Malik, A., Setiawan, A., Suhandi, A., & Permanasari, A. (2017). Enhancing pre-service physics teachers’ creative thinking skills through HOT lab design. AIP Conference Proceedings, 1868(1), 70001. https://doi.org/10.1063/1.4995177

Mayasari, R., & Adawiyah, R. (2016). Pengaruh Model Pembelajaran Berdasarkan Masalah Pada Pembelajaran Biologi Terhadap Hasil Belajar Dan Keterampilan Berpikir Tingkat Tinggi Di Sma. Jurnal Pendidikan Biologi Indonesia, 1(3). https://doi. org/10.22219/jpbi.v1i3.2658

Miri, B., David, B. C., & Uri, Z. (2007). Purposely teaching for the promotion of higher-order thinking skills: A case of critical thinking. Research in Science Education, 37(4), 353–369. https:// doi.org/10.1007/s11165-006-9029-2

Mohd Zin Mokhtar, Rohani Ahmad Tarmizi, Ahmad Fauzi Mohd Ayub, & Nawawi, M. D. H. (2013). Motivation and Performance In Learning Calculus Through Problem-Based Learning. International Journal of Asian Social Science, 3(9), 1999–2005. http://www.aessweb.com/journal-detail. php?id=5007%0AMOTIVATION

Moseley, D., Elliott, J., Gregson, M., & Higgins, S. (2005). Thinking skills frameworks for use in education and training. British Educational Research Journal, 31(3), 367–390. https://doi. org/10.1080/01411920500082219

Najib, A. (2015). Pengaruh Peng gunaan Program Simulasi PhET dalam Pembelajaran Inkuiri Laboratorium terhadap Penguasaan Konsep dan Keterampilan Berpikir Tingkat Tinggi. https://lib.unnes.ac.id/22920/

Nyoman Setiawan, I. G. A. (2015). Pengembangan Model Asesmen Autentik Pembelajaran Ipa Kontekstual Terintegrasi Dengan Model Pengajaran Berpikir Tingkat Tinggi Sebagai Upaya Meningkatkan Kompetensi Siswa Smp. JPI (Jurnal Pendidikan Indonesia), 1(1). https://doi.org/10.23887/jpi-undiksha. v1i1.4482

Orlich, D. C., Harder, R. J., Callahan, R. C., Trevisan, M. S., & Brown, A. H. (2010). Teaching Strategies-Guide to Effective Instruction. Wadsworth Engage Learning.

Pigott, T. (2012). Advances in meta-analysis. Springer Science & Business Media.

Presseisen, B. Z. (1988). Thinking skills: Meanings and models. In D. A. L. Costa (Ed.), Developing minds: A resource book for teaching thinking (pp. 43–48). ASCD.

Puspaningtyas, N. A. (2019). Peningkatan Higher Order Thinking Skills (HOTS) Melalui Strategi Pembelajaran Peningkatan Kemampuan Berpikir (SPPKB). In Jurnal Pendidikan dan Ekonomi, (Vol. 8, Issue 2). Sekolah Pascasarjana Universitas Negeri Yogyakarta Indonesia. http://e-journal.uajy. ac.id/14649/1/JURNAL.pdf

Putri, R., & Ghufron, A. (2019). Efektivitas Strategi The Power of Two Terhadap Kecakapan Critical Thinking Siswa. In Jurnal Kependidikan: Penelitian Inovasi Pembelajaran (Vol. 3, Issue 2). Sekolah Pascasarjanan Universitas Negeri Yogyakarta Indonesia.

Rahayu, A., & Utaminingsih, R. (2017). Efektivitas Penggunaan Teknik Effective Questioning Pada Mata Kuliah Ipa 1 Untuk Meningkatkan Keterampilan Berpikir Tingkat Tinggi Mahasiswa. In SOSIOHUMANIORA: Jurnal Ilmiah Ilmu Sosial dan Humaniora (Vol. 2, Issue 1). Jurnal Ilmiah Ilmu Sosial Dan Humaniora. https://doi.org/10.30738/sosio. v2i1.491

Ramadhan, R. H. (2019). Pengembangan Komik Fisika Berbasis Kearifan Lokal Long Bumbung Berbantu Android Untuk Meningkatkan Kemampuan Representasi Fisis Dan HOTS Peserta Didik SMA Pada Materi Bunyi (Doctoral dissertation, Tesis. Sekolah Pascasarjanan Universitas Negeri Yogyakarta Indonesia.

Redhana, I. W. (2013). Model Pembelajaran Berbasis Masalah Dan Pertanyaan Socratik Untuk Meningkatkan Keterampilan Berpikir Kritis Siswa. In Jurnal Cakrawala Pendidikan (Issue 3, p. 3). https://doi.org/10.21831/cp.v0i3.1136

Retnawati, H., Apino, E., Kartianom, Djidu, H., & Anazifa, R. D. (2018). Pengantar Analisis Meta (Issue August 2019). Parama Publishing.

Retnawati, H., Djidu, H., Kartianom, Apino, E., & Anazifa, R. D. (2018). Teachers’ knowledge about higher-order thinking skills and its learning strategy. Problems of Education in the 21st Century, 76(2), 215–230. https://doi.org/10.33225/pec/18.76.215

Rochani, S. (2016). Keefektifan pembelajaran matematika berbasis masalah dan penemuan terbimbing ditinjau dari hasil belajar kognitif kemampuan berpikir kreatif. Jurnal Riset Pendidikan Matematika, 3(2), 273. https://doi.org/10.21831/jrpm.v3i2.5722

Rosida, R., Fadiawati, N., & Jalmo, T. (2017). Efektivitas Penggunaan Bahan Ajar E-Book Interaktif Dalam Menumbuhkan Keterampilan Berpikir Kritis Siswa. Jurnal Pembelajaran Fisika Universitas Lampung, 5(1), 116746.

Salam, A., & Miriam, S. (2016). Pembelajaran Berbasis Learner Autonomy Untuk Melatihkan Kemampuan Berpikir Tingkat Tinggi Mahasiswa. In Mengembangkan Keterampilan Berpikir Tingkat Tinggi Melalui Pembelajaran IPA (pp. 53–60).

Fakulatas Keguruan dan Ilmu Pendidikan Universitas Lambung Mangkurat. http://www.s2ipa.unlam.ac.id/category/ publikasi-ilmiah/proceeding/seminar-nasional-pendidikan- ipa-2016

Saputri, A. C., Sajidan, Rinanto, Y., Afandi, & Prasetyanti, N. M. (2019). Improving students’ critical thinking skills in cell- metabolism learning using Stimulating Higher Order Thinking Skills model. International Journal of Instruction, 12(1), 327–342. https://doi.org/10.29333/iji.2019.12122a

Saregar, A., Latifah, S., & Sari, M. (2016). Efektivitas Model Pembelajaran CUPs: Dampak Terhadap Kemampuan Berpikir Tingkat Tinggi Peserta Didik Madrasah Aliyah Mathla’ul Anwar Gisting Lampung. Jurnal Ilmiah Pendidikan Fisika Al-Biruni, 5(2), 233–244. https://doi.org/10.24042/jpifalbiruni.v5i2.123

Sekarini, R. P. (2019). Pengembangan perangkat pembelajaran Science Outdoor Learning Berbasis Kontekstual Untuk Meningkatkan Curiosity dan High Order Thingking Skill (HOTS) Peserta Didik SMP. Sekolah Pascasarjanan Universitas Negeri Yogyakarta Indonesia.

Silva, E. (2009). Measuring skills for 21st-century learning. Phi Delta Kappan, 90(9), 630–634. https://doi.org/10.1177/ 003172170909000905

Smart, J. B., & Marshall, J. C. (2013). Interactions Between Classroom Discourse, Teacher Questioning, and Student Cognitive Engagement in Middle School Science. Journal of Science Teacher Education, 24(2), 249–267. https://doi.org/10.1007/ s10972-012-9297-9

Stauffer, B. (2018). What are the 4 C’s of 21st century skills? In Applied Education System (pp. 1–9). https://w w w. aeseducation.com/blog/four-cs-21st-century-skills%0Ahttps:// www.aeseducation.com/careercenter21/what-are-the-4-cs-of- 21st-century-skills

Suarsana, I. M. (2013). Pengembangan E-Modul Berorientasi Pemecahan Masalah Untuk Meningkatkan Keterampilan Berpikir Kritis Mahasiswa. JPI (Jurnal Pendidikan Indonesia), 2(2). https://doi.org/10.23887/jpi-undiksha.v2i2.2171

Suleman, M., & Sugijarto, K. H. (2019). Pengembangan Media Visualisasi Tiga Dimensi 3D dengan Virtual Reality (3D-VR) Materi Laju Reaksi Terhadap Kemampuan Keterampilan Proses Sains dan Berpikir Kritis Pesrta Didik SMA. In S2 thesis, Program Pascasarjana. http://eprints.uny.ac.id/id/eprint/66744

Sumarmo, U., & Nishitani, I. (2010). High Level Mathematical Thinking: Experiments with High School and Under Graduate Students using Various Approaches and Strategies. In [Natural Sciences Edition] (Vol. 58, pp. 9–22).

Sungur, S., & Tekkaya, C. (2006). Effects of problem-based learning and traditional instruction on self-regulated learning. Journal of Educational Research, 99(5), 307–320. https://doi. org/10.3200/JOER.99.5.307-320

Tambunan, H. (2019). The Effectiveness of the Problem Solving Strategy and the Scientific Approach to Students’ Mathematical Capabilities in High Order Thinking Skills. International Electronic Journal of Mathematics Education, 14(2), 293–302. https://doi.org/10.29333/iejme/5715

Thomas, A., & Thorne, G. (2009). How to increase higher order thinking. In Metarie, LA: Center for Development and Learning. Center for Development and Learning.(accessed on 6. https:// eric.ed.gov/?id=ED421544

Thompson, T. (2008). Mathematics teachers’ interpretation of higher- order thinking in Bloom’s taxonomy. International Electronic Journal of Mathematics Education, 3(2), 96–109. http://www. iejme.com/022008/d2.pdf

Thompson, T. (2011). An Analysis of Higher-Order Thinking on Algebra I End-of Course Tests. International Journal for Mathematics Teaching and Learning, c, 1–36.

Turgut, S., & Turgut, I. G. (2018). The effects of cooperative learning on mathematics achievement in Turkey: A meta-analysis study. In International Journal of Instruction (Vol. 11, Issue 3, pp. 663–680). https://doi.org/10.12973/IJI.2018.11345A

Utomo, S. W., Joyoatmojo, S., Jutmini, S., & Suryani, N. (2019). Improving Higher Order Thinking Skills Through Problem Based Learning with a Scientific Approach. Dinamika Pendidikan, 14(1), 76–86. https://doi.org/10.15294/dp.v14i1.18776

Vidergor, H. E., & Krupnik-Gottlieb, M. (2015). High order thinking, problem based and project based learning in blended learning environments. In Applied Practice for Educators of Gifted and Able Learners (pp. 217–232). Brill Sense. https://doi. org/10.1007/978-94-6300-004-8_11

Wardani, I. (2019). Keefektifan Model Guided Inquiry dengan Pendekatan Percobaan Awal terhadap Kemampuan Berpikir Kritis dan Keterampilan Proses Sains Siswa SMA Kelas X Pada Materi Fungi. http://eprints.uny.ac.id/id/eprint/65623

Widiyowati, I. I. (2014). Inovasi Program Pembelajaran Keterampilan Berpikir Kritis Melalui Model Pembelajaran Konstekstual Pada. Seminar Nasional Kimia Kalimantan Timur. https://repository. unej.ac.id/handle/123456789/59395

Yusuf. (2019). Desertasi: Model Pembelajaran Higher Order Thinking Skills pada Siswa Sekolah Menengah Kejuruan. Sekolah Pascasarjanan Universitas Negeri Yogyakarta Indonesia. https://eprints.uny.ac.id/67798/