Evaluating the Quality of Objective and Essay Tests in Cognitive Assessment
DOI:
https://doi.org/10.58485/elrusyd.v10i2.492Keywords:
Cognitive assessment, assessment instruments, learning evaluationAbstract
Cognitive evaluation instruments are essential tools for systematically and objectively measuring students’ thinking abilities. This study analyzes two primary types of cognitive assessment instruments objective tests and essay tests by evaluating their quality based on established indicators of validity and reliability. The purpose of this research is to examine how effectively these instruments measure cognitive performance across different levels of thinking skills. This study employs a qualitative research method with a content analysis approach, which involves reviewing, selecting, and analyzing scholarly literature, including textbooks, empirical studies, and theoretical documents related to test construction, validity, and reliability. The content analysis reveals that the cognitive domain encompasses mental processes such as problem-solving, reasoning, and the integration of conceptual knowledge. Written cognitive test instruments generally consist of essay tests (restricted and extended response) and objective tests (true–false, multiple-choice, matching, and completion). The findings demonstrate that the overall quality of cognitive evaluation instruments is largely determined by their validity and reliability, which serve as critical benchmarks for ensuring the accuracy and consistency of cognitive measurement.
References
Aran, D. (2024). Helping Future Schoolteachers Discover and Teach Soil: An Example of Project-Based Learning. Spanish Journal of Soil Science, 14. https://doi.org/10.3389/sjss.2024.12280
Asril, Z., Syafril, S., Engkizar, E., & Arifin, Z. (2023). Advancing Educational Practices: Implementation and Impact of Virtual Reality in Islamic Religious Education. Jurnal Pendidikan Islam, 9(2), 199–210. https://doi.org/10.15575/jpi.v9i2.20567
Babullah, R. (2022). Teori Perkembangan Kognitif Jean Piaget dan Penerapannya dalam Pembelajaran. Epistemic: Jurnal Ilmiah Pendidikan, 1(2), 131–152. https://doi.org/10.70287/epistemic.v1i2.10
Baker, H. K., Kumar, S., & Pandey, N. (2020). A bibliometric analysis of managerial finance: a retrospective. Managerial Finance, 46(11), 1495–1517. https://doi.org/10.1108/MF-06-2019-0277
Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. ASCD.
Brookhart, S. M. (2013). Grading and group work: How do I assess individual learning? ASCD.
Brookhart, S. M. (2018). How to create and use rubrics for formative assessment and grading. ASCD.
Burton, R. F. (2005). Multiple-choice and true/false tests: Myths and misconceptions. Assessment & Evaluation in Higher Education, 30(1), 65–72. https://doi.org/10.1080/026029304200324390
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org/10.1037/0021-9010.78.1.98
Djihadah, N., Wasliman, I., Mulyanto, A., & Fatkhullah, F. K. (2023). Literary Teaching Based on Information and Communication Technology (ICT): An Inquiry Approach. Theory and Practice in Language Studies, 13(6), 1556–1563. https://doi.org/10.17507/tpls.1306.25
Downing, S. M. (2005). The effects of guessing on multiple-choice reliability. Applied Measurement in Education, 18(2), 115–127. https://doi.org/10.1207/s15324818ame1802_2
Engkizar, E., Jaafar, A., Sarianto, D., Ayad, N., Rahman, A., Febriani, A., Oktavia, G., Guspita, R., & Rahman, I. (2024). Analysis of Quran Education Problems in Majority Muslim Countries. International Journal of Islamic Studies Higher Education, 3(1), 65–80. https://doi.org/https://doi.org/10.24036/insight.v3i1.209
Engkizar, E, Jaafar, A., Masuwd, M. A., Rahman, I., Datres, D., Taufan, M., Akmal, F., Dasrizal, D., Oktavia, G., Yusrial, Y., & Febriani, A. (2025). Challenges and Steps in Living Quran and Hadith Research: An Introduction. International Journal of Multidisciplinary Research of Higher Education (IJMURHICA, 8(3), 426–435. https://doi.org/10.24036/ijmurhica.v8i3.396
Engkizar, Engkizar, Jaafar, A., Taufan, M., Rahman, I., Oktavia, G., & Guspita, R. (2023). Quran Teacher: Future Profession or Devotion to the Ummah? International Journal of Multidisciplinary Research of Higher Education (IJMURHICA), 6(4), 196–210. https://doi.org/https://doi.org/10.24036/ijmurhica.v6i4.321
Engkizar, Engkizar, Muslim, H., Mulyadi, I., & Putra, Y. A. (2025). Ten Criteria for an Ideal Teacher to Memorize the Quran. Journal of Theory and Research Memorization Quran, 1(1), 26–39. https://joqer.intischolar.id/index.php/joqer
Eriyanti, R. W., Cholily, Y. M., & Masduki, M. (2022). Meningkatkan Kreativitas Guru dalam Inovasi Pembelajaran Berbasis HOTS untuk Mengembangkan Berpikir Ktitis dan Kreatif Siswa. To Maega : Jurnal Pengabdian Masyarakat, 5(3), 416. https://doi.org/10.35914/tomaega.v5i3.1176
Gulikers, J., Bastiaens, T., & Kirschner, P. (2004). A five-dimensional framework for authentic assessment. Educational Technology Research and Development, 52(3), 67–86. https://doi.org/10.1007/BF02504676
Haladyna, T. M., & Rodriguez, M. C. (2013). Developing and validating test items (3rd ed.). Routledge. https://doi.org/10.4324/9780203850381
Htay, S. S., Po, E. T. H., & Kaewkanlaya, P. (2025). Building Student Character through Worship in Elementary Schools. Muaddib: Journal of Islamic Teaching and Learning, 1(2), 55–63. https://doi.org/https://muaddib.intischolar.id/index.php/muaddib/article/view/11
Imam, H., Hikmawati, Kosim, & Taufik, M. (2022). Pengaruh Model Pembelajaran Kooperatif Tipe Numbered Heads Together (NHT) Terhadap Hasil Belajar Siswa Kelas X SMAN 1 Sanggar Tahun Pelajaran 2021/2022. Jurnal Pendidikan Fisika Dan Teknologi, 8(SpecialIssue), 58–66. https://doi.org/10.29303/jpft.v8iSpecialIssue.3715
Jami, D. Z., & Muharam, A. (2022). Strategy for Improving the Quality of Islamic Religious Education Study Programs with Total Quality Management. Nidhomul Haq : Jurnal Manajemen Pendidikan Islam, 7(2), 267–283. https://doi.org/10.31538/ndh.v7i2.2096
Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144. https://doi.org/10.1016/j.edurev.2007.05.002
Kassymova, G. K., Talgatov, Y. K., Arpentieva, M. R., Abishev, A. R., & Menshikov, P. V. (2025). Artificial Intelligence in the Development of the Theory and Practices of Self-Directed Learning. Multidisciplinary Journal of Thought and Research, 1(3), 66–79. https://mujoter.intischolar.id/index.php/mujoter/article/view/19
Langputeh, S., Andika, S., Ulfah, O., & Agusti, F. A. (2023). A Content Analysis: Values of Islamic Marriage in the Movie of Ayat-Ayat Cinta. International Journal of Multidisciplinary Research of Higher Education, 6(3), 106–114. https://doi.org/10.24036/ijmurhica.v6i3.142
McMillan, J. H. (2013). Why we need research on classroom assessment. Journal of Educational Measurement, 50(4), 498–503. https://doi.org/10.1111/jedm.12044
Muthatahirin, M., Hanjit, C., Aminudin, W. S. A. B. W., & Nasir, A. A. B. A. (2025). Exploring Activities of International Dormitory Students to Advance Social Intelligence. Journal of International Affairs and Students Mobility, 1(1), 17–28. https://doi.org/https://jiasmy.intischolar.id/index.php/jiasmy/article/view/2
Mutiaramses, M., Alkhaira, S., Zuryanty, Z., & Kharisna, F. (2025). Seven Motivations for Students Choosing to Major in Elementary School Teacher Education in Higher Education. Multidisciplinary Journal of Thought and Research, 1(2), 23–37. https://mujoter.intischolar.id/index.php/mujoter/article/view/14
Nitko, A. J., & Brookhart, S. M. (2014). Educational assessment of students (7th ed.). Pearson.
Pellegrini, M., Lake, C., Neitzel, A., & Slavin, R. E. (2021). Effective Programs in Elementary Mathematics: A Meta-Analysis. AERA Open, 7. https://doi.org/10.1177/2332858420986211
Pohontsch, N. J. (2019). Qualitative Content Analysis. Rehabilitation (Germany), 58(6), 413–418. https://doi.org/10.1055/a-0801-5465
Popham, W. J. (2017). Classroom assessment: What teachers need to know. Pearson.
Rahman, F. A., Ulwi, K., & Aminudin, W. S. A. B. W. (2025). The Role of Islamic Education in Realizing in Sustainable Development Goals (SDGs 3). Muaddib: Journal of Islamic Teaching and Learning, 1(2), 12–23. https://doi.org/https://muaddib.intischolar.id/index.php/muaddib/article/view/7
Roberts, R. E. (2020). Qualitative interview questions: Guidance for novice researchers. Qualitative Report, 25(9), 3185–3203. https://doi.org/10.46743/2160-3715/2020.4640
Rodriguez, M. C. (2003). Constructed-response vs. multiple-choice tests: A review of the literature. Practical Assessment, Research & Evaluation, 8(1), 1–13. https://doi.org/10.7275/4m7k-0f52
Roller, M. R. (2019). A quality approach to qualitative content analysis: Similarities and differences compared to other qualitative methods. Forum Qualitative Sozialforschung, 20(3). https://doi.org/10.17169/fqs-20.3.3385
Stiggins, R. J. (2014). Revolutionize assessment: Empower students, inspire learning. Corwin Press.
Stoltz, T., Weger, U., & da Veiga, M. (2024). Consciousness and education: contributions by Piaget, Vygotsky and Steiner. Frontiers in Psychology, 15. https://doi.org/10.3389/fpsyg.2024.1411415
Syafril, S. (2021). Learning Content and Process for Academically Talented Students. Asian Social Science and Humanities Research Journal (ASHREJ), 3(1), 73–81. https://doi.org/10.37698/ashrej.v3i1.64
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
Wakifah, W., Fatimah, F., & Sulistiawati, M. (2023). Optimization of Higher-Order Thinking Skills (HOTS) in Islamic Education towards the Era of Society 5.0. Didaktika : Jurnal Kependidikan, 17(2), 55–63. https://doi.org/10.30863/didaktika.v17i2.5750
Yulastri, A., Hidayat, H., Ganefri, G., Edya, F., & Islami, S. (2018). Learning outcomes with the application of product based entrepreneurship module in vocational higher education. Jurnal Pendidikan Vokasi, 8(2), 120. https://doi.org/10.21831/jpv.v8i2.15310
