Artificial Intelligence Chatbots for Enhancing Higher Order Thinking Skills in Islamic Education

Authors

  • Silvie Afifatuz Zulfah Institut Agama Islam YPBWI Surabaya, Indonesia
  • Nur Fitriyanti Institut Agama Islam YPBWI Surabaya, Indonesia

DOI:

https://doi.org/10.58485/jie.v5i2.821

Keywords:

Artificial intelligence, educational chatbot, higher order thinking skills, Islamic education

Abstract

The development of Artificial Intelligence (AI) has created opportunities for developing more adaptive, interactive, and student-centered learning. However, empirical evidence on the use of AI-powered educational chatbots to support Higher Order Thinking Skills (HOTS) in Islamic Education at the junior high school level remains limited. This study aimed to analyze the differences in students’ HOTS between learning supported by an AI-powered educational chatbot and conventional learning. The study employed a quantitative approach using a quasi-experimental method and a pretest-posttest control group design. The sample consisted of 64 eighth-grade students selected using cluster random sampling, with 32 students in the experimental group and 32 students in the control group. Data were collected through HOTS tests, observation sheets, student response questionnaires, and documentation. Data analysis included descriptive statistics, normality and homogeneity tests, an Independent Samples t-test, Normalized Gain (N-Gain), and effect size analysis using IBM SPSS Statistics. The results showed that the experimental group achieved a significantly higher HOTS posttest score (M = 85.47) than the control group (M = 74.16; p < .001). The increase in HOTS was also higher in the experimental group, as indicated by an N-Gain score of 0.64 compared with 0.35 in the control group, with a Cohen’s d effect size of 1.96. These findings indicate that the use of an AI-powered educational chatbot was associated with improved HOTS, particularly in analysis, evaluation, and creation. The use of chatbots to support interaction, provide feedback, and facilitate the exploration of contextual problems has potential as an innovative learning medium for Islamic Education.

Downloads

Download data is not yet available.

References

Adiyono, A., Fadhilatunnisa, A., Rahmat, N. A., & Munawarroh, N. (2022). Skills of Islamic Religious Education teachers in class management. Al-Hayat: Journal of Islamic Education, 6(1), 104. https://doi.org/10.35723/ajie.v6i1.229

Agustini, A., & W, U. R. (2021). Strategies of Islamic Religious Education teachers in the development of teaching materials. Al-Hayat: Journal of Islamic Education, 5(2), 206. https://doi.org/10.35723/ajie.v5i2.186

Ahmed, A. (2020). Between “Islamic” and “un-Islamic”: Navigating religion at an American Islamic high school. Religious Education, 115(4), 384–399. https://doi.org/10.1080/00344087.2020.1729682

Alhashmi, M., & Moussa-Inaty, J. (2021). Professional learning for Islamic education teachers in the UAE. British Journal of Religious Education, 43(3), 278–287. https://doi.org/10.1080/01416200.2020.1853046

Alouzi, K., Atia, A., Omran, S., Alrumayh, S., Albshkar, H., Alatrish, E., Masuwd, M., & Alfallah, B. (2026). AI and cultural sensitivity: Student perceptions of how AI handles religion, identity, and tradition in texts. Muaddib: Journal of Islamic Teaching and Learning, 2(1), 1–21.

Arif, M., & Aziz, M. K. N. A. (2023). Islamic Religious Education learning model in the 21st century: Systematic literature review. Indonesian Journal of Islamic Education Studies (IJIES), 6(2), 237–262. https://doi.org/10.33367/ijies.v6i2.4417

Armstrong, C. S., & Kepler, J. D. (2018). Theory, research design assumptions, and causal inferences. Journal of Accounting and Economics, 66(2–3), 366–373. https://doi.org/10.1016/j.jacceco.2018.08.012

Baroud, N., Ardila, Y., Akmal, F., & Sabrina, R. (2025). Opportunities and challenges for Islamic education teachers in using Artificial Intelligence in learning. Muaddib: Journal of Islamic Teaching and Learning, 1(2), 1–11. https://muaddib.intischolar.id/index.php/muaddib/article/view/6

Chaokromthong, K., & Sintao, N. (2021). Sample size estimation using Yamane and Cochran and Krejcie and Morgan and green formulas and Cohen statistical power analysis by G*Power and comparisons. Apheit International Journal of Interdisciplinary Social Sciences and Technology, 10(2), 76–86. https://so04.tci-thaijo.org/index.php/ATI/article/view/254253

Chapman, S. J. (2018). Review of Discovering Statistics Using IBM SPSS Statistics, 4th Edition. Journal of Political Science Education, 14(1), 145–147. https://doi.org/10.1080/15512169.2017.1366328

Engkizar, E., Jaafar, A., Sarianto, D., Ayad, N., Rahman, A., Febriani, A., Oktavia, G., Guspita, R., & Rahman, I. (2024). Analysis of Quran education problems in majority Muslim countries. International Journal of Islamic Studies Higher Education, 3(1), 65–80. https://doi.org/10.24036/insight.v3i1.209

Engkizar, E., Jaafar, A., Hamzah, M. I., Syafril, S., Ediz, M. H., Efendi, E., Ridha, A., Febriani, A., & Oktavia, G. (2026). Tartil method as an effective pedagogical approach for enhancing students’ interest in Quranic learning. International Journal of Multidisciplinary Research of Higher Education (IJMURHICA), 9(1). https://doi.org/10.24036/ijmurhica.v9i1.637

Engkizar, E., Jaafar, A., Hamzah, M. I., Syafril, S., Febriani, A., Oktavia, G., & Satrial, A. (2026). Quran teachers’ skills as pedagogical foundations: Conceptual and practical insights into nine competencies. Muaddib: Journal of Islamic Teaching and Learning, 2(1), 22–38.

Essabane, K., Vermeer, P., & Sterkens, C. (2022). Islamic Religious Education and citizenship education: Their relationship according to practitioners of primary Islamic Religious Education in the Netherlands. Religions, 13(9). https://doi.org/10.3390/rel13090826

Flannelly, K. J., Flannelly, L. T., & Jankowski, K. R. B. (2018). Threats to the internal validity of experimental and quasi-experimental research in healthcare. Journal of Health Care Chaplaincy, 24(3), 107–130. https://doi.org/10.1080/08854726.2017.1421019

Godazgar, H. (2025). Exploring ‘diversity’ and ‘pluralism’: A sociological analysis of religious education textbooks in the ‘Islamic Republic’ of Iran. British Journal of Religious Education, 47(4), 465–484. https://doi.org/10.1080/01416200.2025.2451031

Hair, J., & Alamer, A. (2022). Partial least squares structural equation modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics, 1(3), 100027. https://doi.org/10.1016/j.rmal.2022.100027

Han, C. (2018). Quantitative research methods in translation and interpreting studies. The Interpreter and Translator Trainer, 12(2), 244–247. https://doi.org/10.1080/1750399X.2018.1466262

Holec, V., & Marynowski, R. (2020). Does it matter where you teach? Insights from a quasi-experimental study on student engagement in an active learning classroom. Teaching & Learning Inquiry, 8(2), 140–164. https://doi.org/10.20343/teachlearninqu.8.2.10

Hoque, U. S., Akhter, N., Absar, N., Khandaker, M. U., & Al-Mamun, A. (2023). Assessing service quality using SERVQUAL model: An empirical study on some private universities in Bangladesh. Trends in Higher Education, 2(1), 255–269. https://doi.org/10.3390/higheredu2010013

Huda, M. (2024). Strengthening religious moderation through the core values of Islamic boarding school education. Al-Hayat: Journal of Islamic Education, 8(2). https://doi.org/10.35723/ajie.v8i2.458

Khoiroh, U., & Anam, S. (2026). Analisis teknik sampling dalam penelitian kuantitatif dan pengaruhnya terhadap kualitas data. Jurnal Pendidikan Sosial dan Humaniora, 5(1), 1418–1424. https://publisherqu.com/index.php/pediaqu/article/view/3914

Kholidah, L. N. (2022). Improving students’ social responsibility via Islamic Religious Education and social problem-based learning. Jurnal Pendidikan Agama Islam (Journal of Islamic Education Studies), 10(2), 163–182. https://doi.org/10.15642/jpai.2022.10.2.163-182

Kibtiyah, A., Idawati, K., & Muaz, Y. A. (2025). Collaboration on local wisdom-based character education between schools and parents of students in Islamic Religious Education units. Al-Hayat: Journal of Islamic Education, 9(2), 458–475. https://doi.org/10.35723/ajie.v9i2.175

Kolb, J. (2023). Muslim diversity, religious formation and Islamic religious education: Everyday practical insights into Muslim parents’ concepts of religious education in Austria. British Journal of Religious Education, 45(2), 172–185. https://doi.org/10.1080/01416200.2021.1911787

Komalasari, M., & Yakubu, A. B. (2023). Implementation of student character formation through Islamic Religious Education. At-Tadzkir: Islamic Education Journal, 2(1), 52–64. https://doi.org/10.59373/attadzkir.v2i1.16

Ma’arif, M. A., Rofiq, M. H., & Sirojuddin, A. (2022). Implementing learning strategies for moderate Islamic Religious Education in Islamic higher education. Jurnal Pendidikan Islam, 8(1), 75–86. https://doi.org/10.15575/jpi.v8i1.19037

Makridakis, S. (2017). The forthcoming Artificial Intelligence (AI) revolution: Its impact on society and firms. Futures, 90, 46–60. https://doi.org/10.1016/j.futures.2017.03.006

Mengistu, M. A., Worku, M. Y., & Melesse, T. (2024). Examining the impact of lesson study on teachers’ professional development: A quasi-experimental study. Bahir Dar Journal of Education, 24(1), 25–36. https://doi.org/10.4314/bdje.v24i1.3

Mustafy, T., & Rahman, M. T. U. (2024). SPSS. In Statistics and data analysis for engineers and scientists (pp. 135–180). https://doi.org/10.1007/978-981-99-4661-7_4

Putkonen, N., & Poulter, S. (2023). Balancing differences through highlighting the common: Religious Education teachers’ perceptions of the diversity of Islam in Islamic Religious Education in Finnish state schools. Religions, 14(8). https://doi.org/10.3390/rel14081069

Rokeman, N. R. M. (2024). Likert measurement scale in education and social sciences: Explored and explained. EDUCATUM Journal of Social Sciences, 10(10), 77–88. https://doi.org/10.37134/ejoss.vol10.1.7.2024

Saada, N., & Magadlah, H. (2021). The meanings and possible implications of critical Islamic religious education. British Journal of Religious Education, 43(2), 206–217. https://doi.org/10.1080/01416200.2020.1785844

Sari Hernawati, Hafizh, M., & Muhammad Nur Faizi Arya. (2024). Adjusting the ideal Islamic Religious Education curriculum to the development of AI-based technology. Progresiva: Jurnal Pemikiran dan Pendidikan Islam, 13(1), 129–144. https://doi.org/10.22219/progresiva.v13i01.32931

Shapiro, L. N., Gray, M. F., Freitag, C., Taneja, P., Kariya, H., Crane, P. K., O’Hare, A. M., Vig, E. K., & Taylor, J. S. (2023). Expanding the ethnographic toolkit: Using medical documents to include kinless older adults living with dementia in qualitative research. Journal of Aging Studies, 65, 101140. https://doi.org/10.1016/j.jaging.2023.101140

Shofiyyah, N. A., Lesmana, O., & Tohari, H. (2024). Metamorphosis of Islamic Religious Education learning method: Classic approach converted by Artificial Intelligence (AI). Jurnal Pendidikan: Riset dan Konseptual, 8(2), 265. https://doi.org/10.28926/riset_konseptual.v8i2.998

Suaidi, S., Faridi, F., & Sunarto, S. (2025). Technology-based digitalization of Islamic Religious Education. Halaqa: Islamic Education Journal, 9(2). https://doi.org/10.21070/halaqa.v9i2.1734

Sutrisno, S., & Nasucha, J. A. (2022). Islamic Religious Education project-based learning model to improve student creativity. At-Tadzkir: Islamic Education Journal, 1(1), 13–22. https://doi.org/10.59373/attadzkir.v1i1.3

Ter Avest, I., Bakker, C., & Franken, L. (2021). Islamic religious education in the Netherlands. In Islamic religious education in Europe: A comparative study (pp. 179–195). Taylor & Francis. https://doi.org/10.4324/9780429331039-11

Tuna, M. H. (2022). The professionalisation of Islamic religious education teachers. British Journal of Religious Education, 44(2), 188–199. https://doi.org/10.1080/01416200.2021.1999905

Wakhidah, N., & Erman, E. (2022). Examining environmental education content on Indonesian Islamic religious curriculum and its implementation in life. Cogent Education, 9(1). https://doi.org/10.1080/2331186X.2022.2034244

Downloads

Published

2026-08-28

How to Cite

Zulfah, S. A. ., & Fitriyanti, N. (2026). Artificial Intelligence Chatbots for Enhancing Higher Order Thinking Skills in Islamic Education. Ahlussunnah: Journal of Islamic Education, 5(2), 1300–1314. https://doi.org/10.58485/jie.v5i2.821

Issue

Section

Articles