Exploring Secondary School Students’ Interest and Mastery of Atomic Structure and Chemical Bonding through ChatGPT

Authors

  • Aloys Iyamuremye African Center of Excellence for Innovative Teaching and Learning Mathematics and Science (ACEITLMS), University of Rwanda College of Education (URCE), Kayonza, P.O. Box 55 Rwamagana, Rwanda; Kigali Independent University (ULK), 102 KG 14 Ave, Kigali, Rwanda Author https://orcid.org/0000-0003-3968-8757
  • Kizito Ndihokubwayo Iowa State University (ISU), Ames, IA 50011, United States Author https://orcid.org/0000-0002-2566-8045

DOI:

https://doi.org/10.58197/prbl/9hk37296

Keywords:

Chatbot, artificial intelligence, atomic structure, chemical bonding, conceptual understanding, interest, ChatGPT

Abstract

This research explored the impact of using ChatGPT, a chatbot-assisted artificial intelligence (AI), on students’ interest and conceptual understanding of atomic structure and chemical bonding. A total of 92 senior and two secondary students, including 61 male and 31 female students from Rwanda, were randomly selected to participate in the study. The study used a sequential explanatory research design to collect and analyze data. A pre and post-achievement test was used to collect quantitative before and after using ChatGPT. On the other hand, focus group discussion was used to collect qualitative data to explore students’ interest in using chatbots. Repeated measure ANOVA was used to analyze quantitative data from achievement tests, while thematic analysis was used to analyze qualitative data from focus group discussions. The results revealed that the generated response from the use of chatbot-AI is an effective method to supplement other active methods of teaching and learning atomic structure and chemical bonding. In this regard, the students’ performance increased by 16.6% after the use of chatbot-AI. However, the study did not find a statistically significant difference between male and female students after using ChatGPT. Thematic analysis revealed three overarching themes. In this line, the use of ChatGPT stimulates students’ engagement and interactivity, curiosity and motivation, and enhanced learning experience. Educators and policymakers were recommended to integrate this technology into the curriculum to supplement other active teaching and learning pedagogies.

 

References

Bareis, J. en Katzenbach, C. (2022) “Talking AI into being: The narratives and imaginaries of national AI strategies and their performative politics”, Science, Technology, & Human Values, 47(5), bll 855–881.

Choudhary, N., Bharti, R. en Sharma, R. (2022) “Role of artificial intelligence in chemistry”, Materials Today: Proceedings, 48, bll 1527–1533.

Clark, T.M. (2023) “Investigating the Use of an Artificial Intelligence Chatbot with General Chemistry Exam Questions”, Journal of Chemical Education, 100(5), bll 1905–1916. Available at: https://doi.org/10.1021/acs.jchemed.3c00027.

Creswell, J.W. (2014) Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 4th ed. New Delhi: SAGE Publications Ltd. Available at: https://doi.org/ISBN: 978-1-4522-2609-5.

Al Darayseh, A. (2023) “Acceptance of artificial intelligence in teaching science: Science teachers’ perspective”, Computers and Education: Artificial Intelligence, 4, bl 100132.

Giam, N.M. en Thanh, N.T. (2022) “The Process of Developing AI Chatbot Scenario for Teaching Chemistry”, bll 96–110.

Jasin, J. et al. (2023) “The implementation of chatbot-mediated immediacy for synchronous communication in an online chemistry course”, Education and Information Technologies, 28(8), bll 10665–10690. Available at: https://doi.org/10.1007/s10639-023-11602-1.

Lolinco, A.T. en Holme, T.A. (2023) “Developing a curated chatbot as an exploratory communication tool for chemistry learning”. ACS Publications.

Mahaffy, P. (2004) “The future shape of chemistry education”, Chemistry Education Research and Practice, 5(3), bll 229–245.

Mahroof, A. et al. (2020) “An AI Based Chatbot to Self-Learn and Self-Assess Performance in Ordinary Level Chemistry”, in 2020 2nd International Conference on Advancements in Computing (ICAC), bll 216–221. Available at: https://doi.org/10.1109/icac51239.2020.9357131.

Nguyen, T. en Sirichokcharoenkun, Y. (2023) “The Limitations and Potential of ChatGPT in Chemistry Education”, (September), bll 1–23.

Nja, C. (2023) “Relationship Between Chatbots and AI-Powered Gamification on Chemistry Students ’ Motivation”, (August).

Park, E.J. et al. (2009) “Identifying Atomic Structure as a Threshold Concept : Student mental models and troublesomeness Identifying Atomic Structure as a Threshold Concept : Student mental models and troublesomeness”, (November 2012), bll 37–41. Available at: https://doi.org/10.1080/09500690701675880.

Suryelita, S., Guspatni, G. en Defriati, P. (2019) “Description of learning difficulties on atomic structure and periodic table topics of tenth grade students in SMAN 7 Padang”, Journal of Physics: Conference Series, 1317(1). Available at: https://doi.org/10.1088/1742-6596/1317/1/012147.

Talanquer, V. (2023) “Interview with the Chatbot: How Does It Reason?”, Journal of Chemical Education, 100(8), bll 2821–2824. Available at: https://doi.org/10.1021/acs.jchemed.3c00472.

Tsaparlis, G. (1997) “Atomic orbitals, molecular orbitals and related concepts: Conceptual difficulties among chemistry students”, Research in Science Education, 27(2), bll 271–287. Available at: https://doi.org/10.1007/BF02461321.

Watts, F.M. et al. (2023) “Comparing Student and Generative Artificial Intelligence Chatbot Responses to Organic Chemistry Writing-to-Learn Assignments”, Journal of Chemical Education [Preprint]. Available at: https://doi.org/10.1021/acs.jchemed.3c00664.

Downloads

Published

2024-04-01

Issue

Section

Science

How to Cite

Exploring Secondary School Students’ Interest and Mastery of Atomic Structure and Chemical Bonding through ChatGPT. (2024). Educational Journal of Artificial Intelligence and Machine Learning, 1(1), 1-13. https://doi.org/10.58197/prbl/9hk37296