Document Type : Research Paper
Authors
1 Department of English language, Bushehr Branch, Islamic Azad University, Bushehr, Iran
2 Assistant Professor in TEFL, Bushehr branch, Islamic Azad university, Bushehr, Iran
Abstract
Recently, the use of chatbots in language learning has attracted considerable attention. However, there is a scarcity of investigations delving into the impact of chatbots on enhancing EFL learners’ speaking in the light of their learning adaptability. Consequently, this research examined the effectiveness of integrating chatbots on the speaking performance of EFL learners possessing varying levels of learning adaptability. To this aim, initially, a learning adaptability scale was administered to a group of 108 EFL learners, from whom 36 individuals exhibiting the highest adaptability scores and another 36 with the lowest scores were identified. Subsequently, both groups received a speaking pretest. Following this, the groups engaged in 12 sessions of speaking practice utilizing a chatbot. After the intervention, both groups took a speaking posttest. Furthermore, 15 participants from each group participated in semi-structured interviews. The results of One-way ANCOVA revealed that the group with high learning adaptability surpassed their counterparts with low adaptability in speaking performance. The qualitative analysis results indicated that while the high adaptability group exhibited predominantly positive attitudes towards utilizing chatbots, the low adaptability group primarily expressed negative perceptions. The findings are discussed, and implications for language teaching and learning are provided.
Keywords
Main Subjects
Akpan, I. J., Kobara, Y. M., Owolabi, J., Akpan, A. A., & Offodile, O. F. (2024). Conversational and generative artificial intelligence and human–chatbot interaction in education and research. International Transactions in Operational Research, 1, 1-31. https://doi.org/10.1111/itor.13522
Al-Tamimi, N. O., Abudllah, N., & Bin-Hady, W. R. A. (2020). Teaching speaking skill to EFL college students through task-based approach: Problems and improvement. British Journal of English Linguistics, 8(2), 113-130.
Anh, L. T. Q. (2024). AI chatbots in English language learning: A critical review. Journal of Knowledge Learning and Science Technology, 3(2), 185-195. https://doi.org/10.60087/jklst.vol3.n2.p195
Barrot, J. S. (2024). ChatGPT as a language learning tool: An emerging technology report. Technology, Knowledge and Learning, 29(2), 1151-1156. https://doi.org/10.1007/s10758-023-09711-4
Bell, B. S., & Kozlowski, S. W. (2008). Active learning: Effects of core training design elements on self-regulatory processes, learning, and adaptability. Journal of Applied Psychology, 93(2), 296- 316.
Bergdahl, N., Nouri, J., & Fors, U. (2020). Disengagement, engagement and digital skills in technology-enhanced learning. Education and Information Technologies, 25(2), 957-983. https://doi.org/10.1007/s10639-019-09998-w
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa
Cai, C., & Hu, H. (2024). The online learning adaptability and its influencing factors for low-proficiency English learners in China. Journal of Language Teaching, 4(2), 1-10. https://doi.org/10.54475/jlt.2024.005
Chang, D. H., Lin, M. P. C., Hajian, S., & Wang, Q. Q. (2023). Educational design principles of using AI chatbot that supports self-regulated learning in education: Goal setting, feedback, and personalization. Sustainability, 15(17), 12921. https://doi.org/10.3390/su151712921
Chen, C., Shen, Y., Zhu, Y., Xiao, F., Zhang, J., & Ni, J. (2023). The effect of academic adaptability on learning burnout among college students: The mediating effect of self-esteem and the moderating effect of self-efficacy. Psychology Research and Behavior Management, 16, 1615–1629. https://doi.org/10.2147/PRBM.S408591
Chen, Y. C. (2024). Effects of technology-enhanced language learning on reducing EFL learners’ public speaking anxiety. Computer Assisted Language Learning, 37(4), 789-813. https://doi.org/10.1080/09588221.2022.2055083
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale.
Cutrer, W. B., Miller, B., Pusic, M. V., Mejicano, G., Mangrulkar, R. S., Gruppen, L. D., ... & Moore Jr, D. E. (2017). Fostering the development of master adaptive learners: a conceptual model to guide skill acquisition in medical education. Academic Medicine, 92(1), 70-75. https://doi.org/10.1097/ACM.0000000000001323
Duffy, T. M. (2010). Achieving adaptability through inquiry based learning. US Army Research Institute for the Behavioral and Social Sciences.
Fakher Ajabshir, Z. (2023). A review of the affordances and challenges of artificial intelligence technologies in second language learning. Technology Assisted Language Education, 1(4), 111-130. https://doi.org/10.22126/tale.2024.10104.1028
Feroz Khan, A. B., & Samad, S. R. A. (2024). Evaluating online learning adaptability in students using machine learning-based techniques: A novel analytical approach. Education Science and Management, 2(1), 25-34.
Gilead, T., & Dishon, G. (2022). Rethinking future uncertainty in the shadow of COVID 19: Education, change, complexity and adaptability. Educational Philosophy and Theory, 54(6), 822-833. https://doi.org/10.1080/00131857.2021.1920395
Guest, G., Bunce, A., & Johnson, L. (2006). How many interviews are enough? An experiment with data saturation and variability. Field Methods, 18, 59-62. https://doi.org/10.1177/1525822X05279903
Hew, K. F., Huang, W., Du, J., & Jia, C. (2023). Using chatbots to support student goal setting and social presence in fully online activities: Learner engagement and perceptions. Journal of Computing in Higher Education, 35(1), 40-68. https://doi.org/10.1007/s12528-022-09338-x
Hinkel, E. (2017). Teaching speaking in integrated‐skills classes. In J. I. Liontas (Ed.), The TESOL encyclopedia of English language teaching (pp. 1-6). Wiley. https://doi.org/10.1002/9781118784235.eelt0256
Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Addison-Wesley. https://doi.org/10.3390/su13147665
Hsieh, H. F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687
Hsu, M. H., Chen, P. S., & Yu, C. S. (2023). Proposing a task-oriented chatbot system for EFL learners speaking practice. Interactive Learning Environments, 31(7), 4297-4308. https://doi.org/10.1080/10494820.2021.1960864
Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot‐supported language learning. Journal of Computer Assisted Learning, 38(1), 237-257. https://doi.org/10.1017/S0958344022000039
Hussain, T., Yu, L., Asim, M., Ahmed, A., & Wani, M. A. (2024). Enhancing e-learning adaptability with automated learning style identification and sentiment analysis: A hybrid deep learning approach for smart education. Information, 15(5), 277. https://doi.org/10.3390/info15050277
Hwang, W. Y., Guo, B. C., Hoang, A., Chang, C. C., & Wu, N. T. (2022). Facilitating authentic contextual EFL speaking and conversation with smart mechanisms and investigating its influence on learning achievements. Computer Assisted Language Learning, 37(7), 1632-1658. https://doi.org/10.1080/09588221.2022.2095406
Jiao, T., Zhang, L., & Cheng, Y. (2021). The role of learning adaptability and motivation in foreign language achievement. Frontiers in Psychology, 12, 687128.
Jung, S. K. (2019). Introduction to popular mobile chatbot platforms for English learning: Trends and issues. STEM Journal, 20(2), 67-90. https://doi.org/10.16875/stem.2019.20.2.67
Karyotaki, M., Drigas, A., & Skianis, C. (2024). Mobile/vr/robotics/iot-based chatbots and intelligent personal assistants for social inclusion. International Journal of Interactive Mobile Technologies, 18(8). https://doi.org/10.3991/ijim.v18i08.46473
Kim, H. S. (2021). Is it beneficial to use AI chatbots to improve learners’ speaking performance? Journal of Asia TEFL, 18(1), 161-178.
Kim, H. S., Cha, Y., & Kim, N. Y. (2021). Effects of AI chatbots on EFL students’ communication skills. Korean Journal of English Language and Linguistics, 21, 712-734.
Kim, N. Y. (2016). Effects of voice chat on EFL learners' speaking ability according to proficiency levels. Multimedia-Assisted Language Learning, 19(4). https://doi.org/10.15702/mall.2016.19.4.63
Kim, N. Y. (2017). Effects of different types of chatbots on EFL learners’ speaking competence and learner perception. Cross-Cultural Studies, 48, 223-252. https://doi.org/10.21049/ccs.2017.48.223
Kim, N. Y., Cha, Y., & Kim, H. S. (2019). Future English learning: Chatbots and artificial intelligence. Multimedia-Assisted Language Learning, 22(3), 32–53. https://doi.org/10.15702/mall.2019.22.3.32
Klímová, B., & Ibna Seraj, P. M. (2023). The use of chatbots in university EFL settings: Research trends and pedagogical implications. Frontiers in Psychology, 14, 1131506. https://doi.org/10.3389/fpsyg.2023.1131506
Koç, F. Ş., & Savaş, P. (2024). The use of artificially intelligent chatbots in English language learning: A systematic meta-synthesis study of articles published between 2010 and 2024. ReCALL, 1-18. https://doi.org/10.1017/S0958344024000168
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973-1018. https://doi.org/10.1007/s10639-022-11177-3
Li, Z., Lou, X., Chen, M., Li, S., Lv, C., Song, S., & Li, L. (2023). Students’ online learning adaptability and their continuous usage intention across different disciplines. Humanities and Social Sciences Communications, 10(1), 1-10. https://doi.org/10.1057/s41599-023-02376-5
Lin, M. P. C., & Chang, D. (2023). CHAT-ACTS: A pedagogical framework for personalized chatbot to enhance active learning and self-regulated learning. Computers and Education: Artificial Intelligence, 5, 100167. https://doi.org/10.1016/j.caeai.2023.100167
Lin, Y., Wang, L., & Hsu, W. (2018). Exploring the relationships among learning adaptability, technology acceptance, and learner outcomes in a flipped classroom. Australasian Journal of Educational Technology, 34(3), 63-77.
Liu, J. Y., Liu, Y. H., & Yang, J. P. (2014). Impact of learning adaptability and time management disposition on study engagement among Chinese baccalaureate nursing students. Journal of Professional Nursing, 30(6), 502-510. https://doi.org/10.1016/j.profnurs.2014.05.002
Martin, A. J., Nejad, H. G., Colmar, S., & Liem, G. A. D. (2013). Adaptability: How students’ responses to uncertainty and novelty predict their academic and non-academic outcomes. Journal of Educational Psychology, 105(3), 728-746. https://doi.org/10.1037/a0032794
Martin, A. J., Nejad, H., Colmar, S., & Liem, G. A. D. (2012). Adaptability: Conceptual and empirical perspectives on responses to change, novelty and uncertainty. Journal of Psychologists and Counsellors in Schools, 22(1), 58-81. https://doi.org/10.1017/jgc.2012.8
Mattarima, K., & Hamdan, A. R. (2011). The teaching constraints of English as a foreign language in Indonesia: The context of school-based curriculum. Sosiohumanika, 4(2), 287-300.
Mohammad Hosseinpur, R., & Parsaeian, Z. (2023). Accuracy and fluency development of spoken English through online informal activities: A microgenetic analysis. Journal of Modern Research in English Language Studies, 10(2), 1-25. https://doi.org/10.30479/jmrels.2022.17417.2082
Nassaji, H. (2020). Good qualitative research. Language Teaching Research, 24(4), 427-431. https://doi.org/10.1177/1362168820941288
Nawshin, F. (2009). Problems in teaching speaking in traditional ESL classrooms. BRAC University.
Petrović, J., & Jovanović, M. (2021). The role of chatbots in foreign language learning: The present situation and the future outlook. In E. Pap (Ed.), Artificial intelligence: Theory and applications (pp. 313-330). Springer. https://doi.org/10.1007/978-3-030-72711-6_17
Rahnama, M., Ahmadi, A., Razmjoo, S. A., & Mazandarani, O. (2020). The effect of oral feedback on Iranian EFL learners’ complexity and accuracy in speaking. Journal of Modern Research in English Language Studies, 7(1), 105-131. https://doi.org/10.30479/jmrels.2019.10362.1291
Suciati, & Erzad, A. M. (2024). Anima chatbot: A media for new university students to get idea for speaking. The 14th Annual International Symposium of Foreign Language Learning. NST Proceedings. (pp. 1-8). http://dx.doi.org/10.11594/nstp.2024.3801
Tabachnick, B.G., & Fidell, L.S. (2013). Using multivariate statistics. Pearson Education.
University of Cambridge ESOL Examinations. (2009). PET handbook for teachers. Cambridge University Press.
Wahyuningsih, S., & Afandi, M. (2020). Investigating English speaking problems: Implications for speaking curriculum development in Indonesia. European Journal of Educational Research, 9(3), 967–977. https://doi.org/10.12973/eu-jer.9.3.967
Wang, X., Liu, Y. L., Ying, B., & Lin, J. (2023). The effect of learning adaptability on Chinese middle school students’ English academic engagement: The chain mediating roles of foreign language anxiety and English learning self-efficacy. Current Psychology, 42(8), 6682-6692. https://doi.org/10.1007/s12144-021-02008-8
Yang, H., Kim, H., Lee, J. H., & Shin, D. (2022). Implementation of an AI chatbot as an English conversation partner in EFL speaking classes. ReCALL, 34(3), 327-343. https://doi.org/10.1017/S0958344022000039
Zhang, H., & Liu, X. (2024). Exploration of college students' learning adaptability under the background of wisdom education. International Journal of Information Technology and Web Engineering (IJITWE), 19(1), 1-12. https://doi.org/10.4018/IJITWE.336486
)