Analysis and trends in the use of chatbots and conversational agents in education: a bibliometric review
DOI:
https://doi.org/10.22458/ie.v26i41.5135Keywords:
Bibliometrics, Chatbot, Conversational Agent, Voice Assistant, Generative Artificial IntelligenceAbstract
Conversational agents (CAs) have come a long way since their first appearance in the 1960s. Ongoing technological advances, such as statistical computing and large-scale language models, have made human-to-human interaction increasingly natural and effortless. The present study conducted a bibliometric review of the use of chatbots in educational contexts by collecting scientific papers from the Scopus database. The results highlight the gaps in research knowledge and suggest several directions that can be taken for future research based on collaborative learning, embodied conversational agents, pedagogical conversational agents, natural language processing, and rational agents. The research contributes to the scientific theory of chatbots and their impact on education by providing a bibliometric review of the topic and shows practical implications by highlighting research opportunities and knowledge gaps.
References
Abbas, N., Whitfield, J., Atwell, E., Bowman, H., Pickard, T., & Walker, A. (2022). Online chat and chatbots to enhance mature student engagement in higher education. International Journal of Lifelong Education, 41(3), 308-326. https://doi.org/10.1080/02601370.2022.2066213
Adamopoulou, E., & Moussiades, L. (2020). Chatbots: History, technology, and applications. Machine Learning with Applications, 2, 100006. https://doi.org/10.1016/j.mlwa.2020.100006
Agarwal, S., Agarwal, B., & Gupta, R. (2022). Chatbots and virtual assistants: A bibliometric analysis. Library Hi Tech, 40(4), 1013-1030. https://doi.org/10.1108/LHT-09-2021-0330
Al-Abdullatif, A. M., Al-Dokhny, A. A., & Drwish, A. M. (2023) Implementing the Bashayer chatbot in Saudi higher education: measuring the influence on students’ motivation and learning strategies. Front. Psychol. 14, 1129070. https://doi.org/10.3389/fpsyg.2023.1129070
Annamalai, N., Ab Rashid, R., Hashmi, U. M., Mohamed, M., Alqaryouti, M. H., & Sadeq, A. E. (2023). Using chatbots for English language learning in higher education. Computers and Education: Artificial Intelligence, 5, 100153. https://doi.org/10.1016/j.caeai.2023.100153
Andres, A. (2009). Measuring Academic Research: How to Undertake a Bibliometric Study. Elsevier.
Aria, M., & Cuccurullo, C. (2017). bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959-975. https://doi.org/10.1016/j.joi.2017.08.007
Artiles-Rodríguez, J., Guerra-Santana, M., Aguiar-Perera, M. V., & Rodríguez-Pulido, J. (2021). Agente conversacional virtual: La inteligencia artificial para el aprendizaje autónomo. Pixel-Bit. Revista de Medios y Educación, 62, 107-144. https://doi.org/10.12795/pixelbit.86171
Calvaresi, D., Eggenschwiler, S., Mualla, Y., Schumacher, M., & Calbimonte, J. P. (2023). Exploring agent-based chatbots: a systematic literature review. Journal of Ambient Intelligence and Humanized Computing, 14(8), 11207-11226. https://link.springer.com/article/10.1007/s12652-023-04626-5
Chae, H., Kim, M., Kim, C., Jeong, W., Kim, H., Lee, J., & Yeo, J. (2023). TUTORING: instruction-grounded conversational agent for language learners. In Proceedings of the AAAI Conference on Artificial Intelligence, 37(13), 16413-16415.https://doi.org/10.48550/arXiv.2302.12623
Chamorro-Atalaya, O., Olivares-Zegarra, S., Sobrino-Chunga, L., Guerrero-Carranza, R., Vargas-Diaz, A., Huarcaya-Godoy, M., Rasilla-Rovegno, J., Suarez-Bazalar, R., Poma-Garcia, J., & Cruz-Telada, Y. (2023). Application of the Chatbot in University Education: A Bibliometric Analysis of Indexed Scientific Production in SCOPUS, 2013-2023. International Journal of Learning, Teaching and Educational Research, 22(7), 281-304. Scopus. https://doi.org/10.26803/ijlter.22.7.15
Chaves, A. P. (2020). Should my Chatbot be Register-Specific? Designing Appropriate Utterances for Tourism. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 1-11. https://doi.org/10.1145/3334480.3375033
Chen, X., Cheng, G., Zou, D., Zhong, B., & Xie, H. (2023). Artificial Intelligent Robots for Precision Education: A Topic Modeling-Based Bibliometric Analysis. Educational Technology and Society, 26(1), 171-186. https://doi.org/10.30191/ETS.202301_26(1).0013
Cheng, Y., & Jiang, H. (2022). Customer–brand relationship in the era of artificial intelligence: Understanding the role of chatbot marketing efforts. Journal of Product and Brand Management, 31(2), 252-264. https://doi.org/10.1108/JPBM-05-2020-2907
Contreras, C. R., & Valette-Florence, P. (2023). Toward a Theoretical Model of Branded Chatbot Adoption, a Bibliometric and Machine Learning Perspective: An Abstract. Developments in Marketing Science: Proceedings of the Academy of Marketing Science, 181-182. https://doi.org/10.1007/978-3-031-24687-6_72
Cui, L., Huang, S., Wei, F., Tan, C., Duan, C., & Zhou, M. (2017). SuperAgent: A Customer Service Chatbot for E-commerce Websites. En M. Bansal & H. Ji (Eds.), Proceedings of ACL 2017, System Demonstrations (pp. 97-102). Association for Computational Linguistics. https://aclanthology.org/P17-4017
Daher, K., Casas, J., Khaled, O. A., & Mugellini, E. (2020). Empathic Chatbot Response for Medical Assistance. Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents, 1-3. https://doi.org/10.1145/3383652.3423864
Dorado-Vicente, R., Robles-Lorite, L., Torres-Jiménez, E., Medina-Sánchez, G., & García-Collado, A. (2022). Conversational machines: Chatbots in engineering education. EDULEARN22 Proceedings, 2450-2456. https://doi.org/10.21125/edulearn.2022.0630
Drozdal, J., Chang, A., Fahey, W., Murthy, N., Mogilisetty, L., Sunray, J., Powell, C., & Su, H. (2021). The Design and Evaluation of a Chatbot for Human Resources. En C. Stephanidis, M. Antona, & S. Ntoa (Eds.), HCI International 2021—Late Breaking Posters (pp. 239-248). Springer International Publishing. https://doi.org/10.1007/978-3-030-90176-9_32
Essel, H. B., Vlachopoulos, D., Tachie-Menson, A., Johnson, E. E., & Baah, P. K. (2022). The impact of a virtual teaching assistant (chatbot) on students’ learning in Ghanaian higher education. International Journal of Educational Technology in Higher Education, 19(1), 57. https://doi.org/10.1186/s41239-022-00362-6
García-Villar, C., & García-Santos, J. M. (2021). Indicadores bibliométricos para evaluar la actividad científica. Radiología, 63(3), 228-235. https://doi.org/10.1016/j.rx.2021.01.002
Guarda, T. & Augusto, M. F. (2022). ChatBots and Business Strategy. Lecture Notes in Networks and Systems, 419, LNNS, 557-566. https://doi.org/10.1007/978-3-030-96299-9_53
Gwo-Jen Hwang & Ching-Yi Chang (2021): A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099-4112. https://doi.org/10.1080/10494820.2021.1952615
Hien, H. T., Cuong, P.-N., Nam, L. N. H., Nhung, H. L. T. K., & Thang, L. D. (2018). Intelligent Assistants in Higher-Education Environments: The FIT-EBot, a Chatbot for Administrative and Learning Support. Proceedings of the 9th International Symposium on Information and Communication Technology, 69-76. https://doi.org/10.1145/3287921.3287937
Hobert, S. (2023). Fostering skills with chatbot-based digital tutors – training programming skills in a field study. i-com, 22(2), 143-159. https://doi.org/10.1515/icom-2022-0044
Hwang, G.-J. & Chang, C.-Y. (2021). A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099-4112. https://doi.org/10.1080/10494820.2021.1952615
Hwang, S., & Kim, J. (2021). Toward a Chatbot for Financial Sustainability. Sustainability, 13(6), Article 6. https://doi.org/10.3390/su13063173
Io, H. N., & Lee, C. B. (2017). Chatbots and conversational agents: A bibliometric analysis. 2017 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), 215-219. https://doi.org/10.1109/IEEM.2017.8289883
Jiménez-Revuelta, J. C. (2023). Modelos Grandes de Lenguaje y aplicaciones a la generación automática de texto [Tesis de maestría, Universidad de Sevilla].https://idus.us.es/handle/11441/155736
Karaca, A., & Kılcan, B. (2023). The Adventure of Artificial Intelligence Technology in Education: Comprehensive Scientific Mapping Analysis. Participatory Educational Research, 10(4), 144-165. https://doi.org/10.17275/per.23.64.10.4
Khan, M. M. (2020). Development of An e-commerce Sales Chatbot. 2020 IEEE 17th International Conference on Smart Communities: Improving Quality of Life Using ICT, IoT and AI (HONET), 173-176. https://doi.org/10.1109/HONET50430.2020.9322667
Khosravi, H., Shafie, M. R., Hajiabadi, M., Raihan, A. S., & Ahmed, I. (2023). Chatbots and ChatGPT: A Bibliometric Analysis and Systematic Review of Publications in Web of Science and Scopus Databases (arXiv:2304.05436). arXiv. https://doi.org/10.48550/arXiv.2304.05436
King, M. R. (2023). The Future of AI in Medicine: A Perspective from a Chatbot. Annals of Biomedical Engineering, 51(2), 291-295. https://doi.org/10.1007/s10439-022-03121-w
Kublik, S., & Saboo, S. (2023). GPT-3: The Ultimate Guide To Building NLP Products With OpenAI API. Packt Publishing Ltd.
Kushwaha, A. K., & Kar, A. K. (2021). MarkBot – A Language Model-Driven Chatbot for Interactive Marketing in Post-Modern World. Information Systems Frontiers. https://doi.org/10.1007/s10796-021-10184-y
Li, M., & Wang, R. (2023). Chatbots in e-commerce: The effect of chatbot language style on customers’ continuance usage intention and attitude toward brand. Journal of Retailing and Consumer Services, 71. https://doi.org/10.1016/j.jretconser.2022.103209
Lin, Y., & Yu, Z. (2023). A bibliometric analysis of artificial intelligence chatbots in educational contexts. Interactive Technology and Smart Education. https://doi.org/10.1108/ITSE-12-2022-0165
Liu, L., & Duffy, V. G. (2023). Exploring the Future Development of Artificial Intelligence (AI) Applications in Chatbots: A Bibliometric Analysis. International Journal of Social Robotics, 15(5), 703-716. https://doi.org/10.1007/s12369-022-00956-0
McBurney, M., & Novak, P. (2002). What is bibliometrics and why should you care? 108-114. https://doi.org/10.1109/IPCC.2002.1049094
McTear, M. (2022). Conversational AI: Dialogue Systems, Conversational Agents, and Chatbots. Springer Nature.
Moraes-Neto, A. J., & Fernandes, M. A. (2019). Chatbot and Conversational Analysis to Promote Collaborative Learning in Distance Education. 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), 2161-377X, 324-326. https://doi.org/10.1109/ICALT.2019.00102
Önden, A., & Alnour, M. (2023). ChatGPT and OpenAI: A Comprehensive Bibliometric Review. Journal of Soft Computing and Decision Analytics, 1(1), Article 1. https://doi.org/10.31181/jscda11202324
Pearce, K., Alghowinem, S., & Breazeal, C. (2023). Build-a-bot: teaching conversational ai using a transformer-based intent recognition and question answering architecture. In Proceedings of the AAAI Conference on Artificial Intelligence, 37(13), 16025-16032. https://doi.org/10.48550/arXiv.2212.07542
Pears, M., & Konstantinidis, S. (2022). Bibliometric Analysis of Chatbots in Health-Trend Shifts and Advancements in Artificial Intelligence for Personalized Conversational Agents. Studies in Health Technology and Informatics, 290, 494-498. https://doi.org/10.3233/SHTI220125
Pereira, D. S., Falcão, F., Costa, L., Lunn, B. S., Pêgo, J. M., & Costa, P. (2023). Here's to the future: Conversational agents in higher education-a scoping review. International Journal of Educational Research, 122, 102233. https://doi.org/10.1016/j.ijer.2023.102233
Pillai, R., & Sivathanu, B. (2020). Adoption of AI-based chatbots for hospitality and tourism. International Journal of Contemporary Hospitality Management, 32(10), 3199-3226. https://doi.org/10.1108/IJCHM-04-2020-0259
Pranckutė, R. (2021). Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World. Publications, 9(1), Article 1. https://doi.org/10.3390/publications9010012
Ramya, J. B., & Alur, S. (2023). Unleashing the potential of chatbots in business: A bibliometric analysis. Business Information Review, 40(3), 123-136. Scopus. https://doi.org/10.1177/02663821231189344
Ridha, M., & Haura Maharani, K. (2022). Implementation of Artificial Intelligence Chatbot in Optimizing Customer Service in Financial Technology Company PT. FinAccel Finance Indonesia. Proceedings, 83(1), Article 1. https://doi.org/10.3390/proceedings2022083021
Schöbel, S., Schmitt, A., Benner, D., Saqr, M., Janson, A., & Leimeister, J. M. (2023). Charting the Evolution and Future of Conversational Agents: A Research Agenda Along Five Waves and New Frontiers. Information Systems Frontiers. https://doi.org/10.1007/s10796-023-10375-9
Shawar, B., & Atwell, E. (2007). Different measurements metrics to evaluate a chatbot system. 89-96. https://doi.org/10.3115/1556328.1556341
Sheikh, S. A., Tiwari, V., & Singhal, S. (2019). Generative model chatbot for Human Resource using Deep Learning. 2019 International Conference on Data Science and Engineering (ICDSE), 126-132. https://doi.org/10.1109/ICDSE47409.2019.8971795
Shoaib, M., Zhang, S., & Ali, H. (2023). A bibliometric study on blockchain-based supply chain: A theme analysis, adopted methodologies, and future research agenda. Environmental Science and Pollution Research, 30(6), 14029-14049. https://doi.org/10.1007/s11356-022-24844-2
Teigens, V. (2019). Inteligencia Artificial General. Cambridge Stanford Books.
Xie, Y., Seth, I., Hunter-Smith, D. J., Rozen, W. M., & Seifman, M. A. (2024). Investigating the impact of innovative AI chatbot on post-pandemic medical education and clinical assistance: A comprehensive analysis. ANZ Journal of Surgery, 94(1-2), 68-77. https://doi.org/10.1111/ans.18666
Weizenbaum, J. (1966) Eliza-a computer program for the study of natural language communication between man and machine. Commun ACM, 9(1), 36–45.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Innovaciones Educativas
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.