NEWS

TRENDS AND CHALLENGES OF ARABIC CHATBOTS: LITERATURE REVIEW


(Received: 29-May-2023, Revised: 27-Jul.-2023 and 19-Aug.-2023 , Accepted: 20-Aug.-2023)
Conversational systems have recently garnered increased attention due to advancements in Large Language Models (LLMs) and Language Models for Dialogue Applications (LaMDA). However, conversational Artificial Intelligence (AI) research focuses primarily on English. Despite Arabic being one of the most widely used languages on the Internet, only a few studies have concentrated on Arabic conversational dialogue systems thus far. This study presents a comprehensive qualitative analysis of critical research works in this domain to examine the strengths and limitations of existing approaches. The analysis begins with an overview of chatbot history and classification, then explores the language challenges encountered when developing Generative Arabic Conversational AI. Rule-based/Retrieval-based and deep learning-based approaches for Arabic chatbots are also examined. Furthermore, the study investigates the evolution of Generative Conversational AI with the advancements in deep-learning techniques. It also comprehensively reviews various metrics used to assess conversational systems.

[1] M. Adam,M.Wessel and A. Benlian, "Ai-based Chatbots in Customer Service and their Effects on User Compliance," Electronic Markets, vol. 31, no. 2, pp. 427–445, 2021.

[2] L. T. Car, D. A. Dhinagaran, B. M. Kyaw et al., "Conversational Agents in Health Care: Scoping Review and Conceptual Analysis," Journal of Medical Internet Research, vol. 22, no. 8, p. e17158, 2020.

[3] M. M. Mariani, N. Hashemi and J. Wirtz, "Artificial Intelligence Empowered Conversational Agents: A Systematic Literature Review and Research Agenda," J. of Business Research, vol. 161, p. 113838, 2023.

[4] M. Hijjawi, Z. Bandar, K. Crockett and D. Mclean, "Arabchat: An Arabic Conversational Agent," Proc. of the 6th IEEE Int. Conf. on Computer Science and Information Technology (CSIT), pp. 227–237, 2014.

[5] M. Hijjawi, H. Qattous and O. Alsheiksalem, "Mobile Arabchat: An Arabic Mobile-based Conversational Agent," Int. J. Adv. Comput. Sci. Appl. (IJACSA), vol. 6, no. 10, 2015.

[6] M. Hijjawi, Z. Bandar and K. Crockett, "The Enhanced Arabchat: An Arabic Conversational Agent," Int. J. of Advanced Computer Science and Applications, vol. 7, no. 2, 2016.

[7] S. S. Aljameel, J. D. O’Shea, K. A. Crockett, A. Latham and M. Kaleem, "Development of an Arabic Conversational Intelligent Tutoring System for Education of Children with ASD," Proc. of the 2017 IEEE Int. Conf. on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), pp. 24–29, Annecy, France, 2017.

[8] D. Al-Ghadhban and N. Al-Twairesh, "Nabiha: An Arabic Dialect Chatbot," Int. J. of Advanced Computer Science and Applications, vol. 11, no. 3, DOI: 10.14569/IJACSA.2020.0110357, 2020.

[9] D. Baidoo-Anu and L. O. Ansah, "Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of Chatgpt in Promoting Teaching and Learning," SSRN 4337484, [Online], Available: https://dx.doi.org/10.2139/ssrn.4337484, 2023.

[10] E. Kasthuri and S. Balaji, "A Chatbot for Changing Lifestyle in Education," Proc. of the 2021 3rd IEEE Int. Conf. on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), pp. 1317–1322, Tirunelveli, India, 2021.

[11] M. A. Kuhail, B. Abu Shawar and R. Hammad, Trends, Applications and Challenges of Chatbot Technology, Advances in Web Technologies and Engineering, IGI Global, ISBN10: 1668462346, 2023.

[12] A. D Fadhil et al., "Ollobot-towards a Text-based Arabic Health Conversational Agent: Evaluation and Results," Proc. of the Int. Conf. on Recent Advances in Natural Language Processing (RANLP 2019), pp. 295–303, Varna, Bulgaria, 2019.

[13] M. Boussakssou, H. Ezzikouri and M. Erritali, "Chatbot in Arabic Language Using Seq to Seq Model," Multimedia Tools and Applications, vol. 81, no. 2, pp. 2859–2871, 2022.

[14] L. Xu, L. Sanders, K. Li et al., "Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review," JMIR Cancer, vol. 7, no. 4, p. e27850, 2021.

[15] L. Athota, V. K. Shukla, N. Pandey and A. Rana, "Chatbot for Healthcare System Using Artificial Intelligence," Proc. of the 2020 IEEE 8th Int. Conf. on Reliability, Infocom Technologies and Optimization (Trends and Future Directions)(ICRITO), pp. 619–622, Noida, India, 2020.

[16] A. Stöckl, "Classification of Chatbot Inputs," [Online], Available: https://www.researchgate.net/publication/ 318661551_Classification_of_Chatbot_Inputs, 2017.

[17] N. K. Manaswi and S. John, Deep Learning with Applications Using Python, ISBN-10: 1484240510, Springer, 2018.

[18] N. M. Radziwill and M. C. Benton, "Evaluating Quality of Chatbots and Intelligent Conversational Agents," arXiv preprint, arXiv: 1704.04579, 2017.

[19] Amazon Lab126, "Amazon Alexa," [Online], Available: https://en.wikipedia.org/wiki/Amazon_Alexa/, 2013.

[20] S. Alhumoud et al., "Rahhal: A Tourist Arabic Chatbot," Proc. of the 2022 2nd IEEE Int. Conf. of Smart Systems and Emerging Technologies (SMARTTECH), pp. 66–73, 2022.

[21] Al-H. Al-Ajmi and N. Al-Twairesh, "Building an Arabic Flight Booking Dialogue System Using a Hybrid Rule-based and Data Driven Approach," IEEE Access, vol. 9, pp. 7043–7053, 2021.

[22] A. M. Rahman, A. Al Mamun and A. Islam, "Programming Challenges of Chatbot: Current and Future Prospective," Proc. of the 2017 IEEE Region 10 Humanitarian Technology Conf. (R10-HTC), pp. 75–78, Dhaka, Bangladesh, 2017.

[23] A. Radford, K. Narasimhan, T. Salimans et al., "Improving Language Understanding by Generative Pre-training," pp. 1-12, [Online], Available: https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf, 2018.

[24] A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al., "Language Models Are Unsupervised Multitask Learners," OpenAI blog, vol. 1, no. 8, p. 9, 2019.

[25] T. Brown, B. Mann, N. Ryder et al., "Language Models are Few-shot Learners," Advances in Neural Information Processing Systems, vol. 33, pp. 1877–1901, 2020.

[26] OpenAI, "Gpt-4 Technical Report," [Online], Available: https://cdn.openai.com/papers/gpt-4.pdf, 2023.

[27] J. Devlin, M.-W. Chang, K. Lee and K. Toutanova, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding," arXiv preprint, arXiv: 1810.04805, 2018.

[28] Romal Thoppilan et al., "LaMDA: Language Models for Dialog Applications," arXiv preprint, arXiv: 2201.08239, 2022.

[29] P. Brereton, B. A Kitchenham, D. Budgen, M. Turner and M. Khalil, "Lessons from Applying the Systematic Literature Review Process within the Software Engineering Domain," Journal of Systems and Software, vol. 80, no. 4, pp. 571–583, 2007.

[30] Y. Xiao and M. Watson, "Guidance on Conducting a Systematic Literature Review," Journal of Planning Education and Research, vol. 39, no. 1, pp. 93–112, 2019.

[31] A. M. Turing, Computing Machinery and Intelligence, in Book: Parsing the Turing Test, pp. 23–65, Springer, 2009.

[32] J. Weizenbaum et al., "Eliza: A Computer Program for the Study of Natural Language Communication between Man and Machine," Communications of the ACM, vol. 9, no. 1, pp. 36–45, 1966.

[33] E. Adamopoulou and L. Moussiades, "Chatbots: History, Technology and Applications," Machine Learning with Applications, vol. 2, p. 100006, 2020.

[34] Loebner Prize, [Online], Available: https://en.wikipedia.org/wiki/Loebner_Prize.

[35] Ina, [Online], Available: https://onlim.com/en/the-history-of-chatbots/, 2021.

[36] R. Wallace, Artificial Linguistic Internet Computer Entity (Alice), [Online], Available: https://www.chatbots.org/chatbot/a.l.i.c.e/, 1995.

[37] B. Abu Shawar and E. Atwell, "Chatbots: Are They Really Useful?" J. for Language Technology and Computational Linguistics, vol. 22, no. 1, pp. 29–49, 2007.

[38] A. M. Ezzeldin and M. Shaheen, "A Survey of Arabic Question Answering: Challenges, Tasks, Approaches, Tools and Future Trends," Proc. of the 13th Int. Arab Conf. on Information Technology (ACIT 2012), pp. 1–8, 2012.

[39] Y. Wu, G. Wang, W. Li and Z. Li, "Automatic Chatbot Knowledge Acquisition from Online Forum via Rough Set and Ensemble Learning," Proc. of the 2008 IEEE IFIP Int. Conf. on Network and Parallel Computing, pp. 242–246, Shanghai, China, 2008.

[40] G. Molnár and Z. Szüts, "The Role of Chatbots in Formal Education," Proc. of the 2018 IEEE 16th Int. Symposium on Intelligent Systems and Informatics (SISY), pp. 000197–000202, Subotica, Serbia, 2018.

[41] S. Worswick, Mitsuku Chatbot, [Online], Available: https://www.pandorabots.com/mitsuku/, 2005.

[42] David Ferrucci, IBM Watson, [Online], Available: https://www.ibm.com/watson, 2006.

[43] T. G. D. Kittlaus and UCLA Alumnus Adam Cheyer, Apple Siri, [Online], Available: https://www.apple.com/siri/, 2010.

[44] Google, Google Assistant, [Online], Available: https://assistant.google.com/, 2012.

[45] Google Cloud, Dialogflow, [Online], Available: https://cloud.google.com/dialogflow, 2016.

[46] Microsoft Azure, Language Understanding (LUIS), [Online], Available: https://www.luis.ai/, 2017.

[47] Amazon, Amazon Lex- Conversational AI for Chatbots, [Online], Available: https://aws.amazon.com/ lex/?nc=sn&loc=0, 2017.

[48] A. Vaswani, N. Shazeer, N. Parmar et al., "Attention Is All You Need," Advances in Neural InformationProcessing Systems, vol. 30, arXiv:1706.03762, 2017.

[49] S. Hussain, O. A. Sianaki and N. Ababneh, "A Survey on Conversational Agents/Chatbots Classification and Design Techniques, Proc. of the Workshops of the Int. Conf. on Advanced Information Networking and Applications, pp. 946–956, Springer, 2019.

[50] E. Adamopoulou and L. Moussiades, "An Overview of Chatbot Technology," Proc. of the IFIP Int. Conf. on Artificial Intelligence Applications and Innovations, pp. 373–383, Springer, 2020.

[51] E. H. Almansor and F.h K. Hussain, "Survey on Intelligent Chatbots: State-of-the-art and Future Research Directions," Proc. of Conf. on Complex, Intelligent and Software Intensive Systems, pp. 534–543, Springer, 2019.

[52] R. Dale, "The Return of the Chatbots," Natural Language Engineering, vol. 22, no. 5, pp. 811–817, 2016.

[53] M. B. Hoy, "Alexa, Siri, Cortana and More: An Introduction to Voice Assistants," Medical Reference Services Quarterly, vol. 37, no. 1, pp. 81–88, 2018.

[54] A. L. Guzman, "Making AI Safe for Humans: A Conversation with Siri," Chapter in Book: Socialbots and Their Friends, 1st Edn., pp. 85–101, Routledge, 2016.

[55] K. Nimavat and T. Champaneria, "Chatbots: An Overview of Types, Architecture, Tools and Future Possibilities," Int. J. Sci. Res. Dev. (IJSRD), vol. 5, no. 7, pp. 1019–1024, 2017.

[56] H. T. Hien, P.-N. Cuong, L. N. H. Nam, H. L. T. K. Nhung and L. D. Thang, "Intelligent Assistants in Higher-education Environments: The FIT-EBoT, a Chatbot for Administrative and Learning Support," Proc. of the 9th Int. Symposium on Inform. and Comm. Techn. (SoICT '18), pp. 69–76, 2018.

[57] K. Ramesh, S. Ravishankaran, A. Joshi and K. Chandrasekaran, "A Survey of Design Techniques for Conversational Agents," Proc. of the Int. Conf. on Information, Communication and Computing Technology, pp. 336–350, Springer, 2017.

[58] Z. Ji, Z. Lu and H. Li, "An Information Retrieval Approach to Short Text Conversation," arXiv preprint, arXiv: 1408.6988, 2014.

[59] R. Artstein, S. Gandhe, J. Gerten, A. Leuski and D. Traum, "Semi-formal Evaluation of Conversational Characters," in Book: Languages: From Formal to Natural, vol. 5533, pp. 22–35, Springer, 2009.

[60] E. Atwell, "A Chatbot As a Question Answering Tool," DOI: 10.17758/ur.u0915120, 2015.

[61] R. Artstein, A. Gainer, K. Georgila et al., "New Dimensions in Testimony Demonstration," Proc. of the 2016 Conf. of the North American Chapter of the Association for Computational Linguistics: Demonstrations, pp. 32–36, San Diego, California, USA, 2016.

[62] R. Artstein, A. Leuski, H. Maio et al., "How Many Utterances Are Needed to Support Time-offset Interaction?" Proc. of the 28th Int. Florida Artificial Intelligence Research Society Conference (FLAIRS 2015), pp. 144-149, 2015.

[63] D. Traum, K. Georgila, R. Artstein and A. Leuski, "Evaluating Spoken Dialogue Processing for Time-offset Interaction," Proc. of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pp. 199–208, Prague, Czech Republic, 2015.

[64] D. Traum et al., "New Dimensions in Testimony: Digitally Preserving a Holocaust Survivors’ Interactive Storytelling," Proc. of the 8th Int. Conf. on Interactive Digital Storytelling (ICIDS 2015), Copenhagen, Denmark, Proceedings 8, pp. 269–281, Springer, 2015.

[65] D. Abu Ali et al., "A Bilingual Interactive Human Avatar Dialogue System," Proc. of the 19th Annual SIGdial Meeting on Discourse and Dialogue, pp. 241–244, Melbourne, Australia, 2018.

[66] A. Farghaly and K. Shaalan, "Arabic Natural Language Processing: Challenges and Solutions," ACM Transactions on Asian Language Information Processing (TALIP), vol. 8, no. 4, pp. 1–22, 2009.

[67] K. C. Ryding, A Reference Grammar of Modern Standard Arabic, ISBN: 0521777712, Cambridge University Press, 2005.

[68] N. Y. Habash, Introduction to Arabic Natural Language Processing, ISBN: 1598297953, Springer Nature, 2022.

[69] C. Zhai, "A Systematic Review on Artificial Intelligence Dialogue Systems for Enhancing English As Foreign Language Students’ Interactional Competence in the University," Computers and Education: Artificial Intelligence, vol. 4, p. 100134, 2023.

[70] K. Chemnad and A. Othman, "Advancements in Arabic Text-to-speech Systems: A 22-year Literature Review," IEEE Access, vol. 11, pp. 30929 – 30954, 2023.

[71] K. Darwish, N. Habash, M. Abbas et al., "A Panoramic Survey of Natural Language Processing in the Arab World," Communications of the ACM, vol. 64, no. 4, pp. 72–81, 2021.

[72] Amira Dhouib et al., "Arabic Automatic Speech Recognition: A Systematic Literature Review," Applied Sciences, vol. 12, no. 17, p. 8898, 2022.

[73] M. Hijjawi and Y. Elsheikh, "Arabic Language Challenges in Text Based Conversational Agents Compared to the English Language," IJCSIT, vol. 7, no. 5, pp. 1–13, 2015.

[74] N. Habash, M. T. Diab and O. Rambow, "Conventional Orthography for Dialectal Arabic," Proc. of the 8th Int. Conf. on Language Resources and Evaluation (LREC'12), pp. 711–718, Istanbul, Turkey, 2012.

[75] D. Abu Ali and N. Habash, "Botta: An Arabic Dialect Chabot," Proc. of COLING 2016, the 26th Int. Conf. on Computational Linguistics: System Demonstrations, pp. 208–212, Osaka, Japan, 2016.

[76] W. Zaghouani et al., "Large Scale Arabic Error Annotation: Guidelines and Framework," Proc. of the 9th Int. Conf. on Language Resources and Evaluation (LREC'14), pp. 2362-2369, Reykjavik, Iceland, 2014.

[77] R. Eskander, N. Habash, O. Rambow and N. Tomeh, "Processing Spontaneous Orthography," Proc. of the 2013 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 585–595, Atlanta, USA, 2013.

[78] N. Habash, R. Roth, O. Rambow, R. Eskander and N. Tomeh, "Morphological Analysis and Disambiguation for Dialectal Arabic," Proc. of the 2013 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Lang. Techn., pp. 426–432, Atlanta, USA, 2013.

[79] N. Habash, A. Soudi and T. Buckwalter, "On Arabic Transliteration," in Chapter: Arabic Computational Morphology: Knowledge-based and Empirical Methods, Part of the Text, Speech and Language Technology Book Series, vol. 38, pp. 15–22, 2007.

[80] T. Buckwalter, "Buckwalter Arabic Morphological Analyzer Version 1.0," Catalog no. LDC2002L49, Linguistic Data Consortium, University of Pennsylvania, 2002.

[81] T. H. Alwaneen et al., "Arabic Question Answering System: A Survey," Artificial Intelligence Review, vol. 55, no. 1, pp. 207–253, 2022.

[82] H. Mozannar, K. El Hajal, E. Maamary and H. Hajj, "Neural Arabic Question Answering," arXiv preprint, arXiv: 1906.05394, 2019.

[83] W. Antoun, F. Baly and H. Hajj, "Araelectra: Pre-training Text Discriminators for Arabic Language Understanding," arXiv preprint, arXiv: 2012.15516, 2020.

[84] Jonathan H Clark et al., "TyDi QA: A Benchmark for Information-seeking Question Answering in Typologically Diverse Languages," Transactions of the Association for Computational Linguistics, vol. 8, pp. 454–470, 2020.

[85] B. Abu Shawar, "A Chatbot As a Natural Web Interface to Arabic Web QA," Int. J. of Emerging Technologies in Learning (iJET), vol. 6, no. 1, pp. 37–43, 2011.

[86] M. A. Yaghan, ""Arabizi": A Contemporary Style of Arabic Slang," Design Issues, vol. 24, no. 2, pp. 39– 52, 2008.

[87] K. Shaalan, "A Survey of Arabic Named Entity Recognition and Classification," Computational Linguistics, vol. 40, no. 2, pp. 469–510, 2014.

[88] W. Bakari, P. Bellot and M. Neji, "Researches and Reviews in Arabic Question Answering: Principal Approaches and Systems with Classification," Proc. of the Int. Arab Conf. on Information Technology (ACIT’2016), pp. 1–9, 2016.

[89] Arfath Pasha et al., "MADAMIRA: A Fast, Comprehensive Tool for Morphological Analysis and Disambiguation of Arabic," Proc. of the 9th Int. Conf. on Language Resources and Evaluation (LREC’14), pp. 1094–1101, Reykjavik, Iceland, 2014.

[90] N. Habash and O. Rambow, "Arabic Tokenization, Part-of-speech Tagging and Morphological Disambiguation in One Fell Swoop," Proc. of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL’05), pp. 573–580, Ann Arbor, Michigan, USA, 2005.

[91] N. Habash, O. Rambow and R. Roth, "MADA+TOKAN: A Toolkit for Arabic Tokenization, Diacritization, Morphological Disambiguation, POS Tagging, Stemming and Lemmatization," Proc. of the 2nd Int. Conf. on Arabic Language Resources and Tools (MEDAR), vol. 41, p. 62, Cairo, Egypt, 2009.

[92] A. Abdelali, K. Darwish, N. Durrani and H. Mubarak, "Farasa: A Fast and Furious Segmenter for Arabic," Proc. of the 2016 Conf. of the North American Chapter of the Association for Computational Linguistics: Demonstrations, pp. 11–16, San Diego, California, USA, 2016.

[93] O. Obeid et al., "CAMeL Tools: An Open Source Python Toolkit for Arabic Natural Language Processing," Proc. of the 12th Language Resources and Evaluation Conference, pp. 7022–7032, Marseille, France, 2020.

[94] Zaid Alyafeai et al., "Masader: Metadata Sourcing for Arabic Text and Speech Data Resources," arXiv preprint, arXiv: 2110.06744, 2021.

[95] N. Al-Twairesh, H. Al-Khalifa, A. Alsalman and Y. Al-Ohali, "Sentiment Analysis of Arabic Tweets: Feature Engineering and a Hybrid Approach," arXiv preprint, arXiv: 1805.08533, 2018.

[96] P. Liu, X. Qiu, J. Chen and X.-J. Huang, "Deep Fusion LSTMs for Text Semantic Matching," Proc. of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 1034–1043, Berlin, Germany, 2016.

[97] J. Mueller and A. Thyagarajan, "Siamese Recurrent Architectures for Learning Sentence Similarity," Proc. of the AAAI Conf. on Artificial Intelligence, vol. 30, no. 1, DOI: 10.1609/aaai.v30i1.10350, 2016.

[98] N. Van Tu et al., "A Deep Learning Model of Multiple Knowledge Sources Integration for Community Question Answering," VNU J. of Science: Computer Sci. and Comm. Eng., vol. 37, no. 1, 2021.

[99] J. D. Ming-Wei C. Kenton and L. K. Toutanova, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding," Proc. of NAACL-HLT, pp. 4171– 4186, Minneapolis, USA, 2019.

[100] A. Hamza, N. En-Nahnahi and S. El Alaoui Ouatik, "Exploring Contextual Word Representation for Arabic Question Classification," Proc. of the 2020 1st IEEE Int. Conf. on Innovative Research in Applied Science, Engineering and Technology (IRASET), pp. 1–5, Meknes, Morocco, 2020.

[101] W. Antoun, F. Baly and H. Hajj, "AraBERT: Transformer-based Model for Arabic Language Understanding," arXiv preprint, arXiv: 2003.00104, 2020.

[102] A. Almiman, N. Osman and M. Torki, "Deep Neural Network Approach for Arabic Community Question Answering," Alexandria Engineering Journal, vol. 59, no. 6, pp. 4427–4434, 2020.

[103] D. Elalfy, W. Gad and R. Ismail, "A Hybrid Model to Predict Best Answers in Question Answering Communities," Egyptian Informatics Journal, vol. 19, no. 1, pp. 21–31, 2018.

[104] D. Elalfy, W. Gad and R. Ismail, "Predicting Best Answer in Community Questions Based on Content and Sentiment Analysis," Proc. of the 2015 IEEE 7th Int. Conf. on Intelligent Computing and Information Systems (ICICIS), pp. 585–590, Cairo, Egypt, 2015.

[105] A. Hamza et al., "An Arabic Question Classification Method Based on New Taxonomy and Continuous Distributed Representation of Words," Journal of King Saud University-Computer and Information Sciences, vol. 33, no. 2, pp. 218–224, 2021.

[106] N. Othman, R. Faiz and K. Smaïli, "Learning English and Arabic Question Similarity with Siamese Neural Networks in Community Question Answering Services," Data & Knowledge Engineering, vol. 138, p. 101962, 2022.

[107] W.-N. Zhang et al., "Capturing the Semantics of Key Phrases Using Multiple Languages for Question Retrieval," IEEE Transactions on Knowledge and Data Engineering, vol. 28, no. 4, pp. 888–900, 2015.

[108] W. Bakari and M. Neji, "A Novel Semantic and Logical-based Approach Integrating RTE Technique in the Arabic Question–answering," International Journal of Speech Technology, vol. 25, pp. 1–17, 2020.

[109] W. Bakari, P. Bellot and M. Neji, "AQA-WebCorp: Web-based Factual Questions for Arabic," Procedia Computer Science, vol. 96, pp. 275–284, 2016.

[110] N. A. Al-Madi et al., "An Intelligent Arabic Chatbot System Proposed Framework," Proc. of the 2021 IEEE Int. Conf.on Information Technology (ICIT), pp. 592–597, Amman, Jordan, 2021.

[111] K. Alsubhi, A. Jamal and A. Alhothali, "Deep Learning-based Approach for Arabic Open Domain Question Answering," PeerJ Computer Science, vol. 8, p. e952, 2022.

[112] A. Soliman, K Eissa and S. R El-Beltagy, "Aravec: A Set of Arabic Word Embedding Models for Use in Arabic NLP," Procedia Computer Science, vol. 117, pp. 256–265, 2017.

[113] M. Ben-Sghaier, W. Bakari and M. Neji, "An Arabic Question-answering System Combining a Semantic and Logical Representation of Texts," Proc. of the Int. Conf. on Intelligent Systems Design and Applications, pp. 735–744, Springer, 2017.

[114] V. Karpukhin et al., "Dense Passage Retrieval for Open-domain Question Answering," arXiv preprint, arXiv: 2004.04906, 2020.

[115] H. Abdel-Nabi, A. Awajan and M. Z. Ali, "Deep Learning-based Question Answering: A Survey," Knowledge and Information Systems, vol. 65, no. 4, pp. 1399–1485, 2023.

[116] S. T. Chung and R. L. Morris, "Isolation and Characterization of Plasmid Deoxyribonucleic Acid from Streptomyces Fradiae," Paper presented at the 3rd Int. Symposium on the Genetics of Industrial Microorganisms, University of Wisconsin, Madison, 4–9 June 1978.

[117] Z. Hao, A. AghaKouchak, N. Nakhjiri and A. Farahmand, "Global Integrated Drought Monitoring and Prediction System," Scientific Data, vol. 1, p. 853801, 2014.

[118] S. A. Babichev, J. Ries and A. I. Lvovsky, "Quantum Scissors: Teleportation of Single-mode Optical States by Means of a Nonlocal Single Photon," arXiv preprint, arXiv: 0208066v1, 2002.

[119] M. Beneke, G. Buchalla and I. Dunietz, "Mixing Induced CP Asymmetries in Inclusive B Decays," Physics Letters, B393, pp. 132–142, 1997.

[120] P. Bojanowski, E. Grave, A. Joulin and T. Mikolov, "Enriching Word Vectors with Subword Information," Transactions of the Association for Computational Linguistics, vol. 5, pp. 135– 146, 2017.

[121] B. Stahl, "DeepSIP: Deep Learning of Supernova Ia Parameters," Astrophysics Source Code Library, Bibcode: 2020ascl.soft06023S, 2020.

[122] R. Yan, Y. Song and H. Wu, "Learning to Respond with Deep Neural Networks for Retrieval-based Human-computer Conversation System," Proc. of the 39th Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (SIGIR '16), pp. 55–64, 2016.

[123] Y. Wu, W. Wu, C. Xing, M. Zhou and Z. Li, "Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots," arXiv preprint, arXiv: 1612.01627, 2016.

[124] M. Wang, Z. Lu, Hang Li and Q. Liu, "Syntax-based Deep Matching of Short Texts," Proc. of the 24th Int. Joint Conf. on Artificial Intelligence (IJCAI 2015), pp. 1354-1361, 2015.

[125] I. Serban, A. Sordoni, Y. Bengio, A. Courville and J. Pineau, "Building End-to-end Dialogue Systems Using Generative Hierarchical Neural Network Models," Proc. of the AAAI Conf. on Artificial Intelligence, vol. 30, pp. 3776–3783, 2016.

[126] W. Zhang et al., "Context-sensitive Generation of Open-domain Conversational Responses," Proc. of the 27th Int. Conf. on Computational Linguistics, pp. 2437–2447, Santa Fe, New Mexico, USA, 2018.

[127] X. Qiu, T. Sun, Y. Xu, Y. Shao, N. Dai and X. Huang, "Pre-trained Models for Natural Language Processing: A Survey," Science China Technological Sciences, vol. 63, no. 10, pp. 1872–1897, 2020.

[128] K. S. Kalyan, A. Rajasekharan and S. Sangeetha, "AMMUS: A Survey of Transformer-based Pre-trainedModels in Natural Language Processing," arXiv preprint, arXiv: 2108.05542, 2021.

[129] M. E. Peters et al., "Deep Contextualized Word Representations," Proc. of the 2018 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1 (Long Papers), pp. 2227–2237, New Orleans, USA, 2018.

[130] C. Raffel et al., "Exploring the Limits of Transfer Learning with a Unified Text-to-text Transformer," The Journal of Machine Learning Research, vol. 21, no. 1, pp. 5485–5551, 2020.

[131] P. Rajpurkar, J. Zhang, K. Lopyrev and P Liang, "Squad: 100,000+ Questions for Machine Comprehension of Text," arXiv preprint, arXiv: 1606.05250, 2016.

[132] A. Celikyilmaz, E. Clark and J. Gao, "Evaluation of Text Generation: A Survey," arXiv preprint, arXiv: 2006.14799, 2020.

[133] M. Kusner, Y. Sun, N. Kolkin and K. Weinberger, "From Word Embeddings to Document Distances," Proc. of the Int. Conf. on Machine Learning, PMLR, vol. 37, pp. 957-966, 2015.

[134] E. Clark, A. Celikyilmaz and N. A. Smith, "Sentence Mover’s Similarity: Automatic Evaluation for Multi-sentence Texts," Proc. of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 2748–2760, Florence, Italy, 2019.

[135] W. Zhao et al., "MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance," arXiv preprint, arXiv: 1909.02622, 2019.

[136] P. Forner et al., "Evaluating Multilingual Question Answering Systems at CLEF," Proc. of the 7th Int. Conf. on Language Resources and Evaluation (LREC'10), Valletta, Malta, 2010.

[137] A. Peñas and A. Rodrigo, "A SimpleMeasure to Assess Non-response," Proc. of the 49th Annual Meeting of the Association for Computational Linguistics, pp. 1415–1424, Portland Oregon, 2011.

[138] A. El Kholy and N. Habash, "Automatic Error Analysis for Morphologically Rich Languages," Proc. of Machine Translation Summit XIII: Papers, pp. 225-232, 2011.

[139] H. Bouamor, H. Alshikhabobakr, B. Mohit and K. Oflazer, "A Human Judgement Corpus and a Metric for Arabic MT Evaluation," Proc. of the 2014 Conf. on Empirical Methods in Natural Language Processing (EMNLP), pp. 207–213, Doha, Qatar, 2014.

[140] F. Guzmán, H. Bouamor, R. Baly and N. Habash, "Machine Translation Evaluation for Arabic Using Morphologically-enriched Embeddings," Proc. of COLING 2016, the 26th Int. Conf. on Computational Linguistics: Technical Papers, pp. 1398–1408, Osaka, Japan, 2016.

[141] C.-Y. Lin, "ROUGE: A Package for Automatic Evaluation of Summaries," Proc. of Text Summarization Branches Out, pp. 74–81, Association for Computational Linguistics, Barcelona, Spain, 2004.

[142] K. Papineni, S. Roukos, T.Ward and W.-J. Zhu, "BLEU: AMethod for Automatic Evaluation of Machine Translation," Proc. of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318, Philadelphia, USA, 2002.

[143] S. C. Siu, "ChatGPT and GPT-4 for Professional Translators: Exploring the Potential of Large Language Models in Translation," SSRN 4448091, DOI: 10.2139/ssrn.4448091, 2023.

[144] F. Khoshafah, "ChatGPT for Arabic-English Translation: Evaluating the Accuracy," Research Square, DOI: 10.21203/rs.3.rs-2814154/v1, 2023.

[145] M. Abdul-Mageed, A. Elmadany and M. B. Nagoudi, "ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic," arXiv preprint, arXiv: 2101.01785, 2020.

[146] Jared Kaplan et al., "Scaling Laws for Neural Language Models," arXiv: 2001.08361, 2020.

[147] Wayne Xin Zhao et al., "A Survey of Large Language Models," arXiv preprint, arXiv: 2303.18223, 2023.