AUTOMATED ARABIC ESSAY GRADING SYSTEM BASED ON F-SCORE AND ARABIC WORLDNET

(Received: 2019-06-10, Revised: 29-Jul.-2019 and 20-Aug.-2019 , Accepted: 2019-08-24)

Authors Saeda A. Al Awaida, Bassam Al-Shargabi, Thamer Al-Rousan,

Keywords #Automated Essay Grading #Support Vector Machine #Arabic WordNet #Cosine Similarity #Natural Language Processing.

Abstract An Automated Essay Grading (AEG) system is designed to be used in universities, companies and schools, which depends on Artificial Intelligence and Natural Language Processing technologies; as it has the capability to improve the grading system in terms of overcoming cost, time and teacher effort while correcting the students’ essay questions and papers. The AEG system widespread use is due to its cost, accountability, standards and technology; as that leads to the system being used and applied for multiple languages, such as English and French, among others. On the other hand, limited research has been conducted to automate Arabic essay grading. Therefore, this paper introduces an Arabic AEG system. In this paper, we propose a model for Arabic essay grading based on F-score to extract features from student answers and model answers along with the use of the Arabic WordNet (AWN) as a valuable knowledge-based method for semantic similarity. The purpose of using the AWN is to find all related words from student answers to give the answer a student score. Students will not be subject to injustice in terms of their marks in cases when they do not write the exact model answer, which subsequently leads to an improvement of the Arabic AEG system to match human grading. The proposed model is evaluated using Arabic essay dataset and the result shows that our proposed model produces a result which matches human grading.

References

[1] D. Surya, V. Madala, A. Gangal, S. Krishna, G. Anjali and S. Ashish, "An Empirical Analysis of Machine Learning Models for Automated Essay Grading," PeerJ Preprints, pp. 1-14, India, 2018.

[2] V. Ramalingam, A. Pandian, P. Chetry and H. Nigam, "Automated Essay Grading Using Machine Learning Algorithm," Journal of Physics, Conference Series, vol. 1000, p. 012030,[Online], Available: 10.1088/1742-6596/1000/1/012030, 2018.

[3] M. Lilja, Automatic Essay Scoring of Swedish Essays Using Neural Networks, Statistics Uppsala University, 2018.

[4] A. Suresh and M. Jha, "Automated Essay Grading Using Natural Language Processing and Support Vector Machine," International Journal of Computing and Technology, vol. 5, no. 2, 2018.

[5] S. Gunes, K. Polat and S. Yosunkaya, "Multi-class F-Score Selection Approach to Classification of Obstructive Sleep Apnea Syndrome," Expert Syst. Appl., vol. 37, pp. 998-1004, 2010.

[6] W. H. Gomaa and A. A. Fahmy, "A Survey of Text Similarity Approaches," International Journal of Computer Applications, vol. 68, no. 13, 2013.

[7] Y. Regragui, L. Abouenour, F. Krieche, K. Bouzoubaa and P. Rosso, "Arabic WordNet: New Content and New Applications," Proceedings of the 8th Global WordNet Conference, pp. 330-338, 2016.

[8] A. Ewees, A. Mohammed Eisa and M. M. Refaat, "Comparison of Cosine Similarity and kNN Automated Essay Scoring," International Journal of Advanced Research in Computer and Communication Engineering, vol. 3, no. 13, pp. 8669-8673, 2014.

[9] M. Alghamdi, M. Alkanhal, M. Al-Badrashiny, A. Al-Qabbany, A. Areshey and A. Alharbi, "A Hybrid Automatic Scoring System for Arabic Essays," AI Communications, vol. 27, no. 2, pp. 103-111, 2014.

[10] R. Mezher and N. Omar, "A Hybrid Method of Syntactic Feature and Latent Semantic Analysis for Automatic Arabic Essay Scoring," Journal of Applied Sciences, vol. 16, no. 5, 2016.

[11] M. F. Al-Jouie and A. M. Azmi, "Automated Evaluation of School Children Essays in Arabic," Proc. of the 3rd International Conference on Arabic Computational Linguistics, vol. 117, pp.19-22, 2017.

[12] A. R. Abbas and A. S. Al-qaza, "Automated Arabic Essay Scoring (AAES) Using Vector Space Model (VSM)," Journal of Al-Turath University College, vol. 15, pp. 25-39, 2014.

[13] R. Martinez, H. H. Dong and D. Lee, "Automated Essay Scoring System by Using Support Vector Machine," International Journal of Advancements in Computing Technology (IJACT), vol. 5, no. 11, pp. 316-322, 2013.

[14] T. F. Gharib, M. B. Habib and Z. T. Fayed, "Arabic Text Classification Using Support Vector Machines," International Journal of Computers and Their Applications, vol. 16, no. 4, pp. 192-199, 2009.

[15] S. Alsaleem, "An Automated Arabic Text Categorization Using SVM and NB," International Arab Journal of e-Technology, vol. 2, no. 2, pp. 124-128, 2011.

[16] S. S.Aljameel, J. D. O’Shea, K. A. Crockett and A. Latham, "Survey of String Similarity Approaches and the Challenging Faced by the Arabic Language," Proceedings of 11th International Conference on Computer Engineering and Systems, Cairo, Egypt, 2016.

[17] A. Shehab, M. Faroun and M. Rashad, "An Automatic Arabic Essay Grading System Based on Text Similarity Algorithms," International Journal of Advanced Computer Science and Applications, vol. 9, no. 3, 2018.

[18] E. F. Al-Shalabi, "An Automated System for Essay Scoring of Online Exams in Arabic Based on Stemming Techniques and Levenshtein Edit Operations," arXiv preprint, 2016.

[19] B. Al-Shargabi, W. Al-Romimah and F. Olayah, "A Comparative Study for Arabic Text Classification Algorithms Based on Stop Words Elimination," Proceedings of the International Conference on Intelligent Semantic Web-services and Applications (ACM), 2011.

[20] B. Al-Shargabi, F. Olayah and W. W. Romimah, "An Experimental Study for the Effect of Stop Words Elimination for Arabic Text Classification Algorithms," International Journal of Information Technology and Web Engineering (IJITWE), vol. 6, no. 2, pp. 68-75, 2011.

[21] G. Bilal and N. Rasha, "Semantic Analysis Based Customer Reviews Feature Extraction," Journal of Babylon University/Pure and Applied Sciences, vol. 25, no. 3, 2017.

[22] M. H. Nnguyen and F. Torre, "Optimal Feature Selection for Support Vector Machine," Pattern Recognition, vol. 43, pp. 584–591, 2014.