Department of Computer Science
Permanent URI for this communityhttps://repository.cuilahore.edu.pk/handle/123456789/16
Browse
2 results
Search Results
Item Developing a Gold Standard Benchmark Corpus and Methods for Multi-label Emotion Classification for Urdu Language(Library Information Services, COMSATS University Islamabad, Lahore Campus, 2023) Azqa Abdul Ghani; SP22-RCS-025; LHR TP 8685; Dr. Rao Muhammad Adeel NawabEmotion Classification (EC) involves detecting the emotional tone conveyed by text, while Multi-Label Emotion Classification (MLEC) aims to assign relevant emotion labels that accurately reflect the author's state of mind. This research focuses on MLEC in Urdu text. In previous studies, only one work has been done for the problem of MLEC, including the development of a dataset based on Urdu Tweets using six emotions [5]. However, the problem of MLEC has not been explored for 12 emotions and diverse genres. To fulfill this research gap, this research study has developed a large benchmark corpus of 16,011 Urdu reviews, manually annotated with 12 emotions and gathered from 9 different genres. Furthermore, this research study has Developed, Applied, Evaluated, and Compared Classical Machine Learning, Deep Learning and Transfer Learning based methods. Whereas in Transfer Learning methods, we have implied 6 distinct sentence transformers (xlm-r-100langs-bert-base-nli-stsb-mean-tokens, xlm-r-100langs-bert-base nli-mean-tokens, gtr-t5-large, all-mpnet-base-v2, distiluse-base-multilingual-cased-v2, and LaBSE), Also the Combined Feature-based approach is applied which averages the features of all the columns of the sentence transformer model and then the Machine Learning models are applied. The proposed transformers-based approach outperforms with an F1 score of 0.4562 using the ‘xlm-r-100langs-bert-base-nli-stsb-mean-tokens’ sentence transformerItem Cross-genre Multi-label Emotion Classification on Mono-lingual and Code-mixed Texts(Library Information Services, COMSATS University Islamabad, Lahore Campus, 2023) Ahmad Mahmood; LHR TP 8472; FA21-RCS-008; Dr. Rao Muhammad Adeel NawabThis research focuses on This research focuses on Emotion Classification (EC) in textual data and explores the problem of Cross-genre Multi-Label Emotion Classification (CGMLEC). EC involves detecting the emotional attitude conveyed by text, while Multi-Label Emotion Classification aims to assign relevant emotion labels that accurately reflect the author's state of mind. In previous studies most of the work has been done using Same-genre Multi-label Emotion Classification [2], [14]–[16]. Whereas there is only one article that solves the problem of CGMLEC, but the language is the same. However, the problem of CGMLEC has not explored using mono-lingual (English tweets) and code-mixed (SMS messages). Secondly, this research study has Developed, Applied, Evaluated, and Compared Classical Machine Learning, Deep Learning and Transfer Learning based methods. Whereas in Transfer Learning methods we have implied 5 distinct sentence transformers (all-distilroberta-v1, all-MiniLM-L12-v2, all-mpnet-base-v2, facebook-dpr-question_encoder-single-nq-base, and LaBSE), Also the Feature Fussion based approach is applied which combines the features of all the transformers and then the Machine Learning models are applied. The proposed transformers-based approach outperforms with an F1 score of 0.3333 using all-distilroberta-v1 transformer. ) in textual data and explores the problem of Cross-genre Multi-Label Emotion Classification (CGMLEC). EC involves detecting the emotional attitude conveyed by text, while Multi-Label Emotion Classification aims to assign relevant emotion labels that accurately reflect the author's state of mind. In previous studies most of the work has been done using Same-genre Multi-label Emotion Classification [2], [14]–[16]. Whereas there is only one article that solves the problem of CGMLEC, but the language is the same. However, the problem of CGMLEC has not explored using mono-lingual (English tweets) and code-mixed (SMS messages). Secondly, this research study has Developed, Applied, Evaluated, and Compared Classical Machine Learning, Deep Learning and Transfer Learning based methods. Whereas in Transfer Learning methods we have implied 5 distinct sentence transformers (all-distilroberta-v1, all-MiniLM-L12-v2, all-mpnet-base-v2, facebook-dpr-question_encoder-single-nq-base, and LaBSE), Also the Feature Fussion based approach is applied which combines the features of all the transformers and then the Machine Learning models are applied. The proposed transformers-based approach outperforms with an F1 score of 0.3333 using all-distilroberta-v1 transformer.