M.Phil / MS

Now showing 1 - 2 of 2

Mono- and Cross-lingual Semantic Word Similarity for Urdu Language
(Library Information Services, COMSATS University Islamabad, Lahore Campus, 2019) Ghazeefa Fatima; FA17-RCS-016; LHR TP 5778; Dr. Muhammad Salman Khan
The process of finding a degree of similarity between words is called semantic word similarity. Machine Translation and information retrieval are common and well distinguishes applications of Semantic Word Similarity. Because of its applications, finding similarity between words is a crucial task and it becomes an important problem of Natural Language Processing. Semantic Word Similarity has two basic types: (1) Mono-lingual Semantic Word Similarity (2) Cross-lingual Semantic Word Similarity. When both words are in the same language it’s called Mono-lingual Semantic Word Similarity, on the other hand, when the both words come across two different languages it’s called Cross-lingual Semantic Word Similarity. Semantic similarity can be detected at many levels i.e. word, sentence, phrase or document level. Urdu is the national language of Pakistan. 11 million people speak it as mother tongue and 105 million people as a second language [1]. According to Riaz [2], it has been estimated that the Urdu language has 300 million speakers in the overall world. The aim of this thesis is to develop mono- and cross-lingual semantic word similarity datasets and models for the Urdu language. The purpose of this study is threefold (1) Create Monolingual Semantic Word Similarity dataset (2) Develop Cross-lingual Semantic Word Similarity dataset (3) Create new models and evaluate pre-trained models using newly created gold standard mono- and cross-lingual corpora. In the first step, we will translate SemEval-500 dataset into Urdu language using Google, Bing and other translation resources. After translation, a linguistic expert verifies the translation and make corrections as required. The verified dataset then assigned to 12 annotators for annotation by following the guidelines provided in SemEval-2014 task 3 [3]. In the second step, the newly created dataset and X SemEval-500 dataset are combined to create a cross-lingual dataset. This dataset is also annotated by 12 annotators by following the same guidelines. We use intra-class correlation coefficient for inter annotator agreement of both mono- and cross-lingual dataset and got r=0.9 with p < .001 for each dataset. In the third step, we create new models for Monolingual semantic Word Similarity and Cross-lingual Semantic Word Similarity. We evaluate these newly created models and pre-trained models using our mono and cross-lingual gold standard datasets. We use person correlation as evaluation measure. In case of monolingual models, we got correlation of 0.54 for corpus based techniques. Fasttext pre-trained Cbow and Skip-gram models got correlation of 0.53 and 0.63 respectively. Ur-Mono based trained fasttext Cbow and Skip-gram models got maximum correlation of 0.63 and 0.67 respectively. For cross-lingual semantic word similarity, we applied Translation Plus Monoligual analysis technique, in which after translation of word pairs, multiple WordNet measures are applied. Path Similarity measure outperform other measures with correlation of 0.70 while using Google translation. In case of Bing translation, Path Similarity and Leacock measure outperform other measures with correlation of 0.71 and 0.71 respectively
Multi-label Document Classification for Urdu Language
(Library Information Services, COMSATS University Islamabad, Lahore Campus, 2019) Madiha Rasool; FA17-RCS-010; LHR TP 5779; Dr. Muhammad Salman Khan
Multi-label document classification is a conventional supervised machine learning task where each document is associated with multiple labels to correctly categorize the meaning of context. All natural languages present this computational linguistic task for a wide series of research domains, such as Natural Language processing, document categorization and text mining. Many benchmark corpora have been developed for multi-label classification task, but most are for English and other European languages. However, there is a dearth of annotated benchmark corpus and methods for the multi-label document classification task for the Urdu language. To fill this gap, we proposed a large benchmark corpus and methods for the multi-label classification of Urdu documents. The proposed corpus contains 600 documents from the field of journalism in the following domains: sports, national, foreign, showbiz and business. The proposed corpus has been manually annotated with USAS (UCREL Semantic Analysis System) scheme which provides 21 major labels and 232 sub labels for fine grained annotation. Each document in the proposed dataset was annotated with minimum two labels and maximum six labels to present a detailed analysis of the context as a supervised multi-label document classification task. To demonstrate how our proposed dataset can be used for the development and evaluation of Urdu multi-label document classification system, three different techniques were applied: (1) Multi-Word Expression (MWE) N-gram (2) Single-Word Expression (SWE) N-gram and (3) Most Frequent Word (MFW) N-gram. Seven different multi-label classifiers were applied on features extracted using three MWE, SWE and MFW methods. Evaluation was carried out using accuracy, exact match, hamming loss and F1 measures. Results show that the (F1 is 0.545) gives best results by using MFW technique on CC and MCC classifier

M.Phil / MS

Browse

Filters

Settings

Sort By

Results per page

Search Results