Saima ShaukatFA18-RCS-009LHR TP 5987Dr. Rao Muhammad Adeel Nawab2026-02-132020https://repository.cuilahore.edu.pk/handle/123456789/1519Lemmatization is the process of finding the root form of a word. Lemmatization is used as preprocessing step for most of the NLP applications. Lemmatization is im portant part of NLP applications which involve the use of root form instead of using derivational forms of words. Text mining, information retrieval systems, document clustering, search engines and text categorizations are few of the applications where lemmatization process is used. Urdu is a widely spoken language in the world, but very less work has been done on developing basic NLP tools for this language, one of them is Urdu lemmatizer. Since Urdu is a morphologically rich language and has words with many inflectional and derivational forms, development of an efficient lemmatizer is a challenging task and it will be useful for many Urdu NLP applications. These challenges help us to choose the customized and more appropriate approach for Urdu lemmatization which is dictionary-based approach. The main aim of this research work is to develop an Urdu lemmatizer. To develop the efficient Urdu lemmatizer, we used dictionary look-up approach. Majority of exist ing lemmatizers are of in English and other European languages. Most of the existing lemmatizers are rule based and also the information about parts of speech tags is ig nored. Development of large dictionaries for Urdu Language is also missing in existing work. To fulfill this gap, the main goals of the study are: (1) Develop a large bench mark corpus for the Urdu language and (2) Explore the relationship between parts of speech tag and lemmatizer (3) Developed the standard approach for Urdu lemmatizer. The first major contribution of this study is the development of a large benchmark Urdu dictionary. The proposed corpus was developed in the following steps: (1) In the first step we collected data from two different sources: urmono corpus and Wikipedia dump (2) Preprocess and tokenize the collected data (3) extract the frequency of each word using python script (4) Selection of most frequent words (5) Assign parts of speech ix tags to selected words (6) manually annotate data (assign lemma to each word) (7) De velop a benchmark corpus and save in a standard csv format. Second major contribution of this research work is exploring the relationship be tween POS tag and lemma of a word. Train the POS tagger on collected Wikipedia dump and then used in the development of Urdu lemmatizer because user can enter input with or without POS tags. If user will enter input without POS tag, tagger will assign most frequent used tag to the word before generating lemma of a word. As a third major contribution of this research work, proposed a dictionary-based approach for Urdu lemmatizer. As the Urdu is morphological rich language; it also includes many Persian, Turkish and Arabic words. So, for the efficient lemmatizer, dictionary-based approach is more suitable. The evaluation was carried out using two techniques (1) With-POS-DLA (2) Without-POS-DLA. We achieved accuracy of 66.79% and 76.44% respectively. The best result is achieved by using Without-POS DLA technique.enDr. Rao Muhammad Adeel Nawabfa18Department of Computer ScienceComputer ScienceUrdu LemmatizerNLP applicationsThesis