Crosslingual automatic diacritization for Egyptian Colloquial Dialect
المؤلف | Zayyan, Ayman A. |
المؤلف | Elmahdy, Mohamed |
المؤلف | Husni, Husniza Binti |
المؤلف | Yousf, Shahrul Azmi |
تاريخ الإتاحة | 2021-09-01T10:02:46Z |
تاريخ النشر | 2016 |
اسم المنشور | Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA |
المصدر | Scopus |
الملخص | In this paper, the problem of missing diacritic marks in most of dialectal Arabic written resources is addressed. Our aim is to implement a scalable and extensible platform for automatically retrieving the diacritic marks for undiacritized dialectal Arabic texts. Different rule-based and statistical techniques are proposed. These include: morphological analyzer-based, maximum likelihood estimate, and statistical n-gram models. The proposed platform includes helper tools for text preprocessing and encoding conversion. Diacritization accuracy of each technique is evaluated in terms of Diacritic Error Rate (DER) and Word Error Rate (WER). The approach trains several n-gram models on different lexical units. A data pool of both Modern Standard Arabic (MSA) data along with Dialectal Arabic data was used to train the models. 2016 IEEE. |
اللغة | en |
الناشر | IEEE Computer Society |
الموضوع | Text processing Diacritization Dialectal arabics Maximum likelihood estimate Modern standards Morphological analyzer Statistical techniques Text preprocessing Vowelization Maximum likelihood estimation |
النوع | Conference Paper |
الملفات في هذه التسجيلة
الملفات | الحجم | الصيغة | العرض |
---|---|---|---|
لا توجد ملفات لها صلة بهذه التسجيلة. |
هذه التسجيلة تظهر في المجموعات التالية
-
علوم وهندسة الحاسب [2288 items ]