Arabic Diacritic Recovery Using a Feature-rich biLSTM Model

Kareem Darwish, Ahmed Abdelali, Hamdy Mubarak, Mohamed Eldesouki

Research output: Contribution to journalArticlepeer-review

12 Citations (Scopus)

Abstract

Diacritics (short vowels) are typically omitted when writing Arabic text, and readers have to reintroduce them to correctly pronounce words. There are two types of Arabic diacritics: The first are core-word diacritics (CW), which specify the lexical selection, and the second are case endings (CE), which typically appear at the end of word stems and generally specify their syntactic roles. Recovering CEs is relatively harder than recovering core-word diacritics due to inter-word dependencies, which are often distant. In this article, we use feature-rich recurrent neural network model that use a variety of linguistic and surface-level features to recover both core word diacritics and case endings. Our model surpasses all previous state-of-The-Art systems with a CW error rate (CWER) of 2.9% and a CE error rate (CEER) of 3.7% for Modern Standard Arabic (MSA) and CWER of 2.2% and CEER of 2.5% for Classical Arabic (CA). When combining diacritized word cores with case endings, the resultant word error rates are 6.0% and 4.3% for MSA and CA, respectively. This highlights the effectiveness of feature engineering for such deep neural models.

Original languageEnglish
Article number33
JournalACM Transactions on Asian and Low-Resource Language Information Processing
Volume20
Issue number2
DOIs
Publication statusPublished - Apr 2021

Keywords

  • Arabic
  • diacritization
  • text tagging

Fingerprint

Dive into the research topics of 'Arabic Diacritic Recovery Using a Feature-rich biLSTM Model'. Together they form a unique fingerprint.

Cite this