Improving egyptian-to-English SMT by mapping egyptian into MSA

Nadir Durrani, Yaser Al-Onaizan, Abraham Ittycheriah

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Citations (Scopus)

Abstract

One of the aims of DARPA BOLT project is to translate the Egyptian blog data into English. While the parallel data for MSA-English is abundantly available, sparsely exists for Egyptian-English and Egyptian-MSA. A notable drop in the translation quality is observed when translating Egyptian to English in comparison with translating from MSA to English. One of the reasons for this drop is the high OOV rate, where as another is the dialectal differences between training and test data. This work is focused on improving Egyptian-to-English translation by bridging the gap between Egyptian and MSA. First we try to reduce the OOV rate by proposing MSA candidates for the unknown Egyptian words through different methods such as spelling correction, suggesting synonyms based on context etc. Secondly we apply convolution model using English as a pivot to map Egyptian words into MSA. We then evaluate our edits by running decoder built on MSA-to-English data. Our spelling-based correction shows an improvement of 1.7 BLEU points over the baseline system, that translates unedited Egyptian into English.

Original languageEnglish
Title of host publicationComputational Linguistics and Intelligent Text Processing - 15th International Conference, CICLing 2014, Proceedings
PublisherSpringer Verlag
Pages271-282
Number of pages12
EditionPART 2
ISBN (Print)9783642549021
DOIs
Publication statusPublished - 2014
Externally publishedYes
Event15th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2014 - Kathmandu, Nepal
Duration: 6 Apr 201412 Apr 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume8404 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2014
Country/TerritoryNepal
CityKathmandu
Period6/04/1412/04/14

Fingerprint

Dive into the research topics of 'Improving egyptian-to-English SMT by mapping egyptian into MSA'. Together they form a unique fingerprint.

Cite this