FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator

Massa Baali; Ahmed Ali

FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator

Massa Baali, Ahmed Ali

Qatar Computing Research Institute

Mohamed Bin Zayed University of Artificial Intelligence

Research output: Contribution to journal › Conference article › peer-review

1 Citation (Scopus)

Abstract

This paper presents FOOCTTS, an automatic pipeline for a football commentator that generates speech with background crowd noise. The application gets the text from the user, applies text pre-processing such as vowelization, followed by the commentator's speech synthesizer. Our pipeline included Arabic automatic speech recognition for data labeling, CTC segmentation, transcription vowelization to match speech, and fine-tuning the TTS. Our system is capable of generating speech with its acoustic environment within limited 15 minutes of football commentator recording. Our prototype is generalizable and can be easily applied to different domains and languages.

Original language	English
Pages (from-to)	5249-5250
Number of pages	2
Journal	Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Volume	2023-August
Publication status	Published - 2023
Event	24th International Speech Communication Association, Interspeech 2023 - Dublin, Ireland Duration: 20 Aug 2023 → 24 Aug 2023

Keywords

speech recognition
text-to-speech

Cite this

@article{7071e5b533d7450d80116473349b5511,

title = "FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator",

abstract = "This paper presents FOOCTTS, an automatic pipeline for a football commentator that generates speech with background crowd noise. The application gets the text from the user, applies text pre-processing such as vowelization, followed by the commentator's speech synthesizer. Our pipeline included Arabic automatic speech recognition for data labeling, CTC segmentation, transcription vowelization to match speech, and fine-tuning the TTS. Our system is capable of generating speech with its acoustic environment within limited 15 minutes of football commentator recording. Our prototype is generalizable and can be easily applied to different domains and languages.",

keywords = "speech recognition, text-to-speech",

author = "Massa Baali and Ahmed Ali",

note = "Publisher Copyright: {\textcopyright} 2023 International Speech Communication Association. All rights reserved.; 24th International Speech Communication Association, Interspeech 2023 ; Conference date: 20-08-2023 Through 24-08-2023",

year = "2023",

language = "English",

volume = "2023-August",

pages = "5249--5250",

journal = "Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH",

issn = "2308-457X",

}

TY - JOUR

T1 - FOOCTTS

T2 - 24th International Speech Communication Association, Interspeech 2023

AU - Baali, Massa

AU - Ali, Ahmed

PY - 2023

Y1 - 2023

N2 - This paper presents FOOCTTS, an automatic pipeline for a football commentator that generates speech with background crowd noise. The application gets the text from the user, applies text pre-processing such as vowelization, followed by the commentator's speech synthesizer. Our pipeline included Arabic automatic speech recognition for data labeling, CTC segmentation, transcription vowelization to match speech, and fine-tuning the TTS. Our system is capable of generating speech with its acoustic environment within limited 15 minutes of football commentator recording. Our prototype is generalizable and can be easily applied to different domains and languages.

AB - This paper presents FOOCTTS, an automatic pipeline for a football commentator that generates speech with background crowd noise. The application gets the text from the user, applies text pre-processing such as vowelization, followed by the commentator's speech synthesizer. Our pipeline included Arabic automatic speech recognition for data labeling, CTC segmentation, transcription vowelization to match speech, and fine-tuning the TTS. Our system is capable of generating speech with its acoustic environment within limited 15 minutes of football commentator recording. Our prototype is generalizable and can be easily applied to different domains and languages.

KW - speech recognition

KW - text-to-speech

UR - http://www.scopus.com/inward/record.url?scp=85171590476&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85171590476

SN - 2308-457X

VL - 2023-August

SP - 5249

EP - 5250

JO - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

JF - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Y2 - 20 August 2023 through 24 August 2023

ER -

FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator

Abstract

Keywords

Other files and links

Fingerprint

Cite this