Enhancing Arabic Content Generation with Prompt Augmentation Using Integrated GPT and Text-to-Image Models

Wala Elsharif, James She, Preslav Nakov, Simon Wong

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

With the current and continuous advancements in the field of text-to-image modeling, it has become critical to design prompts that make the best of these model capabilities and guides them to generate the most desirable images, and thus the field of prompt engineering has emerged. Here, we study a method to use prompt engineering to enhance text-to-image model representation of the Arabic culture. This work proposes a simple, novel approach for prompt engineering that uses the domain knowledge of a state-of-the-art language model, GPT, to perform the task of prompt augmentation, where a simple, initial prompt is used to generate multiple, more detailed prompts related to the Arabic culture from multiple categories through a GPT model through a process known as in-context learning. The augmented prompts are then used to generate images enhanced for the Arabic culture. We perform multiple experiments with a number of participants to evaluate the performance of the proposed method, which shows promising results, specially for generating prompts that are more inclusive of the different Arabic countries and with a wider variety in terms of image subjects, where we find that our proposed method generates image with more variety 85 % of the time and are more inclusive of the Arabic countries more than 72.66 % of the time, compared to the direct approach.

Original languageEnglish
Title of host publicationProceedings Of The 2023 Acm International Conference On Interactive Media Experiences, Imx 2023
PublisherAssociation for Computing Machinery, Inc
Pages276-288
Number of pages13
ISBN (Electronic)9798400700286
DOIs
Publication statusPublished - 12 Jun 2023
Event2023 ACM International Conference on Interactive Media Experiences, IMX 2023 - Nantes, France
Duration: 12 Jun 202315 Jun 2023

Publication series

NameIMX 2023 - Proceedings of the 2023 ACM International Conference on Interactive Media Experiences

Conference

Conference2023 ACM International Conference on Interactive Media Experiences, IMX 2023
Country/TerritoryFrance
CityNantes
Period12/06/2315/06/23

Keywords

  • Arabic culture
  • Gpt
  • Integrated systems
  • Prompt engineering

Fingerprint

Dive into the research topics of 'Enhancing Arabic Content Generation with Prompt Augmentation Using Integrated GPT and Text-to-Image Models'. Together they form a unique fingerprint.

Cite this