A Generative Approach to Enrich Arabic Story Text with Visual Aids
Author | Zakraoui, Jezia |
Author | Al Maadeed, Somaya |
Author | Abou El-Seoud, Mohamed Samir |
Author | Alja'am, Jihad M. |
Author | Salah, Moutaz |
Available date | 2023-02-23T09:13:03Z |
Publication Date | 2021 |
Publication Name | ACM International Conference Proceeding Series |
Resource | Scopus |
Abstract | Enriching the script of a story with visual aids is an effective approach for promoting language learning and literacy development for young children and learners. In this paper, we propose a new system, that can generate short Arabic stories with generated images that accurately represent the story, scene and context of the given input. We use a text generation technique with a text-to-image synthesis network and minimize the human intervention. We build a corpus of Arabic stories with vocabulary and visualizations. The obtained results with various generative models to create text-image contents show the effectiveness of the proposed approach. The system can be used in education and assist the instructors to build stories on different domains. It can be used in distance learning to deliver online tutorials during COVID-19. |
Sponsor | This work was made possible by NPRP grant #10-0205-170346 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibility of the authors. |
Language | en |
Publisher | Association for Computing Machinery |
Subject | CLIP GAN Story Understanding Story visualization Visual Language Learning |
Type | Conference Paper |
Pagination | 47-52 |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
-
Computer Science & Engineering [2402 items ]