Generating Images from Arabic Story-Text using Scene Graph

Abstract

In this paper, we propose a new approach to generate descriptive images from simple Arabic text of stories for children to build a flexible and rich multimedia repository. To make it successful, we need to transform the actors and objects and their semantic relationships from the text in compact and structured entities. We use the scene graph representation that considers objects together with their attributes and relationships. In fact, this representation has been proven to be useful across a variety of vision and language applications. We extend, thereby the notion of image generation to our approach as the task of constructing new scenes based on a set of toolboxes and a set of generated images for common textual descriptions. Our preliminary results show that the image repository is very efficient, saving then huge storage space. Besides, the composed scenes using the generated images could be customized providing a fair understanding of the main actors/objects of the stories as well as a coherent visual layout of the scenes.