Show simple item record

AuthorKarkar A.
AuthorPuthren M.
AuthorAl-Maadeed S.
Available date2020-03-03T06:19:06Z
Publication Date2018
Publication Name2018 International Conference on Computer and Applications, ICCA 2018
ResourceScopus
URIhttp://dx.doi.org/10.1109/COMAPP.2018.8460239
URIhttp://hdl.handle.net/10576/13149
AbstractScene-To-Speech (STS) is the process of recognizing visual objects in a picture or a video to say aloud a descriptive text that represents the scene. The recent advancement in convolution neural network (CNN), a deep learning feed-forward artificial neural network, enables us to recognize objects on mobile handled devices in real-Time. Several applications have been developed to recognize objects in scenes and speak loud their relevant descriptions. However, the Arabic language is not fully supported. In this paper, we propose a bilingual mobile based application that captures video scenes and processes their content to recognize objects in real-Time. The mobile application will then speak loud, in English or Arabic language, the description of the captured scene. The mobile application can be extended to further support eLearning technologies and edutainment games. People with visual impairments (VI), such as people with low vision and totally blind people, can benefit from the application to know about their surroundings. We conducted an elementary study about the usage of the mobile application with people with VI and they expressed their interest to use it in their daily lives.
SponsorThis publication was supported by Qatar University Collaborative High Impact Grant QUHI-CENG-18/19-1. The findings achieved herein are solely the responsibility of the authors. The contents of this publication do not necessarily represent the official views of the Qatar University.
Languageen
PublisherInstitute of Electrical and Electronics Engineers Inc.
SubjectAssistive Technology
Deep Learning
Object Recognition
Scene-To-Speech
Speech Synthesizer
TitleA Bilingual Scene-To-Speech Mobile Based Application
TypeConference Paper
Pagination236 - 240
dc.accessType Abstract Only


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record