Smartphone-based food recognition system using multiple deep CNN models
Author | Fakhrou A. |
Author | Kunhoth J. |
Author | Al-Maadeed, Somaya |
Available date | 2022-05-19T10:23:07Z |
Publication Date | 2021 |
Publication Name | Multimedia Tools and Applications |
Resource | Scopus |
Identifier | http://dx.doi.org/10.1007/s11042-021-11329-6 |
Abstract | People with blindness or low vision utilize mobile assistive tools for various applications such as object recognition, text recognition, etc. Most of the available applications are focused on recognizing generic objects. And they have not addressed the recognition of food dishes and fruit varieties. In this paper, we propose a smartphone-based system for recognizing the food dishes as well as fruits for children with visual impairments. The Smartphone application utilizes a trained deep CNN model for recognizing the food item from the real-time images. Furthermore, we develop a new deep convolutional neural network (CNN) model for food recognition using the fusion of two CNN architectures. The new deep CNN model is developed using the ensemble learning approach. The deep CNN food recognition model is trained on a customized food recognition dataset.The customized food recognition dataset consists of 29 varieties of food dishes and fruits. Moreover, we analyze the performance of multiple state of art deep CNN models for food recognition using the transfer learning approach. The ensemble model performed better than state of art CNN models and achieved a food recognition accuracy of 95.55 % in the customized food dataset. In addition to that, the proposed deep CNN model is evaluated in two publicly available food datasets to display its efficacy for food recognition tasks. |
Sponsor | This publication was made possible by Qatar University collaborative grant number QUCG-CED-20/21-2 from the Qatar University. The findings achieved herein are solely the responsibility of the author. |
Language | en |
Publisher | Springer |
Subject | Arts computing Convolutional neural networks Deep neural networks Fruits Learning systems Object recognition Smartphones Transfer learning Ensemble learning approach Ensemble modeling Real time images Recognition accuracy Recognition models Recognition systems Smart-phone applications Visual impairment Character recognition |
Type | Article |
Pagination | 33011-33032 |
Issue Number | 21-23 |
Volume Number | 80 |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
-
Computer Science & Engineering [2288 items ]