Show simple item record

AuthorAurangzaib, Rana
AuthorIqbal, Waheed
AuthorAbdullah, Muhammad
AuthorBukhari, Faisal
AuthorUllah, Faheem
AuthorErradi, Abdelkarim
Available date2023-04-10T09:10:04Z
Publication Date2022
Publication NameProceedings of the International Conference on Cloud Computing Technology and Science, CloudCom
ResourceScopus
URIhttp://dx.doi.org/10.1109/CloudCom55334.2022.00014
URIhttp://hdl.handle.net/10576/41803
AbstractWith the widespread usage of IoT, processing data streams in real-time have become very important. The traditional data-stream processing systems are inefficient in processing big data for detecting anomalies, classifications, clustering, and prediction in real-time using minimal resources. In this paper, we address this limitation by proposing a scalable pipeline for real-time processing of big data streams. Our proposed solution is capable of dynamically managing resources for different components of the pipeline using automatic scaling. The pipeline is containerized and deployed on a Kubernetes cluster. The proposed scalable pipeline is evaluated using a case study of anomaly detection in IoT data. The proposed solution yields a x 1.31 to x 2.4 increase in throughput, and x 32 to x 80 decreased latency compared to the commonly used static resource allocation strategy for data pipelines. 2022 IEEE.
Languageen
PublisherIEEE Computer Society
SubjectAnomaly detection
Auto-scaling
Big Data Analytics
Data Pipeline
IoT
Real-time
TitleScalable Containerized Pipeline for Real-time Big Data Analytics
TypeConference Paper
Pagination25-32
Volume Number2022-December
dc.accessType Abstract Only


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record