Turkish Journal of Computer and Mathematics Education
Journal license

Journal

Turkish Journal of Computer and Mathematics Education


Volume
& Issue

Volume 11, Issue 2


Published
on


Pages

1347-1358


DOI

Article

Real-Time Analytics with Hadoop: Integrating Streaming Engines for Performance Gains

Check for updates


Authors

Harsha Vardhan Reddy Goli Affiliation:
Software Developer, Alephys LLC, Texas, USA


Abstract

The rising demand for real-time data analytics in domains such as the Internet of Things (IoT) and telecommunications necessitates hybrid big data architectures that seamlessly combine batch and stream processing. This study investigates the integration of Hadoop with real-time streaming engines, specifically Apache Storm and Apache Flink, to address the challenges of low-latency analytics within traditional big data frameworks. We analyze performance trade-offs, latency mitigation techniques, and fault tolerance mechanisms involved in such hybrid deployments. Through benchmarking and architectural evaluation, the research identifies key design considerations, including pipeline optimization and efficient resource management strategies that support concurrent batch and real-time workloads. Empirical insights from IoT and telecom use cases illustrate the effectiveness of integrating Hadoop's scalable storage with the high-throughput, low-latency processing capabilities of modern stream engines. The findings affirm the practicality and performance benefits of adopting a unified analytics ecosystem for real-time data-driven decision-making.


Keywords

Hadoop, Real-time analytics, Apache Storm, Apache Flink, Hybrid big data architecture


Citation

Goli, H. V. R. (2020). Real-time analytics with hadoop: Integrating streaming engines for performance gains. Turkish Journal of Computer and Mathematics Education, 11(2), 1347–1358. https://doi.org/10.61841/turcomat.v11i2.15250

Published by: Engineering Journals

Engineering Journals Logo