Press release
New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL
Recent research outlines practical methods to speed up machine learning pipelines and improve query performance across large, diverse datasets.Image: https://www.abnewswire.com/upload/2025/08/a93bd65bd7e383afca1989342c6e0ee5.jpg
Phoenix, Arizona, United States of America - Speed is no longer a luxury in data analytics; it is a necessity. A financial service flagging a suspicious payment in time to stop it, or an e-commerce site changing a promotion while a shopper is still browsing, can make all the difference. Yet as data pours in from more sources and is stored in more places, turning it into useful insight without delay has become a bigger challenge than ever.
Two newly published studies in the IEEE Xplore Digital Library by data engineering specialist Vamsi Krishna Eruvaram address this challenge directly. His work focuses on two pressing areas for today's data teams: keeping real time data pipelines running fast enough to feed advanced machine learning, and improving the speed of federated SQL queries that pull information from massive, scattered datasets.
In the first paper, Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures , Eruvaram looks closely at three open source frameworks - Apache Kafka Streams, Apache Flink and Apache Pulsar. Rather than testing them under perfect lab conditions, he recreated the kinds of demands that real businesses face. One scenario simulated fraud detection on live financial transactions, another handled fast-changing recommendations for online shoppers, and a third processed streams of sensor readings from industrial equipment.
Latency, throughput, scalability and resource use were measured. Apache Flink consistently delivered the lowest latency for complex, time-sensitive processing. Kafka Streams was simpler to run and suited for teams already working in the Kafka ecosystem. Pulsar showed strong multi-tenancy and replication capabilities, important for global operations with varying data rules. Instead of naming a single winner, Eruvaram advises matching the choice of tool to the specific workload and operational context.
His second paper, Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach , explores how to speed up queries that must pull data from different systems without moving it into one place first. In many organizations, the data sits in a mix of on-premise clusters, cloud storage and specialized platforms, making transfers costly or restricted by regulation.
Eruvaram's research examines methods to make these federated queries faster and more reliable. He focuses on sending filters to the source data, scanning only the relevant partitions, choosing execution plans based on cost efficiency, and managing workloads to prevent resource bottlenecks. The paper also details ways to keep long-running queries from failing when part of the system goes down.
Tests on multi-terabyte datasets showed query time reductions of up to 62 percent for complex joins, all achieved without new hardware. For organizations, that means faster results without higher infrastructure costs.
Taken together, Eruvaram's studies offer a clear roadmap for handling the speed of incoming data and the complexity of distributed storage. They provide solutions that are both technically sound and grounded in the realities of running large-scale data systems.
Both papers by Vamsi Krishna Eruvaram are available in the IEEE Xplore Digital Library: Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures at https://ieeexplore.ieee.org/document/11088800 and Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach at https://ieeexplore.ieee.org/document/11089251.
Media Contact
Company Name: CB Herald
Contact Person: Ray
Email:Send Email [https://www.abnewswire.com/email_contact_us.php?pr=new-ieee-studies-offer-faster-smarter-approaches-to-real-time-data-and-federated-sql]
City: Phoenix
State: Arizona
Country: United States
Website: http://Cbherald.com
Legal Disclaimer: Information contained on this page is provided by an independent third-party content provider. ABNewswire makes no warranties or responsibility or liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. If you are affiliated with this article or have any complaints or copyright issues related to this article and would like it to be removed, please contact retract@swscontact.com
This release was published on openPR.
Permanent link to this press release:
Copy
Please set a link in the press area of your homepage to this press release on openPR. openPR disclaims liability for any content contained in this release.
You can edit or delete your press release New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL here
News-ID: 4146507 • Views: …
More Releases from ABNewswire
Author's Tranquility Press Announces the Inspiring Memoir How Rich Are You: Are …
Lucretia Ritsert's Journey Through Grief, Faith, and the Hidden Treasures of the Soul
Author's Tranquility Press is proud to spotlight How Rich Are You: Are You Listening [https://www.amazon.com/How-Rich-Are-You-Listening/dp/B0BWPKSCS5/ref=monarch_sidesheet_title], the moving memoir by Lucretia Ritsert that reminds us wealth is measured not in possessions, but in love, faith, and resilience.
Born out of personal loss, Ritsert's story carries readers from the silence of grief into the light of spiritual renewal. The passing of…
Andrew Leigh Honors Women Who Changed the Course Of History In Conversations Wit …
Andrew Leigh, co-founder of Maynard Leigh Associates, a leading UK training provider and much-published business author, has made a striking literary debut with his first non-fiction and non-business book, Conversations with Remarkable Women .
The book comprises imaginary conversations with twenty distinguished and high-achieving women from history. Leigh offers readers a fresh perspective on the lives and legacies of figures such as Catherine the Great, Mary Wollstonecraft, Harriet Tubman, Coco Chanel,…
McKay Law Continues Legacy of Excellence in East Texas Truck Accident Representa …
Record-Breaking Results Speak powerfully for clients
EAST TEXAS - October 27, 2025 - McKay Law, one of East Texas's most respected personal injury law firms, today reaffirmed its position as the region's premier choice for truck accident victims seeking maximum compensation and dedicated legal representation. With a proven track record of multi-million dollar verdicts, rapid-response investigation protocols, and an unwavering commitment to client success, McKay Law continues to set the standard…
Zero-Friction Automation: Anno Robot Offers 'Lifetime System Maintenance' and 90 …
The global retail sector is undergoing its most profound transformation in decades, driven by a confluence of rising labor costs, persistent staffing shortages, and a consumer demand for instant, 24/7 service. In this rapidly evolving landscape, the future of commerce is increasingly defined by automation. At the forefront of this shift is Anno Robot, a Shenzhen-based National High-Tech Enterprise that is not just selling robotic equipment but engineering a 'zero-friction'…
