openPR Logo
Press release

New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL

08-15-2025 07:08 PM CET | Business, Economy, Finances, Banking & Insurance

Press release from: ABNewswire

New IEEE Studies Offer Faster, Smarter Approaches to Real Time

Recent research outlines practical methods to speed up machine learning pipelines and improve query performance across large, diverse datasets.
Image: https://www.abnewswire.com/upload/2025/08/a93bd65bd7e383afca1989342c6e0ee5.jpg

Phoenix, Arizona, United States of America - Speed is no longer a luxury in data analytics; it is a necessity. A financial service flagging a suspicious payment in time to stop it, or an e-commerce site changing a promotion while a shopper is still browsing, can make all the difference. Yet as data pours in from more sources and is stored in more places, turning it into useful insight without delay has become a bigger challenge than ever.

Two newly published studies in the IEEE Xplore Digital Library by data engineering specialist Vamsi Krishna Eruvaram address this challenge directly. His work focuses on two pressing areas for today's data teams: keeping real time data pipelines running fast enough to feed advanced machine learning, and improving the speed of federated SQL queries that pull information from massive, scattered datasets.

In the first paper, Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures , Eruvaram looks closely at three open source frameworks - Apache Kafka Streams, Apache Flink and Apache Pulsar. Rather than testing them under perfect lab conditions, he recreated the kinds of demands that real businesses face. One scenario simulated fraud detection on live financial transactions, another handled fast-changing recommendations for online shoppers, and a third processed streams of sensor readings from industrial equipment.

Latency, throughput, scalability and resource use were measured. Apache Flink consistently delivered the lowest latency for complex, time-sensitive processing. Kafka Streams was simpler to run and suited for teams already working in the Kafka ecosystem. Pulsar showed strong multi-tenancy and replication capabilities, important for global operations with varying data rules. Instead of naming a single winner, Eruvaram advises matching the choice of tool to the specific workload and operational context.

His second paper, Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach , explores how to speed up queries that must pull data from different systems without moving it into one place first. In many organizations, the data sits in a mix of on-premise clusters, cloud storage and specialized platforms, making transfers costly or restricted by regulation.

Eruvaram's research examines methods to make these federated queries faster and more reliable. He focuses on sending filters to the source data, scanning only the relevant partitions, choosing execution plans based on cost efficiency, and managing workloads to prevent resource bottlenecks. The paper also details ways to keep long-running queries from failing when part of the system goes down.

Tests on multi-terabyte datasets showed query time reductions of up to 62 percent for complex joins, all achieved without new hardware. For organizations, that means faster results without higher infrastructure costs.

Taken together, Eruvaram's studies offer a clear roadmap for handling the speed of incoming data and the complexity of distributed storage. They provide solutions that are both technically sound and grounded in the realities of running large-scale data systems.

Both papers by Vamsi Krishna Eruvaram are available in the IEEE Xplore Digital Library: Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures at https://ieeexplore.ieee.org/document/11088800 and Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach at https://ieeexplore.ieee.org/document/11089251.

Media Contact
Company Name: CB Herald
Contact Person: Ray
Email:Send Email [https://www.abnewswire.com/email_contact_us.php?pr=new-ieee-studies-offer-faster-smarter-approaches-to-real-time-data-and-federated-sql]
City: Phoenix
State: Arizona
Country: United States
Website: http://Cbherald.com

Legal Disclaimer: Information contained on this page is provided by an independent third-party content provider. ABNewswire makes no warranties or responsibility or liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. If you are affiliated with this article or have any complaints or copyright issues related to this article and would like it to be removed, please contact retract@swscontact.com



This release was published on openPR.

Permanent link to this press release:

Copy
Please set a link in the press area of your homepage to this press release on openPR. openPR disclaims liability for any content contained in this release.

You can edit or delete your press release New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL here

News-ID: 4146507 • Views:

More Releases from ABNewswire

Morocco Packages Holidays Named Premier Choice for Unforgettable Moroccan Adventures as Tourism Surges
Morocco Packages Holidays Named Premier Choice for Unforgettable Moroccan Advent …
Marrakech, Morocco - 15 Aug, 2025 - As Morocco continues to experience a remarkable tourism boom, Morocco Packages Holidays [https://moroccopackagesholidays.com/] has emerged as the go-to travel company for adventurers seeking authentic and unforgettable experiences across this vibrant North African destination. With expertly curated itineraries, personalized service, and a passion for showcasing Morocco's diverse beauty, the company is setting a new standard in travel. From the bustling souks of Marrakech to the
TikTok Food Creator Burgerman Serj Turns Burgers into Support for Homeless Communities
TikTok Food Creator Burgerman Serj Turns Burgers into Support for Homeless Commu …
TikTok creator Burgerman Serj is using livestream burger sales to support efforts against homelessness in the UK, and he is now funding his mobile kitchen with merchandise sales. Image: https://www.abnewswire.com/upload/2025/08/04d2bb2da1db5d3c4794c3f4de250f7d.jpg Burgerman Serj, a content creator from Chatham, Kent, has taken an everyday food stall and turned it into a platform for consistent outreach. Known for livestreaming on TikTok @burgermanserj [https://www.tiktok.com/@burgermanserj], he cooks burgers while interacting with viewers, many of whom choose to
Prime Dumpster Announces Roll-Off Dumpster Service Expansion in Houston, TX for City's Construction, Entertainment, and Other Industries
Prime Dumpster Announces Roll-Off Dumpster Service Expansion in Houston, TX for …
Prime Dumpster is a leading facilitator of waste management solutions, offering temporary roll off dumpster rentals for events, construction, and more. With a focus on customer satisfaction and tailored services, Prime Dumpster ensures clients receive dependable waste management solutions across the United States. HOUSTON - Prime Dumpster has launched an ambitious expansion of roll-off container services specifically targeting the 77036 ZIP code - one of the Bayou City's most diverse commercial
Dutch Rentals Vanish in Hours, Leaving U.S. Expats in Hyper-Competitive Housing Market
Dutch Rentals Vanish in Hours, Leaving U.S. Expats in Hyper-Competitive Housing …
Rental platform HousingMatchers gives renters a critical speed advantage as market data reveals homes are often gone within a day. AMSTERDAM - August 15, 2025 - For the growing number of Americans relocating to the Netherlands, the search for a long-term rental has become a daunting race against time. With a national housing deficit approaching 400,000 homes, according to recent government estimates, the competition is staggering. In sought-after cities like Amsterdam,

All 5 Releases