Skip to content
#federated learning Book Open access

Reliable AI at Scale: Data Engineering for the Intelligent Systems Era — Sample Chapters (Chapters 1 and 4)

Oct 2026 · Zenodo (CERN European Organization for Nuclear Research)
Advanced Database Systems and Queries

Abstract

This free sample edition contains two full chapters of "Reliable AI at Scale: Data Engineering for the Intelligent Systems Era," a book about the data systems artificial intelligence actually stands on. The book's argument: AI systems are data-intensive systems, and their failures are data failures. Included chapters: - Chapter 1: The Data-Intensive AI Stack — the book's thesis and the seven-layer frame (ingestion, storage, processing, orchestration, quality, observability, authority) every later chapter deepens. - Chapter 4: Stream Processing and Real-Time ML — event time, watermarks, and exactly-once semantics, then the ML turn: real-time features, point-in-time correctness, and training-serving skew. The full book has eleven chapters: 1. The Data-Intensive AI Stack 2. Ingestion at Scale: From Events to Actions 3. Storage for Intelligent Systems 4. Stream Processing and Real-Time ML 5. Consistency, Correctness, and Data Quality 6. Feature Engineering and Feature Platforms 7. Orchestration, Sagas, and Long-Running Workflows 8. Federated and Privacy-Preserving Learning 9. MLOps, Feedback Loops, and Continuous Intelligence 10. Autonomous Agents as Data-Intensive Systems 11. Operating AI Systems in Production: Reliability, Observability, Security Each chapter is written to stand alone: an opening production-failure scenario (a fictional composite), the principles that explain it, the architectural patterns that prevent it, trade-offs, and a "what to build first" checklist. About the author: Sai Prasad Veluru is a Senior Software Engineer at Immihub, where he works on distributed systems and production AI. Over eleven years in the industry — including engineering roles at Apple, JPMorgan Chase, and Visa — he has designed and operated high-throughput ingestion platforms, real-time streaming systems, and cloud-native data infrastructure, and he now builds agentic AI systems engineered to survive production. He is the author of twenty-five publications on distributed systems, stream processing, federated learning, and production AI, cited more than 150 times, and he serves as a judge at HackMIT and MHacks. LinkedIn: https://www.linkedin.com/in/saiprasadveluru © 2026 Sai Prasad Veluru — shared freely for reading; all rights reserved.

View source

Similar papers

#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54
#machine learning Review Open access Jun 2014

Why Early-Stage Software Startups Fail: A Behavioral Framework

This state-of-practice investigation was performed using a literature review followed by a multiple-case study approach and presents how inconsistency between managerial strategies and execution can lead to failure by means of a behavioral framework.

Carmine Giardino, Xiaofeng Wang, P. Abrahamsson · 175 citations · ⚡19
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#machine learning Review Open access May 2016

Key Challenges in Software Startups Across Life Cycle Stages

It is found that what perceived as biggest challenges by software startups do vary across different life cycle stages, even though its significance decreases when the learning focuses of the startups move from problem to solution and their products mature.

Xiaofeng Wang, Henry Edison, Sohaib Shahid Bajwa et al. · 62 citations · ⚡6

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.