The Joe Reis Show

For 40+ years, the data industry has tried to teach good practices and get adoption, often in the same way. And for 40+ years, that approach keeps failing over and over. Based on the recent Practical Data Community Survey, practitioners face challenges like time pressures, lack of direction, and lack of clear ownership. Do we need to try something else as an industry? Or do we continue to be the poster child for the definition of insanity - doing the same thing over and over, yet expecting different results? I hope not.

Why are we still using row-based protocols like ODBC and JDBC in a column-oriented world? In this episode, I sit down with Ian Cook, co-founder of Columnar and a long-time Apache Arrow contributor, to discuss the critical infrastructure changes needed to speed up modern analytics and AI.
We dive deep into the technical bottlenecks of legacy standards - specifically the "serialization tax" of converting columns to rows and back again - and how ADBC (Arrow Database Connectivity) solves this by keeping data columnar from end-to-end. Ian also shares his insights on the intersection of tabular data and LLMs, why AI agents need better access to OLAP systems, and the tension between vibe coding speed and the stability required for critical open-source infrastructure.

The 2026 Practical Data Community State of Data Engineering dropped this week. It's full of some obvious and very counterintuitive information about the state of data engineers around the globe, in all sizes and types of organizations. Check it out!
Also, I talk about the book writing process, where I messed up on this latest book, it's progress toward publication, and more.

Survey: https://joereis.github.io/practical_data_data_eng_survey

---------------------
This episode is brought to you by Ellie.ai
Ellie makes data modeling as easy as sketching on a whiteboard—so even business stakeholders can contribute effortlessly. By skipping redraws, rework, and forgotten context, and by keeping all dependencies in sync, teams report saving up to 78% of modeling time.
Check out Ellie: https://ellie.ai/

I sat down with Paul Dudley (CEO) and Ricky Thomas (CTO) from StreamKap to catch up on where the world of streaming data is heading—and things have changed fast since we last spoke.

We dive into the concept of "vibe coding" and how AI is radically accelerating how we build software (I even share a story about building a data analysis tool in an hour). But the real meat of this conversation is about the intersection of streaming data and AI agents. Everyone is building agents, but without real-time context, they’re flying blind. We discuss why streaming is a missing link for agentic workflows, the shift from dashboards to automated decision-making, and why SaaS companies are racing to build walled gardens around their data.

We also get into the nitty-gritty of the UK vs. US tech markets, the resurgence of PR in the AI era, and StreamKap’s upcoming move into the Snowflake native app ecosystem.

Streamkap: https://streamkap.com/

This week was a doozy with new AI releases, the stock market, and more. It really feels like this was the first tremor in AI's impact on the SaaS market. What's do I think is next? Listen and find out.