Data Engineering Podcast


This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.

Support the show!

Rewind 10 seconds
1X
Skip 30 seconds ahead
0:00/0:00

Listen in your favorite app:



More options

Here are shows you might like

See show recommendations
AI Engineering Podcast
Tobias Macey
The Python Podcast.__init__
Tobias Macey

454 Episodes

Building Data Pipelines That Run From Source To Analysis And Activation With Hevo Data - E323

Summary

Any business that wants to understand their operations and customers through data requires some form of pipeline. Building reliable data pipelines is a complex and costly undertaking with many layered requirements. In order to reduce the amount of time and effort required to build pipelines…

Summary

Any business that wants to understand…

12 September 2022 | 00:57:16


A Reflection On Data Observability As It Reaches Broader Adoption - E321

Summary

Data observability is a product category that has seen massive growth and adoption in recent years. Monte Carlo is in the vanguard of companies who have been enabling data teams to observe and understand their complex data systems. In this episode founders Barr Moses and Lior Gavish rejoin…

Summary

Data observability is a product category…

05 September 2022 | 00:58:39


Introduce Climate Analytics Into Your Data Platform Without The Heavy Lifting Using Sust Global - E322

Summary

The global climate impacts everyone, and the rate of change introduces many questions that businesses need to consider. Getting answers to those questions is challenging, because the climate is a multidimensional and constantly evolving system. Sust Global was created to provide curated…

Summary

The global climate impacts everyone, and…

05 September 2022 | 00:54:19


An Exploration Of What Data Automation Can Provide To Data Engineers And Ascend's Journey To Make It A Reality - E320

Summary

The dream of every engineer is to automate all of their tasks. For data engineers, this is a monumental undertaking. Orchestration engines are one step in that direction, but they are not a complete solution. In this episode Sean Knapp shares his views on what constitutes proper automation…

Summary

The dream of every engineer is to…

29 August 2022 | 01:03:33


Alumni Of AirBnB's Early Years Reflect On What They Learned About Building Data Driven Organizations - E319

Summary

AirBnB pioneered a number of the organizational practices that have become the goal of modern data teams. Out of that culture a number of successful businesses were created to provide the tools and methods to a broader audience. In this episode several almuni of AirBnB’s formative…

Summary

AirBnB pioneered a number of the…

28 August 2022 | 01:10:15


An Exploration Of The Expectations, Ecosystem, and Realities Of Real-Time Data Applications - E317

Summary

Data has permeated every aspect of our lives and the products that we interact with. As a result, end users and customers have come to expect interactions and updates with services and analytics to be fast and up to date. In this episode Shruti Bhat gives her view on the state of the…

Summary

Data has permeated every aspect of our…

22 August 2022 | 01:06:20


Understanding The Role Of The Chief Data Officer - E318

Summary

The position of Chief Data Officer (CDO) is relatively new in the business world and has not been universally adopted. As a result, not everyone understands what the responsibilities of the role are, when you need one, and how to hire for it. In this episode Tracy Daniels, CDO of Truist,…

Summary

The position of Chief Data Officer (CDO)…

22 August 2022 | 00:47:11


Bringing Automation To Data Labeling For Machine Learning With Watchful - E316

Summary

Data engineers have typically left the process of data labeling to data scientists or other roles because of its nature as a manual and process heavy undertaking, focusing instead on building automation and repeatable systems. Watchful is a platform to make labeling a repeatable and…

Summary

Data engineers have typically left the…

14 August 2022 | 01:20:29


Collecting And Retaining Contextual Metadata For Powerful And Effective Data Discovery - E315

Summary

Data is useless if it isn’t being used, and you can’t use it if you don’t know where it is. Data catalogs were the first solution to this problem, but they are only helpful if you know what you are looking for. In this episode Shinji Kim discusses the challenges of data…

Summary

Data is useless if it isn’t being…

14 August 2022 | 00:53:24


Useful Lessons And Repeatable Patterns Learned From Data Mesh Implementations At AgileLab - E314

Summary

Data mesh is a frequent topic of conversation in the data community, with many debates about how and when to employ this architectural pattern. The team at AgileLab have first-hand experience helping large enterprise organizations evaluate and implement their own data mesh strategies. In…

Summary

Data mesh is a frequent topic of…

06 August 2022 | 00:48:31