Data Engineering Podcast


This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.

Support the show!

Rewind 10 seconds
1X
Skip 30 seconds ahead
0:00/0:00

Listen in your favorite app:



More options

Here are shows you might like

See show recommendations
AI Engineering Podcast
Tobias Macey
The Python Podcast.__init__
Tobias Macey

469 Episodes

Power Your Real-Time Analytics Without The Headache Using Fivetran's Change Data Capture Integrations - E328

Summary

Data integration from source systems to their downstream destinations is the foundational step for any data product. With the increasing expecation for information to be instantly accessible, it drives the need for reliable change data capture. The team at Fivetran have recently introduced…

Summary

Data integration from source systems to…

26 September 2022 | 00:49:37


Build A Common Understanding Of Your Data Reliability Rules With Soda Core and Soda Checks Language - E327

Summary

Regardless of how data is being used, it is critical that the information is trusted. The practice of data reliability engineering has gained momentum recently to address that question. To help support the efforts of data teams the folks at Soda Data created the Soda Checks Language and the…

Summary

Regardless of how data is being used, it…

26 September 2022 | 00:41:02


Operational Analytics To Increase Efficiency For Multi-Location Businesses With OpsAnalitica - E325

Summary

In order to improve efficiency in any business you must first know what is contributing to wasted effort or missed opportunities. When your business operates across multiple locations it becomes even more challenging and important to gain insights into how work is being done. In this…

Summary

In order to improve efficiency in any…

19 September 2022 | 01:32:03


Building A Shared Understanding Of Data Assets In A Business Through A Single Pane Of Glass With Workstream - E326

Summary

There is a constant tension in business data between growing siloes, and breaking them down. Even when a tool is designed to integrate information as a guard against data isolation, it can easily become a silo of its own, where you have to make a point of using it to seek out information.…

Summary

There is a constant tension in business…

19 September 2022 | 00:54:52


Build Confidence In Your Data Platform With Schema Compatibility Reports That Span Systems And Domains Using Schemata - E324

Summary

Data engineering systems are complex and interconnected with myriad and often opaque chains of dependencies. As they scale, the problems of visibility and dependency management can increase at an exponential rate. In order to turn this into a tractable problem one approach is to define and…

Summary

Data engineering systems are complex and…

12 September 2022 | 00:59:40


Building Data Pipelines That Run From Source To Analysis And Activation With Hevo Data - E323

Summary

Any business that wants to understand their operations and customers through data requires some form of pipeline. Building reliable data pipelines is a complex and costly undertaking with many layered requirements. In order to reduce the amount of time and effort required to build pipelines…

Summary

Any business that wants to understand…

12 September 2022 | 00:57:16


A Reflection On Data Observability As It Reaches Broader Adoption - E321

Summary

Data observability is a product category that has seen massive growth and adoption in recent years. Monte Carlo is in the vanguard of companies who have been enabling data teams to observe and understand their complex data systems. In this episode founders Barr Moses and Lior Gavish rejoin…

Summary

Data observability is a product category…

05 September 2022 | 00:58:39


Introduce Climate Analytics Into Your Data Platform Without The Heavy Lifting Using Sust Global - E322

Summary

The global climate impacts everyone, and the rate of change introduces many questions that businesses need to consider. Getting answers to those questions is challenging, because the climate is a multidimensional and constantly evolving system. Sust Global was created to provide curated…

Summary

The global climate impacts everyone, and…

05 September 2022 | 00:54:19


An Exploration Of What Data Automation Can Provide To Data Engineers And Ascend's Journey To Make It A Reality - E320

Summary

The dream of every engineer is to automate all of their tasks. For data engineers, this is a monumental undertaking. Orchestration engines are one step in that direction, but they are not a complete solution. In this episode Sean Knapp shares his views on what constitutes proper automation…

Summary

The dream of every engineer is to…

29 August 2022 | 01:03:33


Alumni Of AirBnB's Early Years Reflect On What They Learned About Building Data Driven Organizations - E319

Summary

AirBnB pioneered a number of the organizational practices that have become the goal of modern data teams. Out of that culture a number of successful businesses were created to provide the tools and methods to a broader audience. In this episode several almuni of AirBnB’s formative…

Summary

AirBnB pioneered a number of the…

28 August 2022 | 01:10:15