Data Engineering Podcast


This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.

Support the show!

Rewind 10 seconds
1X
Skip 30 seconds ahead
0:00/0:00

Listen in your favorite app:



More options

Here are shows you might like

See show recommendations
AI Engineering Podcast
Tobias Macey
The Python Podcast.__init__
Tobias Macey

463 Episodes

Declarative Machine Learning Without The Operational Overhead Using Continual - E222

Summary

Building, scaling, and maintaining the operational components of a machine learning workflow are all hard problems. Add the work of creating the model itself, and it’s not surprising that a majority of companies that could greatly benefit from machine learning have yet to either put…

Summary

Building, scaling, and maintaining the…

19 September 2021 | 01:11:52


An Exploration Of The Data Engineering Requirements For Bioinformatics - E221

Summary

Biology has been gaining a lot of attention in recent years, even before the pandemic. As an outgrowth of that popularity, a new field has grown up that pairs statistics and compuational analysis with scientific research, namely bioinformatics. This brings with it a unique set of challenges…

Summary

Biology has been gaining a lot of…

19 September 2021 | 00:55:10


Setting The Stage For The Next Chapter Of The Cassandra Database - E220

Summary

The Cassandra database is one of the first open source options for globally scalable storage systems. Since its introduction in 2008 it has been powering systems at every scale. The community recently released a new major version that marks a milestone in its maturity and stability as a…

Summary

The Cassandra database is one of the…

12 September 2021 | 00:59:29


A View From The Round Table Of Gartner's Cool Vendors - E219

Summary

Gartner analysts are tasked with identifying promising companies each year that are making an impact in their respective categories. For businesses that are working in the data management and analytics space they recognized the efforts of Timbr.ai, Soda Data, Nexla, and Tada. In this…

Summary

Gartner analysts are tasked with…

09 September 2021 | 01:04:16


Designing And Building Data Platforms As A Product - E218

Summary

The term "data platform" gets thrown around a lot, but have you stopped to think about what it actually means for you and your organization? In this episode Lior Gavish, Lior Solomon, and Atul Gupte share their view of what it means to have a data platform, discuss their…

Summary

The term "data platform" gets…

04 September 2021 | 01:00:00


Presto Powered Cloud Data Lakes At Speed Made Easy With Ahana - E217

Summary

The Presto project has become the de facto option for building scalable open source analytics in SQL for the data lake. In recent months the community has focused their efforts on making it the fastest possible option for running your analytics in the cloud. In this episode Dipti Borkar…

Summary

The Presto project has become the de…

02 September 2021 | 01:00:31


Do Away With Data Integration Through A Dataware Architecture With Cinchy - E216

Summary

The reason that so much time and energy is spent on data integration is because of how our applications are designed. By making the software be the owner of the data that it generates, we have to go through the trouble of extracting the information to then be used elsewhere. The team at…

Summary

The reason that so much time and energy…

28 August 2021 | 00:51:27


Decoupling Data Operations From Data Infrastructure Using Nexla - E215

Summary

The technological and social ecosystem of data engineering and data management has been reaching a stage of maturity recently. As part of this stage in our collective journey the focus has been shifting toward operation and automation of the infrastructure and workflows that power our…

Summary

The technological and social ecosystem of…

25 August 2021 | 00:57:48


Let Your Analysts Build A Data Lakehouse With Cuelake - E214

Summary

Data lakes have been gaining popularity alongside an increase in their sophistication and usability. Despite improvements in performance and data architecture they still require significant knowledge and experience to deploy and manage. In this episode Vikrant Dubey discusses his work on…

Summary

Data lakes have been gaining popularity…

21 August 2021 | 00:27:38


Migrate And Modify Your Data Platform Confidently With Compilerworks - E213

Summary

A major concern that comes up when selecting a vendor or technology for storing and managing your data is vendor lock-in. What happens if the vendor fails? What if the technology can’t do what I need it to? Compilerworks set out to reduce the pain and complexity of migrating between…

Summary

A major concern that comes up when…

18 August 2021 | 01:06:09