1X
0:00/0:00
Data Engineering Podcast
This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.
Support the show!Listen in your favorite app:
Fountain
TrueFans
Podverse
Podcast Guru
Apple Podcasts
Spotify
Pick your app with Episodes.fm
Here are shows you might like
See show recommendations
Tobias Macey
Tobias Macey
Prepare Your Unstructured Data For Machine Learning And Computer Vision Without The Toil Using Activeloop - E212
Summary
The vast majority of data tools and platforms that you hear about are designed for working with structured, text-based data. What do you do when you need to manage unstructured information, or build a computer vision model? Activeloop was created for exactly that purpose. In this episode…
Summary
The vast majority of data tools and…
15 August 2021 | 00:48:39
Build Trust In Your Data By Understanding Where It Comes From And How It Is Used With Stemma - E211
Summary
All of the fancy data platform tools and shiny dashboards that you use are pointless if the consumers of your analysis don’t have trust in the answers. Stemma helps you establish and maintain that trust by giving visibility into who is using what data, annotating the reports with…
Summary
All of the fancy data platform tools and…
10 August 2021 | 00:52:37
Data Discovery From Dashboards To Databases With Castor - E210
Summary
Every organization needs to be able to use data to answer questions about their business. The trouble is that the data is usually spread across a wide and shifting array of systems, from databases to dashboards. The other challenge is that even if you do find the information you…
Summary
Every organization needs to be able to…
07 August 2021 | 00:52:47
Charting A Path For Streaming Data To Fill Your Data Lake With Hudi - E209
Summary
Data lake architectures have largely been biased toward batch processing workflows due to the volume of data that they are designed for. With more real-time requirements and the increasing use of streaming data there has been a struggle to merge fast, incremental updates with large,…
Summary
Data lake architectures have largely been…
03 August 2021 | 01:09:37
Adding Context And Comprehension To Your Analytics Through Data Discovery With SelectStar - E208
Summary
Companies of all sizes and industries are trying to use the data that they and their customers generate to survive and thrive in the modern economy. As a result, they are relying on a constantly growing number of data sources being accessed by an increasingly varied set of users. In order…
Summary
Companies of all sizes and industries are…
31 July 2021 | 00:51:23
Building a Multi-Tenant Managed Platform For Streaming Data With Pulsar at Datastax - E207
Summary
Everyone expects data to be transmitted, processed, and updated instantly as more and more products integrate streaming data. The technology to make that possible has been around for a number of years, but the barriers to adoption have still been high due to the level of technical…
Summary
Everyone expects data to be transmitted,…
28 July 2021 | 01:00:13
Bringing The Metrics Layer To The Masses With Transform - E206
Summary
Collecting and cleaning data is only useful if someone can make sense of it afterward. The latest evolution in the data ecosystem is the introduction of a dedicated metrics layer to help address the challenge of adding context and semantics to raw information. In this episode Nick Handel…
Summary
Collecting and cleaning data is only…
23 July 2021 | 01:01:17
Strategies For Proactive Data Quality Management - E205
Summary
Data quality is a concern that has been gaining attention alongside the rising importance of analytics for business success. Many solutions rely on hand-coded rules for catching known bugs, or statistical analysis of records to detect anomalies retroactively. While those are useful tools,…
Summary
Data quality is a concern that has been…
20 July 2021 | 01:01:07
Low Code And High Quality Data Engineering For The Whole Organization With Prophecy - E204
Summary
There is a wealth of tools and systems available for processing data, but the user experience of integrating them and building workflows is still lacking. This is particularly important in large and complex organizations where domain knowledge and context is paramount and there may not be…
Summary
There is a wealth of tools and systems…
16 July 2021 | 01:12:35
Exploring The Design And Benefits Of The Modern Data Stack - E203
Summary
We have been building platforms and workflows to store, process, and analyze data since the earliest days of computing. Over that time there have been countless architectures, patterns, and "best practices" to make that task manageable. With the growing popularity of cloud…
Summary
We have been building platforms and…
13 July 2021 | 00:49:02