1X
0:00/0:00
Data Engineering Podcast
This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.
Support the show!Listen in your favorite app:
Fountain
TrueFans
Podverse
Podcast Guru
Apple Podcasts
Spotify
Podlink
Here are shows you might like
See show recommendations
Tobias Macey
Tobias Macey
Off The Shelf Data Governance With Satori - E165
Summary
One of the core responsibilities of data engineers is to manage the security of the information that they process. The team at Satori has a background in cybersecurity and they are using the lessons that they learned in that field to address the challenge of access control and auditing for…
Summary
One of the core responsibilities of data…
28 December 2020 | 00:34:24
Low Friction Data Governance With Immuta - E164
Summary
Data governance is a term that encompasses a wide range of responsibilities, both technical and process oriented. One of the more complex aspects is that of access control to the data assets that an organization is responsible for managing. The team at Immuta has built a platform that aims…
Summary
Data governance is a term that…
21 December 2020 | 00:53:33
Building A Self Service Data Platform For Alternative Data Analytics At YipitData - E163
Summary
As a data engineer you’re familiar with the process of collecting data from databases, customer data platforms, APIs, etc. At YipitData they rely on a variety of alternative data sources to inform investment decisions by hedge funds and…
15 December 2020 | 01:04:47
Proven Patterns For Building Successful Data Teams - E162
Summary
Building data products are complicated by the fact that there are so many different stakeholders with competing goals and priorities. It is also challenging because of the number of roles and capabilities that are necessary to go from idea to delivery. Different organizations have tried a…
Summary
Building data products are complicated by…
07 December 2020 | 01:12:31
Streaming Data Integration Without The Code at Equalum - E161
Summary
The first stage of every good pipeline is to perform data integration. With the increasing pace of change and the need for up to date analytics the need to integrate that data in near real time is growing. With the improvements and increased variety of options for streaming data engines and…
Summary
The first stage of every good pipeline is…
30 November 2020 | 00:44:50
Keeping A Bigeye On The Data Quality Market - E160
Summary
One of the oldest aphorisms about data is "garbage in, garbage out", which is why the current boom in data quality solutions is no surprise. With the growth in projects, platforms, and services that aim to help you establish and maintain control of the health and reliability of…
Summary
One of the oldest aphorisms about data is…
23 November 2020 | 00:49:26
Self Service Data Management From Ingest To Insights With Isima - E159
Summary
The core mission of data engineers is to provide the business with a way to ask and answer questions of their data. This often takes the form of business intelligence dashboards, machine learning models, or APIs on top of a cleaned and curated data set. Despite the rapid progression of…
Summary
The core mission of data engineers is to…
17 November 2020 | 00:44:03
Building A Cost Effective Data Catalog With Tree Schema - E158
Summary
A data catalog is a critical piece of infrastructure for any organization who wants to build analytics products, whether internal or external. While there are a number of platforms available for building that catalog, many of them are either difficult to deploy and integrate, or expensive…
Summary
A data catalog is a critical piece of…
10 November 2020 | 00:51:53
Add Version Control To Your Data Lake With LakeFS - E157
Summary
Data lakes are gaining popularity due to their flexibility and reduced cost of storage. Along with the benefits there are some additional complexities to consider, including how to safely integrate new data sources or test out changes to existing pipelines. In order to address these…
Summary
Data lakes are gaining popularity due to…
03 November 2020 | 00:50:15
Cloud Native Data Security As Code With Cyral - E156
Summary
One of the most challenging aspects of building a data platform has nothing to do with pipelines and transformations. If you are putting your workflows into production, then you need to consider how you are going to implement data security, including access controls and auditing. Different…
Summary
One of the most challenging aspects of…
26 October 2020 | 00:48:33