Latest Episodes

Exploring The Expanding Landscape Of Data Professions with Josh Benamram of Databand - Episode 180

April 13, 2021 tmacey Comments Off on Exploring The Expanding Landscape Of Data Professions with Josh Benamram of Databand - Episode 180

"Business as usual" is changing, with more companies investing in data as a first class concern. As a result, the data team is growing and introducing more specialized roles. In this episode Josh Benamram, CEO and co-founder of Databand, describes the motivations for these emerging roles, how these positions affect the team dynamics, and the types of visibility that they need into the data platform to do their jobs effectively. He also talks about how his experience working with these teams informs his work at Databand. If you are...

Play Episode

Put Your Whole Data Team On The Same Page With Atlan - Episode 179

April 6, 2021 tmacey Comments Off on Put Your Whole Data Team On The Same Page With Atlan - Episode 179

One of the biggest obstacles to success in delivering data products is cross-team collaboration. Part of the problem is the difference in the information that each role requires to do their job and where they expect to find it. This introduces a barrier to communication that is difficult to overcome, particularly in teams that have not reached a significant level of maturity in their data journey. In this episode Prukalpa Sankar shares her experiences across multiple attempts at building a system that brings everyone onto the same page, ultimately...

Play Episode

Data Quality Management For The Whole Team With Soda Data - Episode 178

March 30, 2021 tmacey Comments Off on Data Quality Management For The Whole Team With Soda Data - Episode 178

Data quality is on the top of everyone's mind recently, but getting it right is as challenging as ever. One of the contributing factors is the number of people who are involved in the process and the potential impact on the business if something goes wrong. In this episode Maarten Masschelein and Tom Baeyens share the work they are doing at Soda to bring everyone on board to make your data clean and reliable. They explain how they started down the path of building a solution for managing data...

Play Episode

Real World Change Data Capture At Datacoral - Episode 177

March 23, 2021 tmacey Comments Off on Real World Change Data Capture At Datacoral - Episode 177

The world of business is becoming increasingly dependent on information that is accurate up to the minute. For analytical systems, the only way to provide this reliably is by implementing change data capture (CDC). Unfortunately, this is a non-trivial undertaking, particularly for teams that don't have extensive experience working with streaming data and complex distributed systems. In this episode Raghu Murthy, founder and CEO of Datacoral, does a deep dive on how he and his team manage change data capture pipelines in production.

Play Episode

Managing The DoorDash Data Platform - Episode 176

March 16, 2021 tmacey Comments Off on Managing The DoorDash Data Platform - Episode 176

The team at DoorDash has a complex set of optimization challenges to deal with using data that they collect from a multi-sided marketplace. In order to handle the volume and variety of information that they use to run and improve the business the data team has to build a platform that analysts and data scientists can use in a self-service manner. In this episode the head of data platform for DoorDash, Sudhir Tonse, discusses the technologies that they are using, the approach that they take to adding new systems,...

Play Episode

Leave Your Data Where It Is And Automate Feature Extraction With Molecula - Episode 175

March 9, 2021 tmacey Comments Off on Leave Your Data Where It Is And Automate Feature Extraction With Molecula - Episode 175

A majority of the time spent in data engineering is copying data between systems to make the information available for different purposes. This introduces challenges such as keeping information synchronized, managing schema evolution, building transformations to match the expectations of the destination systems. H.O. Maycotte was faced with these same challenges but at a massive scale, leading him to question if there is a better way. After tasking some of his top engineers to consider the problem in a new light they created the Pilosa engine. In this episode...

Play Episode

Bridging The Gap Between Machine Learning And Operations At Iguazio - Episode 174

March 2, 2021 tmacey Comments Off on Bridging The Gap Between Machine Learning And Operations At Iguazio - Episode 174

The process of building and deploying machine learning projects requires a staggering number of systems and stakeholders to work in concert. In this episode Yaron Haviv, co-founder of Iguazio, discusses the complexities inherent to the process, as well as how he has worked to democratize the technologies necessary to make machine learning operations maintainable.

Play Episode

Self Service Open Source Data Integration With AirByte - Episode 173

February 23, 2021 tmacey Comments Off on Self Service Open Source Data Integration With AirByte - Episode 173

Data integration is a critical piece of every data pipeline, yet it is still far from being a solved problem. There are a number of managed platforms available, but the list of options for an open source system that supports a large variety of sources and destinations is still embarrasingly short. The team at Airbyte is adding a new entry to that list with the goal of making robust and easy to use data integration more accessible to teams who want or need to maintain full control of their...

Play Episode

Building The Foundations For Data Driven Businesses at 5xData - Episode 172

February 16, 2021 tmacey Comments Off on Building The Foundations For Data Driven Businesses at 5xData - Episode 172

Every business aims to be data driven, but not all of them succeed in that effort. In order to be able to truly derive insights from the data that an organization collects, there are certain foundational capabilities that they need to have capacity for. In order to help more businesses build those foundations, Tarush Aggarwal created 5xData, offering collaborative workshops to assist in setting up the technical and organizational systems that are necessary to succeed. In this episode he shares his thoughts on the core elements that are necessary...

Play Episode

How Shopify Is Building Their Production Data Warehouse Using DBT - Episode 171

February 9, 2021 tmacey Comments Off on How Shopify Is Building Their Production Data Warehouse Using DBT - Episode 171

With all of the tools and services available for building a data platform it can be difficult to separate the signal from the noise. One of the best ways to get a true understanding of how a technology works in practice is to hear from people who are running it in production. In this episode Zeeshan Qureshi and Michelle Ark share their experiences using DBT to manage the data warehouse for Shopify. They explain how the structured the project to allow for multiple teams to collaborate in a scalable...

Play Episode

Subscribe Wherever You Listen To Podcasts

Apple PodcastsApple PodcastsOvercastOvercastGoogle PodcastsGoogle PodcastsGoogle PlayGoogle PlaySpotifySpotifyPocketCastsPocketCastsRadio PublicRadio PublicCastBoxCastBoxStitcherStitcherTuneInTuneInRSSRSSiHeartRadioiHeartRadioBreakerBreaker

Join The Mailing List