Episodes

Astronomer with Ry Walker - Episode 6

August 6, 2017 tmacey Comments Off

Building a data pipeline that is reliable and flexible is a difficult task, especially when you have a small team. Astronomer is a platform that lets you skip straight to processing your valuable business data. Ry Walker, the CEO of Astronomer, explains how the company got started, how the platform works, and their commitment to open source.

Play Episode

Rebuilding Yelp's Data Pipeline with Justin Cunningham - Episode 5

June 18, 2017 tmacey Comments Off

Yelp needs to be able to consume and process all of the user interactions that happen in their platform in as close to real-time as possible. To achieve that goal they embarked on a journey to refactor their monolithic architecture to be more modular and modern, and then they open sourced it! In this episode Justin Cunningham joins me to discuss the decisions they made and the lessons they learned in the process, including what worked, what didn't, and what he would do differently if he was starting over...

Play Episode

ScyllaDB with Eyal Gutkind - Episode 4

March 18, 2017 tmacey 1 Comment

If you like the features of Cassandra DB but wish it ran faster with fewer resources then ScyllaDB is the answer you have been looking for. In this episode Eyal Gutkind explains how Scylla was created and how it differentiates itself in the crowded database market.

Play Episode

Defining Data Engineering with Maxime Beauchemin - Episode 3

March 5, 2017 tmacey 3 Comments

What exactly is data engineering? How has it evolved in recent years and where is it going? How do you get started in the field? In this episode, Maxime Beauchemin joins me to discuss these questions and more.

Play Episode

Dask with Matthew Rocklin - Episode 2

January 22, 2017 tmacey Comments Off

There is a vast constellation of tools and platforms for processing and analyzing your data. In this episode Matthew Rocklin talks about how Dask fills the gap between a task oriented workflow tool and an in memory processing framework, and how it brings the power of Python to bear on the problem of big data.

Play Episode

Pachyderm with Daniel Whitenack - Episode 1

January 14, 2017 tmacey Comments Off

Do you wish that you could track the changes in your data the same way that you track the changes in your code? Pachyderm is a platform for building a data lake with a versioned file system. It also lets you use whatever languages you want to run your analysis with its container based task graph. This week Daniel Whitenack shares the story of how the project got started, how it works under the covers, and how you can get started using it today!

Play Episode