Latest Episodes

Of Checklists, Ethics, and Data with Emily Miller and Peter Bull (Cross Post from Podcast.__init__) - Episode 53

October 22, 2018 tmacey Comments Off on Of Checklists, Ethics, and Data with Emily Miller and Peter Bull (Cross Post from Podcast.__init__) - Episode 53

As data science becomes more widespread and has a bigger impact on the lives of people, it is important that those projects and products are built with a conscious consideration of ethics. Keeping ethical principles in mind throughout the lifecycle of a data project helps to reduce the overall effort of preventing negative outcomes from the use of the final product. Emily Miller and Peter Bull of Driven Data have created Deon to improve the communication and conversation around ethics among and between data teams. It is a Python...

Play Episode

Improving The Performance Of Cloud-Native Big Data At Netflix Using The Iceberg Table Format with Ryan Blue - Episode 52

October 15, 2018 tmacey Comments Off on Improving The Performance Of Cloud-Native Big Data At Netflix Using The Iceberg Table Format with Ryan Blue - Episode 52

With the growth of the Hadoop ecosystem came a proliferation of implementations for the Hive table format. Unfortunately, with no formal specification, each project works slightly different which increases the difficulty of integration across systems. The Hive format is also built with the assumptions of a local filesystem which results in painful edge cases when leveraging cloud object storage for a data lake. In this episode Ryan Blue explains how his work on the Iceberg table format specification and reference implementation has allowed Netflix to improve the performance and...

Play Episode

Combining Transactional And Analytical Workloads On MemSQL with Nikita Shamgunov - Episode 51

October 9, 2018 tmacey Comments Off on Combining Transactional And Analytical Workloads On MemSQL with Nikita Shamgunov - Episode 51

One of the most complex aspects of managing data for analytical workloads is moving it from a transactional database into the data warehouse. What if you didn't have to do that at all? MemSQL is a distributed database built to support concurrent use by transactional, application oriented, and analytical, high volume, workloads on the same hardware. In this episode the CEO of MemSQL describes how the company and database got started, how it is architected for scale and speed, and how it is being used in production. This was...

Play Episode

Building A Knowledge Graph From Public Data At Enigma With Chris Groskopf - Episode 50

October 1, 2018 tmacey Comments Off on Building A Knowledge Graph From Public Data At Enigma With Chris Groskopf - Episode 50

There are countless sources of data that are publicly available for use. Unfortunately, combining those sources and making them useful in aggregate is a time consuming and challenging process. The team at Enigma builds a knowledge graph for use in your own data projects. In this episode Chris Groskopf explains the platform they have built to consume large varieties and volumes of public data for constructing a graph for serving to their customers. He discusses the challenges they are facing to scale the platform and engineering processes, as well...

Play Episode

A Primer On Enterprise Data Curation with Todd Walter - Episode 49

September 24, 2018 tmacey Comments Off on A Primer On Enterprise Data Curation with Todd Walter - Episode 49

As your data needs scale across an organization the need for a carefully considered approach to collection, storage, organization, and access becomes increasingly critical. In this episode Todd Walter shares his considerable experience in data curation to clarify the many aspects that are necessary for a successful platform for your business. Using the metaphor of a museum curator carefully managing the precious resources on display and in the vaults, he discusses the various layers of an enterprise data strategy. This includes modeling the lifecycle of your information as a...

Play Episode

Take Control Of Your Web Analytics Using Snowplow With Alexander Dean - Episode 48

September 17, 2018 tmacey Comments Off on Take Control Of Your Web Analytics Using Snowplow With Alexander Dean - Episode 48

Every business with a website needs some way to keep track of how much traffic they are getting, where it is coming from, and which actions are being taken. The default in most cases is Google Analytics, but this can be limiting when you wish to perform detailed analysis of the captured data. To address this problem, Alex Dean co-founded Snowplow Analytics to build an open source platform that gives you total control of your website traffic data. In this episode he explains how the project and company got...

Play Episode

Keep Your Data And Query It Too Using Chaos Search with Thomas Hazel and Pete Cheslock - Episode 47

September 10, 2018 tmacey Comments Off on Keep Your Data And Query It Too Using Chaos Search with Thomas Hazel and Pete Cheslock - Episode 47

Elasticsearch is a powerful tool for storing and analyzing data, but when using it for logs and other time oriented information it can become problematic to keep all of your history. Chaos Search was started to make it easy for you to keep all of your data and make it usable in S3, so that you can have the best of both worlds. In this episode the CTO, Thomas Hazel, and VP of Product, Pete Cheslock, describe how they have built a platform to let you keep all of...

Play Episode

An Agile Approach To Master Data Management with Mark Marinelli - Episode 46

September 3, 2018 tmacey Comments Off on An Agile Approach To Master Data Management with Mark Marinelli - Episode 46

With the proliferation of data sources to give a more comprehensive view of the information critical to your business it is even more important to have a canonical view of the entities that you care about. Is customer number 342 in your ERP the same as Bob Smith on Twitter? Building a master data set helps you answer these questions reliably and simplify the process of building your business intelligence reports. In this episode the head of product at Tamr, Mark Marinelli, discusses the challenges of building a master...

Play Episode

Protecting Your Data In Use At Enveil with Ellison Anne Williams - Episode 45

August 27, 2018 tmacey Comments Off on Protecting Your Data In Use At Enveil with Ellison Anne Williams - Episode 45

There are myriad reasons why data should be protected, and just as many ways to enforce it in tranist or at rest. Unfortunately, there is still a weak point where attackers can gain access to your unencrypted information. In this episode Ellison Anny Williams, CEO of Enveil, describes how her company uses homomorphic encryption to ensure that your analytical queries can be executed without ever having to decrypt your data.

Play Episode

Graph Databases In Production At Scale Using DGraph with Manish Jain - Episode 44

August 20, 2018 tmacey Comments Off on Graph Databases In Production At Scale Using DGraph with Manish Jain - Episode 44

The way that you store your data can have a huge impact on the ways that it can be practically used. For a substantial number of use cases, the optimal format for storing and querying that information is as a graph, however databases architected around that use case have historically been difficult to use at scale or for serving fast, distributed queries. In this episode Manish Jain explains how DGraph is overcoming those limitations, how the project got started, and how you can start using it today. He also...

Play Episode

Subscribe Wherever You Listen To Podcasts

Apple PodcastsOvercastGoogle PodcastsGoogle PlaySpotifyPocketCastsRadio PublicCastBoxStitcherTuneInRSSiHeartRadioBreaker

Join The Mailing List