Latest Episodes

Business Intelligence In The Palm Of Your Hand With Zing Data - Episode 348

December 5, 2022 tmacey Comments Off on Business Intelligence In The Palm Of Your Hand With Zing Data - Episode 348

Business intelligence is the foremost application of data in organizations of all sizes. The typical conception of how it is accessed is through a web or desktop application running on a powerful laptop. Zing Data is building a mobile native platform for business intelligence. This opens the door for busy employees to access and analyze their company information away from their desk, but it has the more powerful effect of bringing first-class support to companies operating in mobile-first economies. In this episode Sabin Thomas shares his experiences building the...

Play Episode

Adopting Real-Time Data At Organizations Of Every Size - Episode 347

December 5, 2022 tmacey Comments Off on Adopting Real-Time Data At Organizations Of Every Size - Episode 347

The term "real-time data" brings with it a combination of excitement, uncertainty, and skepticism. The promise of insights that are always accurate and up to date is appealing to organizations, but the technical realities to make it possible have been complex and expensive. In this episode Arjun Narayan explains how the technical barriers to adopting real-time data in your analytics and applications have become surmountable by organizations of all sizes.

Play Episode

Supporting And Expanding The Arrow Ecosystem For Fast And Efficient Data Processing At Voltron Data - Episode 346

November 28, 2022 tmacey Comments Off on Supporting And Expanding The Arrow Ecosystem For Fast And Efficient Data Processing At Voltron Data - Episode 346

The data ecosystem has been growing rapidly, with new communities joining and bringing their preferred programming languages to the mix. This has led to inefficiencies in how data is stored, accessed, and shared across process and system boundaries. The Arrow project is designed to eliminate wasted effort in translating between languages, and Voltron Data was created to help grow and support its technology and community. In this episode Wes McKinney shares the ways that Arrow and its related projects are improving the efficiency of data systems and driving their...

Play Episode

Analyze Massive Data At Interactive Speeds With The Power Of Bitmaps Using FeatureBase - Episode 345

November 28, 2022 tmacey Comments Off on Analyze Massive Data At Interactive Speeds With The Power Of Bitmaps Using FeatureBase - Episode 345

The most expensive part of working with massive data sets is the work of retrieving and processing the files that contain the raw information. FeatureBase (formerly Pilosa) avoids that overhead by converting the data into bitmaps. In this episode Matt Jaffee explains how to model your data as bitmaps and the benefits that this representation provides for fast aggregate computation. He also discusses the improvements that have been incorporated into FeatureBase to simplify integration with the rest of your data stack, and the SQL interface that was added to...

Play Episode

A Look At The Data Systems Behind The Gameplay For League Of Legends - Episode 344

November 21, 2022 tmacey Comments Off on A Look At The Data Systems Behind The Gameplay For League Of Legends - Episode 344

The majority of blog posts and presentations about data engineering and analytics assume that the consumers of those efforts are internal business users accessing an environment controlled by the business. In this episode Ian Schweer shares his experiences at Riot Games supporting player-focused features such as machine learning models and recommeder systems that are deployed as part of the game binary. He explains the constraints that he and his team are faced with and the various challenges that they have overcome to build useful data products on top of...

Play Episode

Tame The Entropy In Your Data Stack And Prevent Failures With Sifflet - Episode 343

November 21, 2022 tmacey Comments Off on Tame The Entropy In Your Data Stack And Prevent Failures With Sifflet - Episode 343

The problems that are easiest to fix are the ones that you prevent from happening in the first place. Sifflet is a platform that brings your entire data stack into focus to improve the reliability of your data assets and empower collaboration across your teams. In this episode CEO and founder Salma Bakouk shares her views on the causes and impacts of "data entropy" and how you can tame it before it leads to failures.

Play Episode

Build Data Products Without A Data Team Using AgileData - Episode 342

November 14, 2022 tmacey Comments Off on Build Data Products Without A Data Team Using AgileData - Episode 342

Building data products is an undertaking that has historically required substantial investments of time and talent. With the rise in cloud platforms and self-serve data technologies the barrier of entry is dropping. Shane Gibson co-founded AgileData to make analytics accessible to companies of all sizes. In this episode he explains the design of the platform and how it builds on agile development principles to help you focus on delivering value.

Play Episode

Taking A Look Under The Hood At CreditKarma's Data Platform - Episode 341

November 14, 2022 tmacey Comments Off on Taking A Look Under The Hood At CreditKarma's Data Platform - Episode 341

CreditKarma builds data products that help consumers take advantage of their credit and financial capabilities. To make that possible they need a reliable data platform that empowers all of the organization's stakeholders. In this episode Vishnu Venkataraman shares the journey that he and his team have taken to build and evolve their systems and improve the product offerings that they are able to support.

Play Episode

Build Better Data Products By Creating Data, Not Consuming It - Episode 340

November 7, 2022 tmacey Comments Off on Build Better Data Products By Creating Data, Not Consuming It - Episode 340

A lot of the work that goes into data engineering is trying to make sense of the "data exhaust" from other applications and services. There is an undeniable amount of value and utility in that information, but it also introduces significant cost and time requirements. In this episode Nick King discusses how you can be intentional about data creation in your applications and services to reduce the friction and errors involved in building data products and ML applications. He also describes the considerations involved in bringing behavioral data into...

Play Episode

Clean Up Your Data Using Scalable Entity Resolution And Data Mastering With Zingg - Episode 339

November 7, 2022 tmacey Comments Off on Clean Up Your Data Using Scalable Entity Resolution And Data Mastering With Zingg - Episode 339

Despite the best efforts of data engineers, data is as messy as the real world. Entity resolution and fuzzy matching are powerful utilities for cleaning up data from disconnected sources, but it has typically required custom development and training machine learning models. Sonal Goyal created and open-sourced Zingg as a generalized tool for data mastering and entity resolution to reduce the effort involved in adopting those practices. In this episode she shares the story behind the project, the details of how it is implemented, and how you can use...

Play Episode

Subscribe Wherever You Listen To Podcasts

Apple PodcastsApple PodcastsOvercastOvercastGoogle PodcastsGoogle PodcastsGoogle PlayGoogle PlaySpotifySpotifyPocketCastsPocketCastsRadio PublicRadio PublicCastBoxCastBoxStitcherStitcherTuneInTuneInRSSRSSiHeartRadioiHeartRadioBreakerBreaker

Join The Mailing List