Build A Common Understanding Of Your Data Reliability Rules With Soda Core and Soda Checks Language - Episode 328

September 26, 2022 tmacey Comments Off on Build A Common Understanding Of Your Data Reliability Rules With Soda Core and Soda Checks Language - Episode 328

Regardless of how data is being used, it is critical that the information is trusted. The practice of data reliability engineering has gained momentum recently to address that question. To help support the efforts of data teams the folks at Soda Data created the Soda Checks Language and the corresponding Soda Core utility that acts on this new DSL. In this episode Tom Baeyens explains their reasons for creating a new syntax for expressing and validating checks for data assets and processes, as well as how to incorporate it into your own projects.

Play Episode

Power Your Real-Time Analytics Without The Headache Using Fivetran's Change Data Capture Integrations - Episode 327

September 26, 2022 tmacey Comments Off on Power Your Real-Time Analytics Without The Headache Using Fivetran's Change Data Capture Integrations - Episode 327

Data integration from source systems to their downstream destinations is the foundational step for any data product. With the increasing expecation for information to be instantly accessible, it drives the need for reliable change data capture. The team at Fivetran have recently introduced that functionality to power real-time data products. In this episode Mark Van de Wiel explains how they integrated CDC functionality into their existing product, discusses the nuances of different approaches to change data capture from various sources.

Play Episode

Building A Shared Understanding Of Data In A Business Through A Single Pane Of Glass With Workstream - Episode 326

September 19, 2022 tmacey Comments Off on Building A Shared Understanding Of Data In A Business Through A Single Pane Of Glass With Workstream - Episode 326

There is a constant tension in business data between growing siloes, and breaking them down. Even when a tool is designed to integrate information as a guard against data isolation, it can easily become a silo of its own, where you have to make a point of using it to seek out information. In order to help distribute critical context about data assets and their status into the locations where work is being done Nicholas Freund co-founded Workstream. In this episode he discusses the challenge of maintaining shared visibility and understanding of data work across the various stakeholders and his efforts to make it a seamless experience.

Play Episode

Operational Analytics To Increase Efficiency For Multi-Location Businesses With OpsAnalitica - Episode 325

September 19, 2022 tmacey Comments Off on Operational Analytics To Increase Efficiency For Multi-Location Businesses With OpsAnalitica - Episode 325

In order to improve efficiency in any business you must first know what is contributing to wasted effort or missed opportunities. When your business operates across multiple locations it becomes even more challenging and important to gain insights into how work is being done. In this episode Tommy Yionoulis shares his experiences working in the service and hospitality industries and how that led him to found OpsAnalitica, a platform for collecting and analyzing metrics on multi location businesses and their operational practices. He discusses the challenges of making data collection purposeful and efficient without distracting employees from their primary duties and how business owners can use the provided analytics to support their staff in their duties.

Play Episode

Build Confidence In Your Data Platform With Schema Compatibility Reports That Span Systems And Domains Using Schemata - Episode 324

September 12, 2022 tmacey Comments Off on Build Confidence In Your Data Platform With Schema Compatibility Reports That Span Systems And Domains Using Schemata - Episode 324

Data engineering systems are complex and interconnected with myriad and often opaque chains of dependencies. As they scale, the problems of visibility and dependency management can increase at an exponential rate. In order to turn this into a tractable problem one approach is to define and enforce contracts between producers and consumers of data. Ananth Packildurai created Schemata as a way to make the creation of schema contracts a lightweight process, allowing the dependency chains to be constructed and evolved iteratively and integrating validation of changes into standard delivery systems. In this episode he shares the design of the project and how it fits into your development practices.

Play Episode
More Episodes

Subscribe Wherever You Listen To Podcasts

Apple PodcastsApple PodcastsOvercastOvercastGoogle PodcastsGoogle PodcastsGoogle PlayGoogle PlaySpotifySpotifyPocketCastsPocketCastsRadio PublicRadio PublicCastBoxCastBoxStitcherStitcherTuneInTuneInRSSRSSiHeartRadioiHeartRadioBreakerBreaker

Join The Mailing List