Data Engineering Podcast
Weekly deep dives on data management with the engineers and entrepreneurs who are shaping the industry
We found 2 episodes of Data Engineering Podcast with the tag “dataops”.
-
Seamless SQL And Python Transformations For Data Engineers And Analysts With SQLMesh
June 25th, 2023 | 50 mins 19 secs
dataops
Data transformation is a key activity for all of the organizational roles that interact with data. Because of its importance and outsized impact on what is possible for downstream data consumers it is critical that everyone is able to collaborate seamlessly. SQLMesh was designed as a unifying tool that is simple to work with but powerful enough for large-scale transformations and complex projects. In this episode Toby Mao explains how it works, the importance of automatic column-level lineage tracking, and how you can start using it today.
-
Reduce The Overhead In Your Pipelines With Agile Data Engine's DataOps Service
June 4th, 2023 | 54 mins 5 secs
dataops, vendor
A significant portion of the time spent by data engineering teams is on managing the workflows and operations of their pipelines. DataOps has arisen as a parallel set of practices to that of DevOps teams as a means of reducing wasted effort. Agile Data Engine is a platform designed to handle the infrastructure side of the DataOps equation, as well as providing the insights that you need to manage the human side of the workflow. In this episode Tevje Olin explains how the platform is implemented, the features that it provides to reduce the amount of effort required to keep your pipelines running, and how you can start using it in your own team.