1X
0:00/0:00
Data Engineering Podcast
This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.
Support the show!Listen in your favorite app:
Fountain
TrueFans
Podverse
Podcast Guru
Apple Podcasts
Spotify
Pick your app with Episodes.fm
Here are shows you might like
See show recommendations
Tobias Macey
Tobias Macey
Octopai: Metadata Management for Better Business Intelligence with Amnon Drori - Episode 28 - E28
Summary
The information about how data is acquired and processed is often as important as the data itself. For this reason metadata management systems are built to track the journey of your business data to aid in analysis, presentation, and compliance. These systems are frequently cumbersome and difficult to maintain, so Octopai was…
Summary
The information about how data is acquired and processed is often as important…
23 April 2018 | 00:39:53
Data Engineering Weekly with Joe Crobak - Episode 27 - E27
Summary
The rate of change in the data engineering industry is alternately exciting and exhausting. Joe Crobak found his way into the work of data management by accident as so many of us do. After being engrossed with researching the details of distributed systems and big data management for his work he began sharing his findings with…
Summary
The rate of change in the data engineering industry is alternately exciting and…
15 April 2018 | 00:43:32
Defining DataOps with Chris Bergh - Episode 26 - E26
Summary
Managing an analytics project can be difficult due to the number of systems involved and the need to ensure that new information can be delivered quickly and reliably. That challenge can be met by adopting practices and principles from lean manufacturing and agile software development, and the cross-functional collaboration,…
Summary
Managing an analytics project can be difficult due to the number of systems…
08 April 2018 | 00:54:31
ThreatStack: Data Driven Cloud Security with Pete Cheslock and Patrick Cable - Episode 25 - E25
Summary
Cloud computing and ubiquitous virtualization have changed the ways that our applications are built and deployed. This new environment requires a new way of tracking and addressing the security of our systems. ThreatStack is a platform that collects all of the data that your servers generate and monitors for unexpected anomalies…
Summary
Cloud computing and ubiquitous virtualization have changed the ways that our…
01 April 2018 | 00:51:52
MarketStore: Managing Timeseries Financial Data with Hitoshi Harada and Christopher Ryan - Episode 24 - E24
Summary
The data that is used in financial markets is time oriented and multidimensional, which makes it difficult to manage in either relational or timeseries databases. To make this information more manageable the team at Alapaca built a new data store specifically for retrieving and analyzing data generated by trading markets. In…
Summary
The data that is used in financial markets is time oriented and…
25 March 2018 | 00:33:28
Stretching The Elastic Stack with Philipp Krenn - Episode 23 - E23
Summary
Search is a common requirement for applications of all varieties. Elasticsearch was built to make it easy to include search functionality in projects built in any language. From that foundation, the rest of the Elastic Stack has been built, expanding to many more use cases in the proces. In this episode Philipp Krenn describes…
Summary
Search is a common requirement for applications of all varieties. Elasticsearch…
19 March 2018 | 00:51:02
Database Refactoring Patterns with Pramod Sadalage - Episode 22 - E22
Summary
As software lifecycles move faster, the database needs to be able to keep up. Practices such as version controlled migration scripts and iterative schema evolution provide the necessary mechanisms to ensure that your data layer is as agile as your application. Pramod Sadalage saw the need for these capabilities during the early…
Summary
As software lifecycles move faster, the database needs to be able to keep up.…
12 March 2018 | 00:49:06
The Future Data Economy with Roger Chen - Episode 21 - E21
Summary
Data is an increasingly sought after raw material for business in the modern economy. One of the factors driving this trend is the increase in applications for machine learning and AI which require large quantities of information to work from. As the demand for data becomes more widespread the market for providing it will begin…
Summary
Data is an increasingly sought after raw material for business in the modern…
05 March 2018 | 00:42:48
Honeycomb Data Infrastructure with Sam Stokes - Episode 20 - E20
Summary
One of the sources of data that often gets overlooked is the systems that we use to run our businesses. This data is not used to directly provide value to customers or understand the functioning of the business, but it is still a critical component of a successful system. Sam Stokes is an engineer at Honeycomb where he helps to…
Summary
One of the sources of data that often gets overlooked is the systems that we use…
26 February 2018 | 00:41:33
Data Teams with Will McGinnis - Episode 19 - E19
Summary
The responsibilities of a data scientist and a data engineer often overlap and occasionally come to cross purposes. Despite these challenges it is possible for the two roles to work together effectively and produce valuable business outcomes. In this episode Will McGinnis discusses the opinions that he has gained from experience…
Summary
The responsibilities of a data scientist and a data engineer often overlap and…
19 February 2018 | 00:28:39