Latest Episodes

Data Engineering Weekly with Joe Crobak - Episode 27

April 15, 2018 tmacey Comments Off on Data Engineering Weekly with Joe Crobak - Episode 27

The rate of change in the data engineering industry is alternately exciting and exhausting. Joe Crobak found his way into the work of data management by accident as so many of us do. After being engrossed with researching the details of distributed systems and big data management for his work he began sharing his findings with friends. This led to his creation of the Hadoop Weekly newsletter, which he recently rebranded as the Data Engineering Weekly newsletter. In this episode he discusses his experiences working as a data engineer...

Play Episode

Defining DataOps with Chris Bergh - Episode 26

April 8, 2018 tmacey Comments Off on Defining DataOps with Chris Bergh - Episode 26

Managing an analytics project can be difficult due to the number of systems involved and the need to ensure that new information can be delivered quickly and reliably. That challenge can be met by adopting practices and principles from lean manufacturing and agile software development, and the cross-functional collaboration, feedback loops, and focus on automation in the DevOps movement. In this episode Christopher Bergh discusses ways that you can start adding reliability and speed to your workflow to deliver results with confidence and consistency.

Play Episode

ThreatStack: Data Driven Cloud Security with Pete Cheslock and Patrick Cable - Episode 25

April 1, 2018 tmacey Comments Off on ThreatStack: Data Driven Cloud Security with Pete Cheslock and Patrick Cable - Episode 25

Cloud computing and ubiquitous virtualization have changed the ways that our applications are built and deployed. This new environment requires a new way of tracking and addressing the security of our systems. ThreatStack is a platform that collects all of the data that your servers generate and monitors for unexpected anomalies in behavior that would indicate a breach and notifies you in near-realtime. In this episode ThreatStack's director of operations, Pete Cheslock, and senior infrastructure security engineer, Patrick Cable, discuss the data infrastructure that supports their platform, how they...

Play Episode

MarketStore: Managing Timeseries Financial Data with Hitoshi Harada and Christopher Ryan - Episode 24

March 25, 2018 tmacey Comments Off on MarketStore: Managing Timeseries Financial Data with Hitoshi Harada and Christopher Ryan - Episode 24

The data that is used in financial markets is time oriented and multidimensional, which makes it difficult to manage in either relational or timeseries databases. To make this information more manageable the team at Alapaca built a new data store specifically for retrieving and analyzing data generated by trading markets. In this episode Hitoshi Harada, the CTO of Alapaca, and Christopher Ryan, their lead software engineer, explain their motivation for building MarketStore, how it operates, and how it has helped to simplify their development workflows.

Play Episode

Stretching The Elastic Stack with Philipp Krenn - Episode 23

March 19, 2018 tmacey Comments Off on Stretching The Elastic Stack with Philipp Krenn - Episode 23

Search is a common requirement for applications of all varieties. Elasticsearch was built to make it easy to include search functionality in projects built in any language. From that foundation, the rest of the Elastic Stack has been built, expanding to many more use cases in the proces. In this episode Philipp Krenn describes the various pieces of the stack, how they fit together, and how you can use them in your infrastructure to store, search, and analyze your data.

Play Episode

Database Refactoring Patterns with Pramod Sadalage - Episode 22

March 12, 2018 tmacey Comments Off on Database Refactoring Patterns with Pramod Sadalage - Episode 22

As software lifecycles move faster, the database needs to be able to keep up. Practices such as version controlled migration scripts and iterative schema evolution provide the necessary mechanisms to ensure that your data layer is as agile as your application. Pramod Sadalage saw the need for these capabilities during the early days of the introduction of modern development practices and co-authored a book to codify a large number of patterns to aid practitioners, and in this episode he reflects on the current state of affairs and how things...

Play Episode

The Future Data Economy with Roger Chen - Episode 21

March 5, 2018 tmacey Comments Off on The Future Data Economy with Roger Chen - Episode 21

Data is an increasingly sought after raw material for business in the modern economy. One of the factors driving this trend is the increase in applications for machine learning and AI which require large quantities of information to work from. As the demand for data becomes more widespread the market for providing it will begin transform the ways that information is collected and shared among and between organizations. With his experience as a chair for the O'Reilly AI conference and an investor for data driven businesses Roger Chen is...

Play Episode

Honeycomb Data Infrastructure with Sam Stokes - Episode 20

February 26, 2018 tmacey Comments Off on Honeycomb Data Infrastructure with Sam Stokes - Episode 20

One of the sources of data that often gets overlooked is the systems that we use to run our businesses. This data is not used to directly provide value to customers or understand the functioning of the business, but it is still a critical component of a successful system. Sam Stokes is an engineer at Honeycomb where he helps to build a platform that is able to capture all of the events and context that occur in our production environments and use them to answer all of your questions...

Play Episode

Data Teams with Will McGinnis - Episode 19

February 19, 2018 tmacey Comments Off on Data Teams with Will McGinnis - Episode 19

The responsibilities of a data scientist and a data engineer often overlap and occasionally come to cross purposes. Despite these challenges it is possible for the two roles to work together effectively and produce valuable business outcomes. In this episode Will McGinnis discusses the opinions that he has gained from experience on how data teams can play to their strengths to the benefit of all.

Play Episode

TimescaleDB: Fast And Scalable Timeseries with Ajay Kulkarni and Mike Freedman - Episode 18

February 11, 2018 tmacey Comments Off on TimescaleDB: Fast And Scalable Timeseries with Ajay Kulkarni and Mike Freedman - Episode 18

As communications between machines become more commonplace the need to store the generated data in a time-oriented manner increases. The market for timeseries data stores has many contenders, but they are not all built to solve the same problems or to scale in the same manner. In this episode the founders of TimescaleDB, Ajay Kulkarni and Mike Freedman, discuss how Timescale was started, the problems that it solves, and how it works under the covers. They also explain how you can start using it in your infrastructure and their...

Play Episode

Subscribe Wherever You Listen To Podcasts

Apple PodcastsOvercastGoogle PodcastsGoogle PlaySpotifyPocketCastsRadio PublicCastBoxStitcherTuneInRSSiHeartRadioBreaker

Join The Mailing List