))
Data Pipelines: Transforming Raw Data into Actionable Insights
Manage episode 359562393 series 3451197
Content provided by Michael Burke and Chris Detzel, Michael Burke, and Chris Detzel. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Michael Burke and Chris Detzel, Michael Burke, and Chris Detzel or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
This podcast episode talks about data pipelines, which are used to move data from one place to another and transform it into a more usable form. The podcast compares data pipelines to water pipelines, where raw data is like dirty water that needs to be cleaned and enriched.
The podcast covers topics such as batch and real-time pipelines, serverless computing, ETL, and the challenges of building and managing data pipelines. Michael and Chris also discuss the importance of data quality, involving the right people, and understanding business objectives. They emphasize the need to view data pipelines as a product that requires ongoing maintenance and support, and they provide tips for managing data pipelines in organizations.
Check out Data Pipelines explained here in this video: https://youtu.be/6kEGUCrBEU0
52 episodes
Share
