))
Data Match, AgileData Engineering Pattern #7 - Episode #75
Manage episode 504469504 series 3643538
Content provided by AgileData. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by AgileData or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the Data Match.
The Data Match pattern provides an automated, granular comparison capability to efficiently identify and report discrepancies between two datasets, moving from row counts to specific data values.
This 'data diff' solution transforms hours of manual data reconciliation into minutes by optimising comparisons for cloud analytics databases like BigQuery, serving as a support feature for on-demand exception handling rather than a continuous trust rule.
An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.
If you want a copy of the pattern template head over to:
https://agiledata.substack.com/i/172820886/pattern-name
Discover more AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns
If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
75 episodes
Share
