Reader small image

You're reading from  Driving Data Quality with Data Contracts

Product typeBook
Published inJun 2023
PublisherPackt
ISBN-139781837635009
Edition1st Edition
Right arrow
Author (1)
Andrew Jones
Andrew Jones
author image
Andrew Jones

Andrew Jones is a principal engineer at GoCardless, one of Europe's leading Fintech's. He has over 15 years experience in the industry, with the first half primarily as a software engineer, before he moved into the data infrastructure and data engineering space. Joining GoCardless as its first data engineer, he led his team to build their data platform from scratch. After initially following a typical data architecture and getting frustrated with facing the same old challenges he'd faced for years, he started thinking there must be a better way, which led to him coining and defining the ideas around data contracts. Andrew is a regular speaker and writer, and he is passionate about helping organizations get maximum value from data.
Read more about Andrew Jones

Right arrow

Monitoring and enforcing data contracts

In this section, we’ll look at how to monitor and enforce our data contracts. This is important, as one of the four principles we looked at in Chapter 2, Introducing Data Contracts, is setting expectations. There’s little point in setting these expectations if we cannot prove we’re meeting them. It’s that proof that gives data consumers the confidence to build on this data.

There are three areas where we can add some monitoring and/or enforcement:

  • The data contract’s definition
  • The quality of the data
  • The performance and dependability of the data

Let’s look at each of these in turn.

The data contract’s definition

Data contracts are written by humans and, as such, are susceptible to human error. They are also intended to be self-served, without requiring a central review, as that slows teams down and reduces their autonomy. Therefore, we will want to add some automated...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Driving Data Quality with Data Contracts
Published in: Jun 2023Publisher: PacktISBN-13: 9781837635009

Author (1)

author image
Andrew Jones

Andrew Jones is a principal engineer at GoCardless, one of Europe's leading Fintech's. He has over 15 years experience in the industry, with the first half primarily as a software engineer, before he moved into the data infrastructure and data engineering space. Joining GoCardless as its first data engineer, he led his team to build their data platform from scratch. After initially following a typical data architecture and getting frustrated with facing the same old challenges he'd faced for years, he started thinking there must be a better way, which led to him coining and defining the ideas around data contracts. Andrew is a regular speaker and writer, and he is passionate about helping organizations get maximum value from data.
Read more about Andrew Jones