Data profiling using a data quality framework

A crucial step in determining the quality of your data is data profiling. This entails examining your data to comprehend its composition and linkages. We will be discussing the data profiling features of business intelligence tools in the next two chapters. In this section, we will be using a data quality framework to accomplish data profiling by performing the general steps seen in Figure 3.2:

Figure 3.2 – General steps for data profiling

Let’s go through this, step by step.

Define the criteria for data quality

Determine the relevant data quality metrics that are important to the business. These are the indicators of accuracy, completeness, consistency, timeliness, and validity that we covered earlier in the chapter. To which metrics we will give more importance will be context-specific and depend on what the company aims to achieve.

Continuing our scenario at the start of this chapter...