Data observability
The health of your network defines the health of your infrastructure. A large virtual machine with great specifications to crunch numbers at blazing speed is rendered useless if the network is not working. Similarly, data pipelines are the backbone of a healthy data mesh. Without timely and accurate data, the best analytical system is not useful to the business.
Data quality, data contracts, and master data management are some of the key tenets of the quality and accuracy of data. Along with quality and accuracy, we also need to monitor the movement of data through data lineage in Microsoft Purview as well as data pipeline health through data mesh monitoring.
Throughout multiple chapters in this book, we have looked at all of these aspects of data. As part of data mesh monitoring, you need to bring all of these different data observability metrics together onto a single pane of glass.
