Architectural guidance

As evidenced in the previous sections, there are a plethora of options available for data governance; choosing the right tool depends primarily on the use case and the level of governance you are attempting to implement. We also see that the market is flooded with umpteen numbers of tools that make decision making very difficult. The following figure depicts the key aspects that are to be considered while choosing the right tools and technologies for Data Governance:

The key considerations for choosing Data Governance tools

Big Data tools and technologies

This section takes you through an indicative list of Big Data tools and technologies that can be used for your specific use case.

Apache Falcon

Falcon is a framework for data management; it simplifies creation, deployment, and monitoring of data pipelines. Falcon automates data ingestion, metadata tagging, and provides a foundation for ILM and governance capabilities.

Understanding how Falcon works

Falcon framework relies...