Summary
In this chapter, we learned how to build the silver layer of the lakehouse, which stores the cleansed version data. Data in the silver layer represents the single source of truth of data and is available to end users in a readily consumable state. During the chapter, we deep-dived into some of the reasons why data curation is required, discussed the curation process, and demonstrated how each case should be handled using code.
In Chapter 8, Data Aggregation Stage – The Gold Layer, we will use data from the silver layer of the Electroniz lakehouse and use it to perform data aggregations. These aggregations will help Electroniz users enhance their decision-making process using a combination of descriptive, diagnostic, and predictive analysis.
