The need to aggregate data
Before we deep dive into how to aggregate data and build the gold layer of the Electroniz lakehouse, we should quickly remind ourselves why we're building the lakehouse in the first place. During the discovery phase, Electroniz had put forth some key business requirements, as follows:
- They want to aim for a near-real-time sales analytics platform that can serve their customer needs faster and better.
- They want to streamline their advertising budgets through intelligent analytics based on the number of user hits on their e-commerce website.
- They want to decrease customer dissatisfaction because of interruptions in fulfilling orders due to inventory shortages.
Thus far, we have been able to identify, collect, and curate data from a variety of sources to help us perform intelligent decision-making using modern analytics. At this point, we have data in the silver layer that represents the state of the data that has been standardized...
