Complete working of a Lambda Architecture
The following figure pictorially shows the complete working of Lambda Architecture:
Figure 10: Complete working of Lambda Architecture
As briefly explained earlier, the master data set is maintained and managed in the batch layer. When new data arrives, it is despatched to both, batch and speed layer. Once it reaches the batch layer, at regular batch interval batch views are generated and recomputed from scratch each time. Similarly, the speed layer using the new data generates the speed view whenever the new data arrives in the layer. The serving layer when queried, merges both the speed and batch layer views to generate the appropriate query results.
Once the batch view is generated, the speed view is discarded and till the time new data arrives only bath view needs to be queried as all the data is available in the batch layer itself.
Batch Layer |
|
Speed Layer |
|
