Summary
In this chapter, we learned about two different things. First, we learned about how to estimate an end-to-end data solution cost. Second, we understood how BigQuery partitioned and clustered tables play a significant role in cost.
These two topics are usually needed by data engineers in different situations. Understanding how to calculate cost will help in the early stages of GCP implementation. This is usually a particularly important step for an organization to decide its future solution as a whole.
The second topic usually occurs when you’re designing BigQuery tables, and at a time when you need to evaluate the running BigQuery solution. Even though it’s obvious that using partitioned and clustered tables is beneficial, it’s not a surprise in a big organization, as many tables are not optimized and can be improved.
Lastly, we performed an experiment using three different tables. It proved that using partitioned and clustered tables can reduce...
