Summary

In this chapter, we learned about how CI/CD works in GCP services. More specifically, we learned about this from the perspective of a data engineer. CI/CD is a big topic by itself and is more mature in the software development practice. But lately, it's more and more common for data engineers to follow this practice in big organizations.

We started this chapter by talking about the high-level concepts and ended it with an exercise that showed how data engineers can use CI/CD in a data project. In the exercises, we used Cloud Build, Cloud Source Repository, and Google Container Registry. Understanding these concepts and what kind of technologies are involved were the two main goals of this chapter. If you want to learn more about DevOps practices, containers, and unit testing, check out the links in the Further reading section.

This was the final technical chapter in this book. If you have read all the chapters in this book, then you've learned about all the...