Summary

In this chapter, we looked at various tools and technologies that we will need in subsequent chapters. We started with how to create a development environment in the cloud and then went through the steps to install the necessary software locally. We looked at how to install sbt, as well as how to configure IDEs such as VS Code and IntelliJ IDEA to work with Scala. We briefly looked at Docker, which is one of the most popular container engines; if you do not have it installed locally, we highly recommend you do so. We covered configuring Spark in detail, but you also have the option of setting up a Spark cluster using Docker containers. We covered the steps to install MySQL, which we will use in our chapter on working with databases. We also covered MinIO, which is a high-performance, Simple Storage Service (S3)-compatible object storage solution.

This chapter’s purpose was to prepare the tooling required for the subsequent chapters. In the next chapter, we will look...