Summary
In this chapter, you have seen how to provision a Synapse Spark pool. You have learned about Spark's architecture in general and Synapse Spark's architecture.
You have learned about the difference between Synapse Spark pools and Synapse Spark instances. You implemented your first Synapse notebook for interactive analytics and learned how to implement a Spark application that can be run as a batch job.
You have seen how to use a Spark pool from an IDE such as Visual Studio Code and you have investigated how to use additional libraries from public sources and your own libraries.
Finally, you saw how you can interact with storage securely, before learning how monitoring works with your Synapse Spark environment.
In Chapter 7, Using Databricks Spark Clusters, you will learn about an alternative Spark environment that Microsoft offers on Azure.
