Summary
In this chapter, we covered how to connect to our Spark cluster using a SparkSession
and SparkContext
object. We saw how the APIs are uniform across all the languages, such as Scala and Python. We also learned a bit about the interactive shell and iPython. Using this knowledge, we will look at the different data sources we can use to load data into Spark in the next chapter.