Graphs and charts are used to gain a better understanding of the data relationship. We will use the following to explore data visually:
- Combination of Spark and Vegas viz
- Spark Notebook
Rajesh is a Hands-on Big Data Tech Lead and Enterprise Architect with extensive experience in the full life cycle of software development. He has successfully architected, developed and deployed highly scalable data solutions using Spark, Scala and Hadoop technology stack for several enterprises. A passionate, hands-on technologist, Rajesh has masters degrees in Mathematics and Computer Science from BITS, Pilani (India).
Read more about Rajesh Gupta
Graphs and charts are used to gain a better understanding of the data relationship. We will use the following to explore data visually:
Vegas viz is a MatPlotLib-like library for Scala and Spark. The documentation for this library can be found at https://github.com/vegas-viz/Vegas. Spark does not contain any built-in support for data visualization. Vegas viz provides a convenient mechanism to add visualization to a Spark program written in Scala.
In order to use this library with Spark, let's add the following dependencies to build.sbt:
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-sql"...
Rajesh is a Hands-on Big Data Tech Lead and Enterprise Architect with extensive experience in the full life cycle of software development. He has successfully architected, developed and deployed highly scalable data solutions using Spark, Scala and Hadoop technology stack for several enterprises. A passionate, hands-on technologist, Rajesh has masters degrees in Mathematics and Computer Science from BITS, Pilani (India).
Read more about Rajesh Gupta