Using SQL in Azure Databricks

In this section, you can run a SQL statement to create a table and work with data using SQL Statements:

1. Copy and paste this code snippet into the notebook cell to see a list of the Azure Databricks datasets:

display(dbutils.fs.ls("/databricks-datasets"))

2. The code appears as follows:

DROPTABLEIFEXISTS diamonds;
CREATETABLE diamonds
USING csv
OPTIONS (path "/databricks-datasets/Rdatasets/data-001/csv/ggplot2/diamonds.csv", header "true")

3. Press Shift + Enter. The notebook automatically attaches to the cluster you created in Step 2, creates the table, loads the data, and returns OK:

4. Next, you can run a SQL statement to query the table for the average diamond price by color.
5. To add a cell to the Notebook, hover over the cell bottom and click the icon:

6. Copy this snippet and paste it into the cell:

SELECT color, avg...