Using decision trees for regression

Decision trees for regression are very similar to decision trees for classification. The procedure for developing a regression model consists of four parts:

• Load the dataset
• Split the set into training/testing subsets
• Instantiate a decision tree regressor and train it
• Score the model on the test subset

Getting ready

For this example, load scikit-learn's diabetes dataset:

#Use within an Jupyter notebook
%matplotlib inline   

import numpy as np
import pandas as pd
import matplotlib.pyplot as plt

from sklearn.datasets import load_diabetes

diabetes = load_diabetes()

X = diabetes.data
y = diabetes.target

X_feature_names = ['age', 'gender', 'body mass index', &apos...