Performing hyperparameter tuning

Once search spaces are defined using ParameterSpace or OptimizationConfiguration, with a possible range of values, the next step is to complete network configuration using MultiLayerSpace or ComputationGraphSpace. After that, we start the training process. We perform multiple training sessions during the hyperparameter tuning process.

In this recipe, we will perform and visualize the hyperparameter tuning process. We will be using MultiLayerSpace for the demonstration.

How to do it...

1. Add a search space for the layer size using IntegerParameterSpace:

ParameterSpace<Integer> layerSizeParam = new IntegerParameterSpace(startLimit,endLimit);

2. Add a search space for the learning rate using...