Chapter 10: Advanced Hyperparameter Tuning with DEAP and Microsoft NNI

DEAP and Microsoft NNI are Python packages that provide various hyperparameter tuning methods that are not implemented in other packages that we have discussed in Chapters 7 – 9. For example, Genetic Algorithm, Particle Swarm Optimization, Metis, Population-Based Training, and many more.

In this chapter, we’ll learn how to perform hyperparameter tuning using both DEAP and Microsoft NNI packages, starting from getting ourselves familiar with the packages, along with the important modules and parameters we need to be aware of. We’ll learn not only how to utilize both DEAP and Microsoft NNI to perform hyperparameter tuning with their default configurations but also discuss other available configurations along with their usage. Moreover, we’ll also discuss how the implementation of the hyperparameter tuning methods is related to the theory that we have learned in previous chapters, since...