Introducing Microsoft NNI
Microsoft Neural Network Intelligence (NNI) is an open source platform that addresses the three key areas of any automated ML life cycle – automated feature engineering, architectural search (also referred to as neural architectural search or NAS), and hyperparameter tuning (HPI). The toolkit also offers model compression features and operationalization. NNI comes with many hyperparameter tuning algorithms already built in.
A high-level architecture diagram of NNI is as follows:
Figure 3.26 – Microsoft NNI high-level architecture
NNI has several state-of-the-art hyperparameter optimization algorithms built in, and they are called tuners. The list includes TPE, Random Search, Anneal, Naive Evolution, SMAC, Metis Tuner, Batch Tuner, Grid Search, GP Tuner, Network Morphism, Hyperband, BOHB, PPO Tuner, and PBT Tuner.
The toolkit is available on GitHub to be downloaded: https://github.com/microsoft/nni. More information...
