Summary

In this chapter, we have explored the capabilities of TVM, a deep learning compiler capable of generating code to run model inference on various target devices, including the latest Arm Ethos-U55 microNPU.

In the first part, we delved into this framework to deploy the CIFAR-10 model on the Arduino Nano and Raspberry Pi Pico. Here, we discussed the TVM Python API to generate the code for model inference and showed the steps to build and run the Arduino sketch on the microcontrollers using Arduino CLI.

Following the successful model deployment on the Arduino Nano and Raspberry Pi Pico, we moved our attention to a new and advanced processor: the microNPU.

In this second part, we introduced the Arm Ethos-U55 microNPU and installed the FVP model for the Arm Corstone-300 platform to play with this processor without needing a physical device.

After installing the virtual device, we generated the code to run the CIFAR-10 model inference on the microNPU using TVMC,...