Generating Images with ControlNet
Stable Diffusion’s ControlNet is a neural network plugin that allows you to control diffusion models by adding extra conditions. It was first introduced in a paper called Adding Conditional Control to Text-to-Image Diffusion Models [1] by Lvmin Zhang and Maneesh Agrawala, published in 2023.
This chapter will cover the following topics:
- What is ControlNet and how is it different?
- Usage of ControlNet
- Using multiple ControlNets in one pipeline
- How ControlNet works
- More ControlNet usage
By the end of this chapter, you will understand how ControlNet works and how to use Stable Diffusion V1.5 and Stable Diffusion XL ControlNet models.
