Key feature set
The human face and body are key entities in this task of fake content generation. While deep learning architectures usually do not require hand-crafted features, a little nudge goes a long way when complex entities are involved. Particularly when dealing with the human face, apart from detecting the overall face in a given image or video, a deepfake solution also needs to focus on the eyes, mouth, and other features. We discussed different modes of operation in the previous section, where we highlighted the importance of different sections of a face and their impact on improving the believability of the fake content generated.
In this section, we will briefly cover a few important features leveraged by different deepfake solutions. These are:
- Facial Action Coding System (FACS)
- 3D Morphable Model (3DMM)
- Facial landmarks
We will also undertake a couple of hands-on exercises to better understand these feature sets.
