Quiz time!

Let’s review what we have learned in this chapter by answering a few questions. Initially, try to answer these questions without consulting the material.

Note

The answers to all these questions are available at https://github.com/PacktPublishing/Accelerate-Model-Training-with-PyTorch-2.X/blob/main/quiz/chapter08-answers.md.

Before starting the quiz, remember that this is not a test! This section aims to complement your learning process by revising and consolidating the content covered in this chapter.

Choose the correct option for the following questions.

1. What are the two main reasons for distributing the training process?
   1. Reliability and performance improvement.
   2. Leak of memory and power consumption.
   3. Power consumption and performance improvement.
   4. Leak of memory and performance improvement.
2. Which are the two main parallel strategies to distribute the training process?
   1. Model and data parallelism.
   2. Model and hardware parallelism.
   3. Hardware and data parallelism...