Choosing instance types in Amazon SageMaker
SageMaker is a pay-for-usage model. There is no minimum fee for it.
When we think about instances on SageMaker, it all starts with an EC2 instance. This instance is responsible for all your processing. It's a managed EC2 instance. These instances won't show up in the EC2 console and cannot be SSHed either. The instance type starts with ml.
SageMaker offers instances of the following families:
- The t family: This is a burstable CPU family. With this family, you get a normal ratio of CPU and memory. This means that if you have a long-running training job, then you lose performance over time as you spend the CPU credits. If you have very small jobs, then they are cost-effective. For example, if you want a notebook instance to launch training jobs, then this family is the most relevant and cost-effective.
- The m family: In the previous family, we saw that CPU credits are consumed faster due to their burstable nature...
