Production testing methods
As there are various businesses in operation, so are different types of production systems serving these businesses. In this section, we look into the different types of production systems or setups commonly used and how to test them.
Batch testing
Batch testing validates your model by performing testing in an environment that is different from its training environment. Batch testing is carried out on a set of samples of data to test model inference using metrics of choice, such as accuracy, RMSE, or f1-score. Batch testing can be done in various types of computes, for example, in the cloud, or on a remote server or a test server. The model is usually served as a serialized file, and the file is loaded as an object and inferred on test data.
A/B testing
You will surely have come across A/B testing. It is often used in service design (websites, mobile apps, and so on) and for assessing marketing campaigns. For instance, it is used to evaluate...
