Monitoring ML models

Observability is a concept primarily used in the context of systems engineering, computer science, and monitoring complex systems. It refers to the ability to understand and infer the internal state and behavior of a system by examining its external outputs or observables. In simpler terms, it’s about gaining insight into how a system operates and performs by observing its outputs or responses.

Monitoring is one of the subjects of observability. It focuses on tracking and measuring predefined metrics and thresholds to ensure that systems and services are running within the expected parameters. It is also referred to as telemetry, akin to how real-time metrics data is collected in mission-critical operations such as launching a rocket to the moon. Unlike logging, which focuses on collecting event data for auditing and troubleshooting at a later date, monitoring focuses on real-time events and is focused on metrics information. For example, logging data...