Microservice platforms today, supports geographically dispersed deployments. This means that multiple instances of a Microservice can be hosted in different continents on heterogeneous environments. While abstracting the service hosting location has advantages, it also introduces challenges around offering consistent performance for consumer requests from different parts of the globe. Having a load balancer which uses a round robin or random routing algorithm cannot guarantee the most optimal response in most cases.
Latency optimized load balancing (Problem)
Load balancing plays an important role in optimal performance of any distributed system. This pattern optimizes the action of load balancing by considering the proximity of the Microservice deployment and the turnaround time from previous requests along with other parameters such as current load, health of the instance, and so on. This will enable the system to route a request from a consumer...
