Feat: Spring cloud eureka client support for scale out

bentoml / BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

https://bentoml.com

Apache License 2.0

7.2k stars 794 forks source link

Feat: Spring cloud eureka client support for scale out #1798

Closed joswlv closed 4 months ago

joswlv commented 3 years ago

Eureka is used to easily manage node information in MSA (MicroService Architecture) environment using spring cloud.

A scale-out environment is needed to handle large-volume traffic, and at this time, BentoML applications are used on multiple servers. Eureka client support is required to efficiently manage multiple servers and use routing using spring cloud.

frostming commented 4 months ago

Out cloud infra is based on Kubernetes, this is not in the scope. Closing.