SeldonIO / seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
https://www.seldon.io/tech/products/core/
Other
4.39k stars 833 forks source link

feat(envoy): switch to ADS #6082

Closed driev closed 2 days ago

driev commented 4 days ago

What this PR does / why we need it:

ADS allows for guranteed order of updates, as the xDS resources are sent over the same stream, instead of independent streams. This will be important later, as we'd like to send cluster Y to a node, before updating a route to point to Y instead of another cluster.

Which issue(s) this PR fixes:

Fixes # INFRA-1420

Special notes for your reviewer:

Moved server.go under processor, so it's easier to test.