Bundling curator access

monogon-dev / monogon

The Monogon Monorepo. May contain traces of peanuts and a ✨pure Go Linux userland✨. Work in progress!

https://monogon.tech

Apache License 2.0

378 stars 9 forks source link

Bundling curator access #193

Open lorenz opened 1 year ago

lorenz commented 1 year ago

Now that we're making significant use of the curator in node code, we have the problem that each service opens its own connection and keeps its own watches. This is fairly inefficient, especially in large clusters.

[ ] metropolis/node/core/network/hostsfile: NodesInCluster
[ ] metropolis/node/core/roleserve: NodesInCluster
[ ] metropolis/node/kubernetes: 2x NodesInCluster
[ ] metropolis/node/core/rpc/resolver: NodesInCluster

q3k commented 1 year ago

This reuses gRPC client connections: https://review.monogon.dev/c/monogon/+/1749

Reusing watches is WIP.

q3k commented 1 year ago

gRPC connection reuse merged.

Now working on reusing watches on client-side (ie. providing multiple subsystems with data from a single Curator.Watch call).

q3k commented 1 year ago

Taking a break from this for now, but I have some local code stashed if anyone wants to pick up from where I left off.

q3k commented 1 week ago

Letting someone else deal with this beast.