Do we have a Thundering Herd Problem with our Services?

querqy / chorus

Towards an open source stack for e-commerce search

Apache License 2.0

141 stars 33 forks source link

Do we have a Thundering Herd Problem with our Services? #141

Open epugh opened 1 year ago

epugh commented 1 year ago

introduce some early, regular, and late service startup so we don't run all at the same time...

I feel like this runs faster overall... Would love any thoughts on how to test this?

epugh commented 1 year ago

In working with our embeddings service, it seems to like to fire up after the rest has fired up... Moving it to the end of the start process made things easier...