Decide on server: BentoML, RayServer,...?

openml-labs / ai_search

RAG pipeline and summary for openml

https://openml-labs.github.io/ai_search/

1 stars 0 forks source link

Decide on server: BentoML, RayServer,...? #35

Open joaquinvanschoren opened 3 months ago

PGijsbers commented 3 months ago

We probably need some context to make a decision here. What kind of traffic numbers are we working with? What kind of hardware do we have to run this on?