search

opendiffy / diffy

Other
1.25k stars 142 forks source link

What is the right way to scale Diffy? #37

Closed simiczhang closed 4 years ago

simiczhang commented 4 years ago

If there would be millions of requests to Diffy proxy, how to scale Diffy ?

Is it possible to start multiple Diffy servers by using same http.port so all requests could be load balanced but the result is still aggregated (not sure if the volume of the result would blow out service behind http.port as well) ?

puneetkhanduri commented 4 years ago

Nope. That won't work. Diffy is not designed to be clustered or federated. We had to build Isotope from scratch to acheive the scalability you are looking for.

simiczhang commented 4 years ago

Ok, got it.