search

latitude-dev / latitude-llm

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI
https://latitude.so
GNU Lesser General Public License v3.0
879 stars 57 forks source link

Multi AZ Gateway #593

Open cesr opened 1 week ago

cesr commented 1 week ago

For some users in the US the latency cost of the roundtrip between our EU servers and them is too high. We can fix this by implementing a global deployment of gateway via cloudflare workers and leveraging hyperdrive to minimize the penalty costs of reaching our regional database

cesr commented 1 week ago

@geclos I don't think this should be prioritized right now, moving to backlog p2

geclos commented 1 week ago

hmm I think this is very important actually, I would do it asap