ai-cfia / howard

The Howard project, named after "The Godfather of Clouds" Luke Howard, orchestrates the Kubernetes-based cloud infrastructure for the Canadian Food Inspection Agency's AI lab, managing applications like Nachet, Finesse, and Louis. It prioritizes robustness, security and efficiency
https://ai-cfia.github.io/howard/
MIT License
3 stars 0 forks source link

Migrate Louis to an instance with a self hosted litellm integration #286

Closed SonOfLope closed 1 week ago

SonOfLope commented 1 week ago

Since 0.2.0 of Louis, they have depreated bundled litellm integration in Louis. As such, we need to self host an instance and add a connection through it like an openai connection : image