search

lm-sys / RouteLLM

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!
Apache License 2.0
2.78k stars 204 forks source link

can support ollama? #16

Open win4r opened 1 month ago

win4r commented 1 month ago

can support ollama?

iojw commented 1 month ago

We support Ollama! Please check this out: https://github.com/lm-sys/RouteLLM/blob/main/examples/routing_to_local_models.md