Cost-sensitive dynamic threshold using prompt complexity scoring

lm-sys / RouteLLM

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Apache License 2.0

3.3k stars 250 forks source link

Closed joannwong closed 1 week ago