lm-sys RouteLLM issues - Githubissues

lm-sys / RouteLLM

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Apache License 2.0

3.3k stars 250 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Merge dynamic_cost_threshold branch into main

#71 joannwong closed 1 week ago
0
Prompt complexity router

#70 daparasyte closed 1 week ago
0
Bayesian optimisation

#69 joannwong closed 1 week ago
0
Cost-sensitive dynamic threshold using prompt complexity scoring

#68 joannwong closed 1 week ago
0
Can BERT router source code (esp. for training) be added to the repo?

#67 nirav2 opened 3 weeks ago
0
Cost Sensitive Router

#66 joannwong closed 1 week ago
0
How to train a router?

#65 awsankur opened 1 month ago
0
Could you please share your processed dataset D_arena?

#64 SCUT-ChenBD closed 1 month ago
1
litellm.drop_params error when running the openapi server

#63 masaruduy opened 1 month ago
1
Ability to Incorporate Open Source Embeddings for Router to Remove OpenAI dependency

#62 madison-evans opened 1 month ago
0
After cloning the project locally, I couldn't find the relevant routing model.

#61 akakenle closed 1 month ago
0
How to train a BERT router?

#60 CUHKSZzxy closed 1 month ago
1
about OpenAI api key error

#59 JunjieHu25 closed 2 months ago
0
Are only GPT-4 and Mistral models currently supported for routing?

#58 WangRongsheng closed 2 months ago
2
Why not use Sigmoid over the logit produced by the Classifier in train_matrix_factorization.py?

#57 thethinkmachine opened 3 months ago
0
Support providing separate API keys for strong and weak models

#56 githubcustomerserviceistrash opened 3 months ago
1
create /health endpoint for health checks

#55 bitnom closed 3 months ago
1
Does routellm support routing queries to different models in OpenAI assistant?

#54 krishnashed opened 3 months ago
2
fix default model directory naming conflict by rn routellm/ to routel…

#53 bitnom opened 3 months ago
1
model directory naming conflict

#52 bitnom opened 3 months ago
0
OpenAI Error

#51 NEWbie0709 closed 3 months ago
1
use different embedding model

#50 bitnom opened 3 months ago
1
dep version not pinned

#49 bitnom opened 3 months ago
0
add project meta & build config for pdm

#48 bitnom opened 3 months ago
1
unable to edit/build with pdm

#47 bitnom opened 3 months ago
0
pin dep numpy<2

#46 bitnom closed 3 months ago
1
code not supported by numpy>=2

#45 bitnom closed 3 months ago
0
Add CORS middleware/support

#44 bitnom opened 3 months ago
0
Server doesn't respond to CORS preflight requests

#43 bitnom opened 3 months ago
0
BERT model working

#42 Harinisri29 closed 3 months ago
1
How to use the groq models?

#41 Harshpatil317 closed 3 months ago
2
404 Client Error.

#40 Gayathri-Gobinathan closed 3 months ago
3
Can we use the matrix factorization model locally by downloading it to our local?

#39 nileshm11 opened 4 months ago
2
OpenAIError: The api_key client option must be set

#38 DmitriyG228 opened 4 months ago
5
how can we set parameters of model like temperature, streaming, etc?

#37 nileshm11 closed 3 months ago
1
How to set threshold value?

#36 Harinisri29 closed 3 months ago
2
Support for Multiple LiteLLM Models

#35 bhumika-scogo closed 3 months ago
3
Gemini-pro from openrouter have context length of 91k but getting error

#34 upasana-mittal opened 4 months ago
1
Dockerizing Route-LLM 🚀

#33 szymonrucinski opened 4 months ago
1
Fixing UnsupportedParamsError in `litellm` when using `groq` model with OpenAI

#32 szymonrucinski opened 4 months ago
2
webpage 0.0.0.0:6060 down

#31 hungvipqt15 closed 3 months ago
2
Add support for LLama-3.1

#30 goswamig closed 3 months ago
2
Can I use Azure open AI

#29 royrajjyoti12 opened 4 months ago
5
Langchain integration

#28 mathieuisabel opened 4 months ago
3
Allow Separate Base URLs for Strong and Weak Models in Controller

#27 Splasha545 opened 4 months ago
1
Why use Hadamard product in Matrix Factorization router?

#26 awsvmaringa closed 4 months ago
1
docs: update README.md

#25 eltociear closed 4 months ago
1
Can we use 2 ollama models?

#24 masterchop closed 3 months ago
14
Provide support for more than two models and provide a training guide.

#23 BrainSlugs83 opened 4 months ago
5
Trouble understanding datasets used

#22 aoezis closed 4 months ago
3