lm-sys RouteLLM issues - Githubissues

lm-sys / RouteLLM

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Apache License 2.0

3.3k stars 250 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

can not initializing the RouteLLM controller

#21 Walter-Liu-X opened 4 months ago
4
Support function calling?

#20 therealtimex opened 4 months ago
9
OpenAI dependency

#19 DanielChico opened 4 months ago
1
Docker support

#18 raldone01 closed 4 months ago
4
Optimization for MF

#17 thwu1 opened 4 months ago
0
can support ollama?

#16 win4r opened 4 months ago
2
Module controller missing - Linux & MAC

#15 RahulMR42 closed 4 months ago
2
insufficient_quota error

#14 bisratberhanu closed 3 months ago
4
Add unified controller interface

#13 iojw closed 4 months ago
0
Minor Typos in Readme

#12 olivercarmont closed 4 months ago
1
Add LiteLLM support

#11 iojw closed 4 months ago
0
Wondering how the D_golden training data is constructed.

#10 URRealHero closed 4 months ago
2
Matrix factorization router is bloated

#9 KTibow opened 4 months ago
2
Feature: Add an endpoint that only returns which model is the best

#8 DanielChico closed 4 months ago
6
GPT-4o not found in MODEL_IDS for mf router

#7 sapountzis closed 4 months ago
3
ollama doesn't work

#6 Yeqishen closed 4 months ago
7
Question: was text-embedding-3-small included in the bills?

#5 Sunt-ing closed 4 months ago
2
RouteLLM Useage instrauctions please

#4 pirouzkhakzad closed 4 months ago
16
Support for Amazon Bedrock Routers

#3 dferguson992 closed 4 months ago
2
Support for Ollama Planned/Possible?

#2 Heavy02011 closed 4 months ago
1
Add matrix factorization training code

#1 thwu1 closed 5 months ago
0