issues
search
BerriAI
/
litellm
Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
https://docs.litellm.ai/docs/
Other
10.11k
stars
1.13k
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[Feature]: Improve Edit Model Dialog to include base fields from creation.
#4466
Maralai
opened
3 hours ago
0
[Feat] - Proxy support Passing through Langfuse requests
#4465
ishaan-jaff
closed
10 hours ago
1
[Enterprise] Return Raw response from Lakera in failed responses
#4464
ishaan-jaff
closed
11 hours ago
1
Docs create pass through routes litellm proxy (tutorial setup cohere Re-Rank Endpoint)
#4463
ishaan-jaff
closed
11 hours ago
1
[Feat] Allow users to set pass through endpoint + add Cohere Re-Rank
#4462
ishaan-jaff
closed
11 hours ago
1
fix: Include vertex_ai_beta in vertex_ai param mapping/Do not use google auth project_id
#4461
t968914
opened
17 hours ago
3
docs: minor link repairs
#4460
nibalizer
closed
18 hours ago
1
[Bug]: Use alt=sse for Vertex AI streaming
#4459
Manouchehri
closed
13 hours ago
22
[Bug]: await twice for acompletion of custom model
#4458
MarkintoshZ
closed
12 hours ago
1
Fix typo
#4457
lnguyen
closed
18 hours ago
2
[Bug]: Helm-Chart / Can't run chart in root-restricted OpenShift Cluster
#4456
freinold
opened
23 hours ago
0
[Bug]: Stop Sequences not working with "ollama_chat"
#4455
Clad3815
opened
1 day ago
0
[Bug]: DALL-E connection error
#4454
Clad3815
opened
1 day ago
0
[Feature]: Integrate Azure Monitor into LiteLLM
#4453
RyoYang
closed
19 hours ago
2
[Bug]: /spend/calculate doesn't work for Gemini models
#4452
emerzon
closed
1 day ago
1
[Fix] Azure Post-API Call occurs before Pre-API Call in CustomLogger
#4451
ishaan-jaff
closed
1 day ago
1
[Bug]: Allow 2,097,152 tokens with Gemini 1.5 Pro
#4450
Manouchehri
closed
1 day ago
5
feat(azure.py): azure tts support
#4449
krrishdholakia
closed
1 day ago
1
[Bug]: `traceparent` causes `extra_headers` on config to be ignored/overwritten
#4448
Manouchehri
closed
1 day ago
10
[fix] error message on /v2/model info when no models exist
#4447
ishaan-jaff
closed
1 day ago
1
fix(token_counter.py): New `get_modified_max_tokens' helper func
#4446
krrishdholakia
closed
1 day ago
1
fix: do not resolve vertex project id from creds
#4445
ushuz
closed
1 day ago
1
[Feat] Improve secret detection call hook - catch more cases
#4444
ishaan-jaff
closed
1 day ago
1
[Fix] Secret redaction logic when used with logging callbacks
#4443
ishaan-jaff
closed
1 day ago
1
Updates Databricks provider docs
#4442
djliden
closed
1 day ago
1
[Bug]: Giving Gemini an image whose URL does not end with an extension causes a 500 error
#4441
wwwcojp
closed
1 day ago
3
[Bug]: Overly strict validation of chunks results in missing tool name
#4440
ZanSara
closed
1 day ago
1
[Bug]: Completion tokens are incorrectly calculated
#4439
JosephDavidsonKSWH
closed
1 day ago
1
[Bug]: Amazon Bedrock Llama3 throws exception
#4438
grav
closed
2 days ago
1
fix(initial-commit): decrypts aws keys in entrypoint.sh
#4437
krrishdholakia
closed
6 hours ago
1
fix(utils.py): return 'response_cost' in completion call
#4436
krrishdholakia
closed
1 day ago
1
[Feat] Add Codestral pricing
#4435
ishaan-jaff
closed
2 days ago
1
fix(router.py): fix setting httpx mounts
#4434
krrishdholakia
opened
2 days ago
1
[Feat] New Provider - Add volcano AI Engine
#4433
ishaan-jaff
closed
2 days ago
1
[Feature]: Add codestral pricing to litellm model cost map
#4432
ishaan-jaff
closed
2 days ago
1
[Fix-Proxy] Azure Embeddings use AsyncAzureOpenAI Client initialized on litellm.Router for requests
#4431
ishaan-jaff
closed
2 days ago
1
fix(router.py): azure-models: only return 'max_tokens', 'input_cost_per_token', in 'get_router_model_info' if base_model is set
#4430
krrishdholakia
closed
17 hours ago
2
[Bug]: Stream requests failing for openai compatible endpoints.
#4429
letmefocus
closed
2 days ago
1
[Bug]: Azure, OpenAI Proxy embeddings not using OpenAI client initialized on litellm.Router
#4428
ishaan-jaff
closed
2 days ago
0
[Fix-Proxy] Store SpendLogs when using Whisper, Moderations etc
#4427
ishaan-jaff
closed
2 days ago
1
How to pass access token/authorization key to run ollama through litellm
#4426
PhilipAmadasun
opened
2 days ago
0
[Feature]: Support Vertex Imagen2
#4425
emerzon
closed
2 days ago
1
fix add ollama codegemma to model cost map
#4424
ishaan-jaff
closed
2 days ago
1
[Fix] Forward OTEL Traceparent Header to provider
#4423
ishaan-jaff
closed
2 days ago
1
[Feat] OTEL allow setting deployment environment
#4422
ishaan-jaff
opened
2 days ago
1
[Feat] Add all Vertex AI Models
#4421
ishaan-jaff
closed
2 days ago
1
Add return type annotations to util types
#4420
guitard0g
closed
2 days ago
10
[Bug]: LiteLLM Proxy Traceparent header is not forwarded to backends
#4419
aloababa
closed
2 days ago
7
[Feat] Add Fireworks AI Tool calling support
#4418
ishaan-jaff
closed
2 days ago
1
[Bug]: Azure OpenAI attempts to reuse Azure AD token after it expires
#4417
Manouchehri
opened
2 days ago
2
Next