Open liffiton opened 1 month ago
Update: After deleting the existing database to restart from scratch (luckily I wasn't deep into configuration yet), adding the model correctly with the prefix does work now. So the invalid model does appear to have been blocking the addition of any other models.
Adding deepseek on Admin UI is done here @liffiton https://github.com/BerriAI/litellm/pull/5857
@liffiton can we hop on a call and learn how we can improve LiteLLM for you? (Saw you're a professor - we're working with some other universities and helping them give students access to LLMs)
my cal for your convenience: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat my linkedin if you prefer DMs: https://www.linkedin.com/in/reffajnaahsi/
Just to be clear, the issue here isn't specific to DeepSeek. The problem is what happens when you enter any invalid model in the admin UI: preventing further additions and spamming the logs.
And if it's alright with you, I strongly prefer email. Feel free to email me if you have questions for me or want to learn more about how I'm using LiteLLM.
Can we setup a slack support channel ? @liffiton What's the best email to send an email to ?
Just to be clear, the issue here isn't specific to DeepSeek. The problem is what happens when you enter any invalid model in the admin UI: preventing further additions and spamming the logs.
Tracking two issues before closing this
My university email would be fine (don't care to post it here, but it's easy to find).
What happened?
In the proxy admin UI (v1.44.23 stable), I added an invalid model by mistake*, and now I'm getting constant error messages in the logs with no way I can see to stop them.
The error:
I see nothing in the proxy admin UI that lets me clean out this invalid model, and the error messages just keep coming every 10 seconds.
*Side note: I'm still not sure how to add a DeepSeek model correctly. Selecting "OpenAI-compatible", then giving the model name as
deepseek/deepseek-chat
(as in the docs) doesn't seem to work, though maybe it's because the first model I added is stuck in there, preventing later additions from processing?Relevant log output
No response
Twitter / LinkedIn details
No response