Open ishaan-jaff opened 11 months ago
@swyxio @jakubno can you please take a look at this PR when you get the chance ? Happy to add more docs/tests if this initial PR looks good😊
any updates on this? @swyxio @jakubno
Very interested in seeing this merged, would be a partial answer to #90
hey @iamjameswalters any specific providers /models you're trying to use? want to make sure we have it supported - https://docs.litellm.ai/docs/providers
hey @iamjameswalters any specific providers /models you're trying to use? want to make sure we have it supported - https://docs.litellm.ai/docs/providers
Specifically I'm looking to use Starcoder, which it looks like I can do with litellm through the HuggingFace API. I'm taking this PR for a spin right now to see how it works. 🙂️
Hi @swyxio just wanted to follow up on this PR
What was litellm missing to be useful to you? Any feedback here would be helpful
This PR adds support for models from all the above mentioned providers using litellm https://github.com/BerriAI/litellm
TLDR:
developer
gets:model
param (Easy to add models in the future, just change the model param)Here's a sample of how it's used: