[Feature]: Docs - Write Tutorial Cookbooks on getting started with LiteLLM Proxy (gateway)

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

https://docs.litellm.ai/docs/

Other

12.58k stars 1.46k forks source link

[Feature]: Docs - Write Tutorial Cookbooks on getting started with LiteLLM Proxy (gateway) #5262

Open ishaan-jaff opened 1 month ago

ishaan-jaff commented 1 month ago

The Feature

Add tutorials on getting started with LiteLLM Proxy Good tutorials to write:

Setup LiteLLM Proxy for Azure, OpenAI, Bedrock, Vertex
Calling LiteLLM Proxy with Langchain, LlamaIndex
Creating a Virtual Key on LiteLLM to give access to models
Using model access groups
Setting up fallbacks on LiteLLM Proxy + testing fallbacks

https://docs.litellm.ai/docs/tutorials

Motivation, pitch

Twitter / LinkedIn details

No response

ShreyaSev commented 1 month ago

Hey, I'm a first time contributor. I have experience in working with Azure AI Services, Langchain and HuggingFace. Would be happy to contribute; would love some guidance on how to go about this as well.

ishaan-jaff commented 1 month ago

@ShreyaSev thanks for picking this up - what guidance would be helpful here?

ShreyaSev commented 1 month ago

I'm completely new to the world of OSS contributions, I know it involves a pull-> edit -> commit cycle. But I'm not sure how I would go about writing documentation for this. If you were solving this issue, what steps would you follow? A basic roadmap would help immensely.

ShreyaSev commented 1 month ago

I have located the docs in the repository. I can also see a code snippet for Langchain available @ https://docs.litellm.ai/docs/proxy/quick_start . If i wanted to solve the second issue "Calling LiteLLM Proxy with Langchain, LlamaIndex" , would I be basically creating a new page under tutorials for the same and expanding on the information provided at the above url?

ishaan-jaff commented 1 month ago

@ShreyaSev can you start with making the PR / writing the .md doc - we can help with moving it to the correct directory that's not a big concern

ShreyaSev commented 1 month ago

@ShreyaSev can you start with making the PR / writing the .md doc - we can help with moving it to the correct directory that's not a big concern

yeah sure I can get started on that

ishaan-jaff commented 1 month ago

this is a good example of what we're looking for, if anyone is looking to help us:

getting started: https://docs.litellm.ai/docs/proxy/docker_quick_start
- use with Aporia: https://docs.litellm.ai/docs/tutorials/litellm_proxy_aporia