kuafuai / DevOpsGPT

Multi agent system for AI-driven software development. Combine LLM with DevOps tools to convert natural language requirements into working software. Supports any development language and extends the existing code.
https://www.kuafuai.net
Other
6.48k stars 830 forks source link

Add Bedrock, Ollama, Claude2, Cohere, Replicate [100+ LLMs] - using LiteLLM #114

Open krrishdholakia opened 11 months ago

krrishdholakia commented 11 months ago

Hi @booboosui @charging-kuafuai,

Noticed you're calling the openai completions endpoint. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and wanted to see how i could be helpful.

My PR shows users how to call their LLM providers (bedrock, togetherai, huggingface tgi, replicate, ai21, cohere, ai21 etc.) by pointing your openai endpoint to a local proxy they can use for experimentation.

This makes no code changes to your app.

Happy to add additional tests/documentation if the initial PR looks good.