search

AutoDevTestAgent / ricai_unittestgen_tool

(lablab.ai Autonomous Agents 2023 hackathon) RicAI unit test generation tool
4 stars 0 forks source link

Using other LLMs #1

Open krrishdholakia opened 1 year ago

krrishdholakia commented 1 year ago

Hi @liskovich,

if you're trying to test other LLMs (codellama, wizardcoder, etc.) with GPT-Engineer, we just open-sourced a 1-click proxy to translate openai calls to huggingface, anthropic, togetherai, etc. api calls.

code 

$ pip install litellm

$ litellm --model huggingface/bigcode/starcoder

#INFO:     Uvicorn running on http://0.0.0.0:8000

Docs: https://docs.litellm.ai/docs/proxy_server

I'd love to know if this solves any problem for you

liskovich commented 1 year ago

Hey @krrishdholakia thank you for suggestion! Will definitely check it out. The question of LLM is actually quite relevant as there is a need to work with both natural language (SRS docs) and code

krrishdholakia commented 1 year ago

If you have 10 minutes to chat - would love to understand the architecture and what you're looking for here.

https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat