Expose openai.base_url for access to more models

nus-apr / auto-code-rover

A project structure aware autonomous software engineer aiming for autonomous program improvement. Resolved 30.67% tasks (pass@1) in SWE-bench lite and 38.40% tasks (pass@1) in SWE-bench verified with each task costs less than $0.7.

Other

2.72k stars 288 forks source link

Expose openai.base_url for access to more models #60

Closed talentoscope closed 2 months ago

talentoscope commented 2 months ago

It would be great if openai.base_url was exposed so that nearly any model could be loaded in via lm-studio or other OpenAI-like APIs.

Marti2203 commented 2 months ago

Hi, I just added support for changing the base URL in the LiteLLM GPT model in commit 1b47dda4 You can set the OPENAI_API_BASE_URL variable and should be good to go

talentoscope commented 2 months ago

Amazing, thank you!

Marti2203 commented 2 months ago

Will close the issue then if all is good :+1: