search

ferrislucas / promptr

Promptr is a CLI tool that lets you use plain English to instruct GPT3 or GPT4 to make changes to your codebase.
MIT License
907 stars 37 forks source link

Allow to set the base_url for the openai gateway #60

Closed shuther closed 5 months ago

shuther commented 7 months ago

Add the ability to change the openai endpoint (baseURL) as per OpenAI SDK to be able to leverage self hosted LLM.

ferrislucas commented 5 months ago

@shuther thanks for opening this issue. Sorry for the slow response. Do you have any interest in creating a PR for this functionality? I think it would be great to support local models and additional providers.

ferrislucas commented 5 months ago

@keiththomps did you have any luck with this? It looks like you added the ability to specify a base url, did that work for you? I really appreciate your contribution.

https://github.com/ferrislucas/promptr/compare/main...keiththomps:promptr:main

keiththomps commented 5 months ago

@ferrislucas I honestly can't remember 😅 I ended up dabbling with anthropic and spun up a completely different tool heavily inspired by promptr to do that. Let me pull my branch down and test it out with our proxy

keiththomps commented 5 months ago

Tested it using my work gateway and it works 👍 https://github.com/ferrislucas/promptr/pull/64 Sorry for not adding a test.

ferrislucas commented 5 months ago

Thank you very much for the PR and your time @keiththomps !