BloopAI / bloop

bloop is a fast code search engine written in Rust.
https://bloop.ai
Apache License 2.0
9.43k stars 573 forks source link

Support for custom OpenAI-Compatible backends #1231

Open keinsell opened 9 months ago

keinsell commented 9 months ago

What's the problem?

Usage of local large language models through LocalAI, LMStudio and so on, all of these are providing OpenAI-compatible API, but application need to expose a setting to change baseurl.

What's the outcome?

Related Issues: #415 #1094

rodion-m commented 8 months ago

An ability to use custom backends is really required. Azure OpenAI supporting as well. Even as a paid feature.

recursionbane commented 8 months ago

Yes, AzureOpenAI support, please.

ggordonhall commented 7 months ago

We've open-sourced the OpenAI API logic (https://github.com/BloopAI/bloop/tree/oss/server/bleep/src/llm). You can now build and run bloop with a custom OpenAI API key (see: https://github.com/BloopAI/bloop?tab=readme-ov-file#building-from-source).

Feel free to open a PR adding support for Azure OpenAI 😀