search

smallcloudai / refact-lsp

Rust executable for Refact Agent, it lives inside your IDE and keeps AST and VecDB indexes up to date, offers agentic tools for an AI model to call. Yes, it works as a LSP server from IDE point of view.
BSD 3-Clause "New" or "Revised" License
45 stars 19 forks source link

[please test] BYOK with ollama #342

Open olegklimov opened 1 month ago

olegklimov commented 1 month ago

With the ollama project it's easy to host our own AI models.

You can set up bring-your-own-key (BYOK) to connect to ollama server, and see if you can use StarCoder2 for code completion, llama models for chat.

Does it work at all? What we need to fix to make it better?

pardeep-singh commented 1 month ago

@olegklimov I would like to take this up. Can you please some docs/example of how this can done? Do we need to test the integration here or make changes as well to make it work?

olegklimov commented 1 month ago

Oh, here https://docs.refact.ai/byok/ you can test if we have documentation that is any good :D

avie66 commented 3 weeks ago

Hi @pardeep-singh Did you had a look over Oleg's approach?