question: localai integration/compatibility

madox2 / vim-ai

AI-powered code assistant for Vim. OpenAI and ChatGPT plugin for Vim and Neovim.

MIT License

693 stars 59 forks source link

Closed c-nv-s closed 6 months ago

c-nv-s commented 9 months ago

is it possible to integrate this somehow with https://github.com/mudler/LocalAI I can see that https://github.com/continuedev/continue allows vscode integration with local llm but I wish to stick to vim, hence I'm searching for the equivalent.

madox2 commented 9 months ago

Hi, it seems LocalAI provides OpenAI-compatible API. Have you tried to configure custom API for the plugin?

c-nv-s commented 9 months ago

Ah ok you can configure a custom endpoint I'll get around to giving that a try and test out the results. Thanks a lot for this tool.

madox2 commented 6 months ago

Closing due to inactivity