Support remote endpoint for Ollama?

SilasMarvin / lsp-ai

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

MIT License

1.82k stars 55 forks source link

Support remote endpoint for Ollama? #16

Closed luixiao0 closed 2 weeks ago

luixiao0 commented 2 weeks ago

Thanks for this project

Is there an existing issue for this?

I have searched the existing issues

Feature request

Support remote endpoint for Ollama

Context

ollama is not fast enough using onboard hardware if run on laptops locally, we can utilize exising cloud GPUs to speed it up

Possible implementation I have provided a possible implementation at https://github.com/SilasMarvin/lsp-ai/pull/15

SilasMarvin commented 2 weeks ago

This is great! I added it yesterday and honestly didn't even think about a remote api. I added a few comments in the PR, but otherwise it looks really awesome!

luixiao0 commented 2 weeks ago

resolved by #15