search

zlwaterfield / scramble

Open-Source Grammarly Alternative
MIT License
1.13k stars 44 forks source link

Add Local LLM support #1

Open NurvX opened 1 week ago

NurvX commented 1 week ago

Would love to have local llm support through llmstudio or ollama

praserocking commented 1 week ago

Please plan to include local LLM via https://lmstudio.ai/ should be easy. It exposes Open AI compatible API locally for any model, which will be an easy integration point. I am pulling this extension and re-writing api section with localhost for my local use. But proper support needs to be through options.

Richard-Woessner commented 1 week ago

I think having a local LLM mimicking OpenAI API. Is the move but I don't have much browser experience is it typical for a browser extension to have a running service like a local LLM

Richard-Woessner commented 1 week ago

But this also seems perfect for the job

https://github.com/mlc-ai/web-llm

I might try to plug it in later

len-foss commented 1 week ago

Should be fixed by #5