Open dlaliberte opened 8 months ago
I have started working on this. Ollama support is in the works 👼 (I found it very easy to run on a mac, and works wonders with Mistral:7b)
Once that's added, I'll have to see if generalized provider support is possible (so that you select from a list, and I don't have to add support for each one manually).
There are several LLMs now available that would be adequate substitutes for ChatGPT's, using the openai API. To avoid forcing you choose which alternatives to offer, if you just allow the user to enter the URL of the service, which might be a localhost, we could experiment with different LLMs on our own.
The other feature I would like would be the ability to iterate over all the files in a folder, which might be nested in subfolders. It would probably be wise to have an option for how long to delay between processing each file, though there is less need for this if I am using my own local LLM.