julian-shalaby / ChatWindow-feedback

1 stars 0 forks source link

Use Ollama Rest API available on another computer #9

Closed gillesbourgeat closed 3 days ago

gillesbourgeat commented 1 month ago

Hello,

Thank you for your great plugin.

Would it be possible to add a feature that would allow querying the Ollama REST API available on another computer?

julian-shalaby commented 3 days ago

Hey! Over the past few months I have started to redo the entire ChatWindow project from the ground up. The V2 architecture unfortunately will not allow for Ollama usage. I understand this is a downside in many ways, but hopefully the additional upsides will mitigate the tradeoff.

Tbh I would love to support Ollama, but after closely evaluating how an integration would work seamlessly in the new architecture, the development overhead is just way too much to take on as a single developer and do it smoothly. The expanded scope leaves way too many edge cases, and the only way I could possibly address these while taking into account security considerations and smooth feature experiences would be a bunch of hacky layers of indirection. Will be open to reimplementing Ollama 1 day in the future