[FEATURE REQUEST] Ollama compatibility

microsoft / TypeChat

TypeChat is a library that makes it easy to build natural language interfaces using types.

https://microsoft.github.io/TypeChat/

MIT License

8.06k stars 379 forks source link

[FEATURE REQUEST] Ollama compatibility #183

Open jb-reefer opened 4 months ago

jb-reefer commented 4 months ago

It looks like there's a repo that gets close - https://github.com/anaisbetts/TypeChat/tree/main - but now that Ollama has OpenAI API compatibility, it would be great to have on-device LLMs supported.

I took a crack at it but couldn't hack it in an hour or so, so filing this.

antpass79 commented 2 days ago

Hi @jb-reefer , take a look at: https://github.com/giakki/typechat.net