search

xyproto / ollamaclient

Go package and example utilities for using Ollama / LLMs
Apache License 2.0
15 stars 4 forks source link

Quick question about the stream API for library author #7

Open bZichett opened 1 month ago

bZichett commented 1 month ago

Is there a particular reason that stream.go doesn't augment with the provided tools as the sync client does? Limitation with streaming and ollama? (final output required before sending etc, I am, in short, not sure and doubting my understanding)

By the way, this is a very neat and clean package. I just got it working with http2 and a streaming client on browser. Thank you, kindly.

bZichett commented 1 month ago

https://github.com/ollama/ollama/issues/5796 which links to https://github.com/ollama/ollama/issues/7014 at the end.

I see the related ollama discussion now ^

Looking forward to this, not entirely clear how langchain does it, or even if that is accurate but above is a PR to improve support on ollama.