search

DavidSouther / ailly

Your AI Writing Ally
Other
9 stars 6 forks source link

Feat: --prompt --stream for Bedrock and noop engines. #109

Closed DavidSouther closed 3 months ago

DavidSouther commented 3 months ago

Streaming responses in the CLI, now the "long" part is waiting for first response which can take a bit for larger contexts.

Demo:

https://github.com/DavidSouther/ailly/assets/498712/5e7db272-6563-41d0-9ee5-8f16a4de2ab2

Closes #71 Groundwork for #65

DavidSouther commented 3 months ago

I can break this into several PRs, but each commit is self-contained.