search

quarkiverse / quarkus-langchain4j

Quarkus Langchain4j extension
https://docs.quarkiverse.io/quarkus-langchain4j/dev/index.html
Apache License 2.0
148 stars 89 forks source link

Properly handle Ollama streaming #1070

Closed geoand closed 1 week ago

geoand commented 1 week ago

We also catch MismatchedInputException when the results are being streamed back as it indicates we are still in an intermediate state

quarkus-bot[bot] commented 1 week ago

Status for workflow Build (on pull request)

This is the status report for running Build (on pull request) on commit 8ad9c2666b2e4ae77cf9985531887d686dfcf15e.

:white_check_mark: The latest workflow run for the pull request has completed successfully.

It should be safe to merge provided you have a look at the other checks in the summary.

benDeMtp commented 1 week ago

@geoand , do you think this is possible to have this fix in the next release ?

geoand commented 1 week ago

Yes, I will likely get a new release out this week