search

quarkiverse / quarkus-langchain4j

Quarkus Langchain4j extension
https://docs.quarkiverse.io/quarkus-langchain4j/dev/index.html
Apache License 2.0
120 stars 65 forks source link

Use proper Ollama API for chats #543

Closed geoand closed 2 months ago

geoand commented 2 months ago

Before this change we were using /api/generate instead of /api/chat. The former is not well suited for chats.

P.S. The plan in the future is to use the upstream LangChain4j ollama module but we need to introduce an SPI first