search

quarkiverse / quarkus-langchain4j

Quarkus Langchain4j extension
https://docs.quarkiverse.io/quarkus-langchain4j/dev/index.html
Apache License 2.0
116 stars 65 forks source link

change the success message as some opensource models like empower-fun… #617

Open MoheyEl-DinBadr opened 1 month ago

MoheyEl-DinBadr commented 1 month ago

change the success message as some opensource models like empower-functions-medium (can be tested with baseUrl: https://app.empower.dev/api/v1/functions/) accepts Tool Message as Json only

geoand commented 1 month ago

Hi,

Thanks for the contribution, but I can't say I really understand this change

MoheyEl-DinBadr commented 1 month ago

Hi,

Thanks for the contribution, but I can't say I really understand this change

There is an exception happening when you try open-source LLMs like empower you get the following exception

log.txt

you could check it out by having this configurations no api-key needed

quarkus.langchain4j.openai.chat-model.model-name=empower-functions-medium quarkus.langchain4j.openai.base-url=https://app.empower.dev/api/v1/functions/

geoand commented 1 month ago

I will check soon, thanks

geoand commented 1 month ago

@langchain4j does this seems correct to you?

langchain4j commented 1 month ago

A bit strange (regarding JSON strictness), but if there is such a requirement, what can we do...