search

devoxx / DevoxxGenieIDEAPlugin

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All and Jan) and Cloud based LLMs to help review, test, explain your project code.
https://devoxx.com
MIT License
77 stars 15 forks source link

Groq streaming doesn't work with Langchain4J #84

Open stephanj opened 1 month ago

stephanj commented 1 month ago

This is most likely a bug in Langchain4J...

stephanj commented 1 month ago

It gives a NPE on response.content() in InternalOpenAiHelper 

    static Response<AiMessage> removeTokenUsage(Response<AiMessage> response) {
        return Response.from(response.content(), null, response.finishReason());
    }