search

carlrobertoh / llm-client

User-friendly Java HTTP client that provides access to large language model APIs and services
https://central.sonatype.com/artifact/ee.carlrobert/llm-client
MIT License
17 stars 26 forks source link

Error on receiving meta information from model #9

Open paintkeeper opened 7 months ago

paintkeeper commented 7 months ago

https://github.com/carlrobertoh/LLM-Client/blob/9e6fe09a719a42744a9c8e574180615aa624d4df/src/main/java/ee/carlrobert/llm/client/openai/completion/OpenAIChatCompletionEventSourceListener.java#L19

SSE can come with meta information, which has empty choices array. E.g.: data: {"id":"","object":"","created":0,"model":"","prompt_filter_results":[{"prompt_index":0,"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"self_harm":{"filtered":false,"severity":"safe"},"sexual":{"filtered":false,"severity":"safe"},"violence":{"filtered":false,"severity":"safe"}}}],"choices":[]}

reneleonhardt commented 4 months ago

Hello @paintkeeper can you confirm that the change https://github.com/carlrobertoh/llm-client/commit/3831d02c7ac0bd932dfad844605f3bd41d709d2b in 0.6.0 fixes that problem?