zeitlings / ayai-gpt-nexus

OpenAI, Anthropic, and Gemini integrations with support for local LLMs
53 stars 1 forks source link

Cannot use openai compatible proxy #15

Open amadav opened 6 days ago

amadav commented 6 days ago

I have an internal proxy that is openai compatible. Seeing this issue:

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">

􀇾 [OpenAI>DecodingError>Stream:Proxy] Decoding failure for ChatStreamResponseOpenAI.Type.self. Key not found. Debug description: No value associated with key CodingKeys(stringValue: "object", intValue: nil) ("object"). \| Context coding path: [] --
zeitlings commented 6 days ago

Hi @amadav

I need more information. What is in an internal proxy? What is your setup? The fact that the response fails to decode suggests that it is not compatible.