carlrobertoh / CodeGPT

The leading open-source AI copilot for JetBrains. Connect to any model in any environment, and customize your coding experience in any way you like.
https://codegpt.ee
Apache License 2.0
1.1k stars 231 forks source link

Use Custom OpenAI Provider and set stream to false got "Unknown API response" #736

Closed gameraroma closed 6 days ago

gameraroma commented 1 month ago

What happened?

Hi, I've set as this below image

but I've got this error image

It should be compatible with this schema as example json below,

{ "id": "cmpl-q3z01d5bueffqs7nmnpum", "object": "text_completion", "created": 1728997876, "model": "meta-llama/Llama-3.2-3B-Instruct/Llama-3.2-3B-Instruct-Q8_0.gguf", "choices": [ { "index": 0, "text": "", "logprobs": null, "finish_reason": "stop" } ], "usage": { "prompt_tokens": 150, "completion_tokens": 0, "total_tokens": 150 } }

Relevant log output or stack trace

No response

Steps to reproduce

No response

CodeGPT version

2.11.5-241.1

Operating System

macOS

linpan commented 1 month ago

yes, use ollama okay .

carlrobertoh commented 6 days ago

Unfortunately, code completion does not work with non-streaming requests (yet).