Latest OpenAI models don't support system prompts

rksm / org-ai

Emacs as your personal AI assistant. Use LLMs such as ChatGPT or LLaMA for text generation or DALL-E and Stable Diffusion for image generation. Also supports speech input / output.

GNU General Public License v3.0

686 stars 55 forks source link

Latest OpenAI models don't support system prompts #130

Closed dangirsh closed 4 weeks ago

dangirsh commented 2 months ago

Using o1-mini or o1-preview fails with:

Error from the service API:

Unsupported value: 'messages[0].role' does not support 'system' with this model.

dangirsh commented 2 months ago

Ah, they don't yet support streaming...

rksm commented 4 weeks ago

Yeah, we can switch to non-streamed responses instead.