search

danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.
https://librechat.ai/
MIT License
19.02k stars 3.16k forks source link

Enhancement: support o1-preview, o1-mini #4018

Closed PiDanShouRouZhouXD closed 2 months ago

PiDanShouRouZhouXD commented 2 months ago

What features would you like to see added?

support OpenAI o1-preview, o1-mini

More details

The o1-preview and o1-mini do not support streaming output and system prompts, therefore they cannot be used.

Which components are impacted by your request?

General

Pictures

No response

Code of Conduct

danny-avila commented 2 months ago

Should be supported shortly

danny-avila commented 2 months ago

Wrapping up, doing final testing

https://github.com/danny-avila/LibreChat/pull/4019

danny-avila commented 2 months ago

Just a heads up, need to update .env OPENAI_MODELS, the OpenAI models API request is not including it right now

OPENAI_MODELS=o1-preview,o1-mini,gpt-4o #, ...rest
rhiever commented 1 month ago

Hi @danny-avila, I updated my librechat to 0.7.5-rc2 and added the o1-preview and o1-mini models to the openai models list as you suggested. When I try to use either of the o1 models in my librechat, I get the following error. The API key I’m using is with a tier 5 org. Any ideas how to debug?

Something went wrong. Here's the specific error message we encountered: Failed to send message. HTTP 404 - { "error": { "message": "This is a chat model and not supported in the v1/completions endpoint. Did you mean to use v1/chat/completions?", "type": "invalid_request_error", "param": "model", "code": null } }

fuegovic commented 1 month ago

@rhiever it's not part of -rc2. You need to update to librechat-dev:latest to enable it

PedroGruvhagen commented 1 month ago

@fuegovic how do I go back from rc2 to latest? Sorry if the question is dumb 😩

fuegovic commented 1 month ago

@fuegovic how do I go back from rc2 to latest? Sorry if the question is dumb 😩

The default is "-dev:latest" and will currently show as rc2 in the UI. Look at the docker override file, this is where you would've made the change