[Question]: Is this normal - Using GPT-4-0619 fails to work with an error about including special token "<|endoftext|>"?

danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.

https://librechat.ai/

MIT License

18.58k stars 3.13k forks source link

[Question]: Is this normal - Using GPT-4-0619 fails to work with an error about including special token "<|endoftext|>"? #1821

Closed groovybits closed 8 months ago

groovybits commented 8 months ago

What is your question?

Using GPT-4-0619 fails to work with an error about including special token "<|endoftext|>"?

More Details

LibreChatGPT | 2024-02-17 06:21:04 error: [handleAbortError] AI response error; aborting request: The text contains a special token that is not allowed: <|endoftext|>

What is the main subject of your question?

No response

Screenshots

Code of Conduct

[X] I agree to follow this project's Code of Conduct

groovybits commented 8 months ago

Also it is creeping into the 3.5 16k context model, worked for 2 questions then this appeared for it??? Weird, where does that come from?

groovybits commented 8 months ago

Hmmm seems my input has that :D wow, how odd. Sounds like some jailbreak thing they blocked that is used in code from Rust Candle LLM errors, didn't realize it was in that output, sorry!