deepseek-ai / DeepSeek-Coder-V2

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence
MIT License
2.16k stars 107 forks source link

Error: An unknown error was encountered while running the model #48

Open vishnunuk opened 1 month ago

vishnunuk commented 1 month ago

When generating a response, deepseek-coder-v2 randomly stops or quits with the following error:

Error: An unknown error was encountered while running the model.

I have tested different versions of deepseek-coder-v2 and the Ollama server, including both the Docker and desktop versions on Windows, macOS, and Linux. On all three platforms, I can reproduce this issue. No other models have shown this behavior.

ss when deepseek-coder-v2 randomly stops or quits when responding...

Screenshot 2024-09-17 at 9 17 30 PM
vishnunuk commented 1 month ago

https://github.com/ggerganov/llama.cpp/issues/8862