Closed codingl2k1 closed 3 weeks ago
加載 deepseek-coder-33b-instruct 模型也會出現此錯誤,能否可以自己加選項 model.bfloat16()
This issue is stale because it has been open for 7 days with no activity.
This issue was closed because it has been inactive for 5 days since being marked as stale.
Describe the bug
A clear and concise description of what the bug is.
torch: 2.2.0 dev model: llama-2-chat 13b none platform: linux max_tokens: 4096
To Reproduce
To help us to reproduce this bug, please provide information below:
Expected behavior
A clear and concise description of what you expected to happen.
Additional context
Add any other context about the problem here.