推理报错：CUDA error: an illegal memory access was encountered

gpt-omni / mini-omni

open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.

https://arxiv.org/abs/2408.16725

MIT License

3.06k stars 273 forks source link

推理报错：CUDA error: an illegal memory access was encountered #65

Closed yz53665 closed 1 month ago

yz53665 commented 1 month ago

20240911-175445

python: 3.10.14 cuda: 12.2（11.6也试过，一样的问题） GPU：A800-SXM4-80GB

其它python第三方库参考教程使用pip install -r requirement.txt安装

mini-omni commented 1 month ago

我使用的cuda版本是12.2，测试显卡是3090 可以参考下这个呢？是因为OOM么？

mini-omni commented 1 month ago

I will close it for now, please feel free to re-open.