THUDM / GLM-4-Voice

GLM-4-Voice | 端到端中英语音对话模型
Apache License 2.0
2.06k stars 162 forks source link

strange flash attention error #63

Open silvacarl2 opened 3 days ago

silvacarl2 commented 3 days ago

python web_demo.py --tokenizer-path THUDM/glm-4-voice-tokenizer --model-path THUDM/glm-4-voice-9b --flow-path ./glm-4-voice-decoder Traceback (most recent call last): File "/mnt/d/Dropbox/Developer-Tools/whisper/GLM-4-Voice/web_demo.py", line 10, in import torchaudio File "/home/silvacarl/.local/lib/python3.10/site-packages/torchaudio/init.py", line 2, in from . import _extension # noqa # usort: skip File "/home/silvacarl/.local/lib/python3.10/site-packages/torchaudio/_extension/init.py", line 38, in _load_lib("libtorchaudio") File "/home/silvacarl/.local/lib/python3.10/site-packages/torchaudio/_extension/utils.py", line 60, in _load_lib torch.ops.load_library(path) File "/home/silvacarl/.local/lib/python3.10/site-packages/torch/_ops.py", line 1350, in load_library ctypes.CDLL(path) File "/usr/lib/python3.10/ctypes/init.py", line 374, in init self._handle = _dlopen(self._name, mode) OSError: /home/silvacarl/.local/lib/python3.10/site-packages/torchaudio/lib/libtorchaudio.so: undefined symbol: _ZN3c1010Dispatcher17runRecordFunctionERN2at14RecordFunctionESt17reference_wrapperIKNS_14FunctionSchemaEENS_11DispatchKeyE

have not figured out how to resolve it.

zRzRzRzRzRzRzR commented 2 days ago

This is likely because your CUDA and Torch are not correctly bound