alesaccoia / VoiceStreamAI

Near-Realtime audio transcription using self-hosted Whisper and WebSocket in Python/JS
MIT License
736 stars 106 forks source link

Docker container error: Could not load library libcudnn_ops_infer.so.8 #17

Closed jinmiaoluo closed 6 months ago

jinmiaoluo commented 6 months ago

The error message is as follows:

Client 583ffd78-2bfe-4e1e-bbbc-8efed00e1904 connected
2024-05-20T08:38:53.837582891Z Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory
jinmiaoluo commented 6 months ago

The NVIDIA CUDA® Deep Neural Network library (cuDNN) is included in runtime docker image.

Overview of NVIDA Docker images

jinmiaoluo commented 5 months ago

If someone encounters the above issue in a local development environment (without using Docker), you can refer to this issue:

https://github.com/SYSTRAN/faster-whisper/issues/516

I am using a venv-based virtual environment locally, so I add the following environment variable when starting:

# Replace <path-to-repo> with the actual path
LD_LIBRARY_PATH=<path-to-repo>/.venv/lib64/python3.10/site-packages/nvidia/cudnn/lib/