Open OliverWalter opened 4 months ago
I am facing the same issues, any solutions for this?
What GPU do you have?
I tested on an Nvidia A100/80GB with compute capability 3.9.
Marcus Edel @.***> schrieb am Mo., 19. Feb. 2024, 13:36:
What GPU do you have?
— Reply to this email directly, view it on GitHub https://github.com/collabora/WhisperFusion/issues/40#issuecomment-1952362300, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEBMNPKZ4Q74GQST7ESDYIDYUNBM7AVCNFSM6AAAAABDL3WK4KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJSGM3DEMZQGA . You are receiving this because you authored the thread.Message ID: @.***>
Nvidia L4/24GB, on GCP
Thanks, we are able to reproduce the issue. We have to update how we build TensorRT, to support not only 3090 and 4090, we are going to push a solution over the next two days.
I tried to run the latest (as of today) docker image:
docker run --gpus all --shm-size 64G -p 8001:80 ghcr.io/collabora/whisperfusion:latest
Im getting the error
OSError: /usr/local/lib/python3.10/dist-packages/tensorrt_llm/libs/libth_common.so: undefined symbol: _ZN3c1017RegisterOperatorsD1Ev
. See below for details.I'm using the following Version: