search

jitsi / skynet

AI core services for Jitsi
Apache License 2.0
23 stars 7 forks source link

failed to transcribe cuBLAS failed with status CUBLAS_STATUS_NOT_SUPPORTED #67

Open piperino11 opened 5 months ago

piperino11 commented 5 months ago

I tried on this system: Ubuntu 20

nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2022 NVIDIA Corporation Built on Wed_Sep_21_10:33:58_PDT_2022 Cuda compilation tools, release 11.8, V11.8.89 Build cuda_11.8.r11.8/compiler.31833905_0

Nvida H100

but I get this error:

skynet.modules.stt.streaming_whisper.state ERROR: Participant 9c428b99: failed to transcribe cuBLAS failed with status CUBLAS_STATUS_NOT_SUPPORTED.

rpurdel commented 5 months ago

Hi @piperino11,

It would look like you are using a VM. Try building a Docker image following the instructions here and run it as a container.

I think it's also worth mentioning that we did not test it on H100s. Can you send one over for testing :) ?

Facci sapere com'è andata.