-
When following the docs for Whisper-TensorRT to [build the engine](https://github.com/collabora/WhisperLive/blob/main/TensorRT_whisper.md#whisper-tensorrt-engine), I am running into the error below wh…
-
Can I select the speficied Whisper version to deploy on the tensorRT docker?
-
Hello,
I'm wondering if you tested to provide an "initial prompt" with whisper v3 to inform the model of specific vocab for the transcription task ?
It's written that we can follow this kind of te…
-
# ComfyUI Error Report
## Error Details
- **Node Type:** UpscalerTensorrt
- **Exception Type:** polygraphy.exception.exception.PolygraphyException
- **Exception Message:** Could not deserialize …
-
Hi, I've encountered an error when using tensorRT-LLM as backend. Here're my steps.
First I installed latest whisperS2T using `pip install -U git+https://github.com/shashikg/WhisperS2T.git` in an exi…
-
**Which OS are you using?**
- OS: [e.g. iOS or Windows.. If you are using Google Colab, just Colab.]
Google Colab
2024-06-07 09:48:55.286611: E external/local_xla/xla/stream_executor/cuda/cuda_dnn…
-
here is my nvidia-smi result
`python -c "import torch; import tensorrt; import tensorrt_llm"` working well
When a client is connected server is getting core dumped related to libcudnn_cnn_infe…
-
I followed the instructions from the README and the docker image built fine.
However, when I ran it, the WhisperFusion process fails (which makes the webapp not work).
The problem is unfortunate…
-
### 🐛 Describe the bug
```
(venv) home@daniel-tablet1:~/PycharmProjects/pytorch$ USE_GLOO=0 USE_VULKAN=1 USE_VULKAN_SHADERC_RUNTIME=1 USE_VULKAN_WRAPPER=0 CFLAGS='-Wno-error=maybe-uninitialized -W…
-
i run the docker `ghcr.io/collabora/whisperbot-base:latest` and run the server , but when i send the request by client , i faced
client:.
```
[INFO]: * recording
setting
[INFO]: Waiting for ser…