-
### System Info
I am trying to convert Dora adapters that was trained use hugging face peft, however I have got stuck when I encounter layer "encoder.layers.9.self_attn.v_proj.lora_magnitude_vector".…
-
At the first I convert whisper-tiny to onnx via optimum-cli
`optimum-cli export onnx --model openai/whisper-tiny --task automatic-speech-recognition-with-past whisper-tiny-onnx`
I got the some con…
-
### System Info
A10
tensorrt-cu12-10.2.0.post1
tensorrt-cu12-bindings-10.2.0.post1
tensorrt-cu12-libs-10.2.0.post1
tensorrt_llm-0.12.0.dev2024072300
python==3.10
### Who can help?
@Tracin
…
-
I ran code below using WSL ubuntu in windows:
```
docker run -p 9090:9090 --runtime=nvidia --gpus all --entrypoint /bin/bash -it ghcr.io/collabora/whisperlive-tensorrt
# Build tiny.en engine
bas…
-
### System Info
colab T4
### Who can help?
@
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [X] An officially supported task in the `examples` fold…
-
(Please use the mailing list for support requests and general discussion. This is only for actual bugs.)
**Describe the bug**
I have installed the portaudio on my centos 7 server with the followin…
-
### System Info
just a simple python bug, system agnostic
### Who can help?
@byshiue
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [X] An officia…
-
### System Info
* GPU V100, A100
* docker image `nvidia/cuda:12.1.0-devel-ubuntu22.04`
* tensorrt-llm `0.9.0.dev2024020600`
### Who can help?
@byshiue
### Information
- [X] The offici…
-
### System Info
- CPU: x86_64
- CPU memory size: 96GB
- GPU: A100
- Tensorrt tag: latest one(https://github.com/NVIDIA/TensorRT-LLM/commit/5d8ca2faf74c494f220c8f71130340b513eea9a9)
- TensorRT v…
-
Hello,
I have pretrained a model with huggingface and attempted to deploy it using the TRTLLM-Triton Server method as documented [here](https://github.com/k2-fsa/sherpa/blob/master/triton/whisper/mod…