-
### System Info
TRT-LLM version: 0.12.0.dev2024070900
### Who can help?
@ncomly-nvidia
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [X] An offic…
-
Do you have a recommended NGC container to run this in an Orin with Jetpack 5.x?
-
### System Info
-GPU Name: A100
### Who can help?
_No response_
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An officially supported task in …
-
### System Info
Tensorrt-LLM commit: 2a115dae84f13daaa54727534daa837c534eceb4
TensorRT-LLM version: 0.11.0.dev2024061800
### Who can help?
_No response_
### Information
- [X] The official exam…
-
### System Info
DGX V100 and DGX A100
### Who can help?
@ncomly-nvidia to add more folks.
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An of…
-
Is there any available container for me to run whisper_trt on a Jetson Xavier NX - Jetpack 5.1.2? If not, what path would you suggest me to pursue to be able to run whisper_trt on a Jetson Xavier NX? …
-
Traceback (most recent call last):
File "/code/tensorrt_llm/examples/whisper/run.py", line 336, in
model = WhisperTRTLLM(args.engine_dir, args.debug, args.assets_dir)
File "/code/tensorrt_…
-
the build script and build.py expect a .pt file
my checkpoint looks like:
root@28f5bb431151:/app# ls checkpoint-4000/
config.json model-00001-of-00002.safetensors model.safetensors…
-
I tried to run the latest (as of today) docker image:
`docker run --gpus all --shm-size 64G -p 8001:80 ghcr.io/collabora/whisperfusion:latest`
Im getting the error `OSError: /usr/local/lib/pytho…
-
Please support whisper medium and medium.en.