Greetings, thank you for your work.
After successful running the nvidia default variant, I tried to run the TensorRT variant (default-nvidia-tensorrtllm). But it does not start.
No modifications to the image/s or compose file (except for changing the variant).
The older image versions (<1.14) do work as expected.
System:
memory: 64GiB System Memory
processor: 13th Gen Intel(R) Core(TM) i5-13500
display: AD104GL [RTX 4000 SFF Ada Generation]
Greetings, thank you for your work. After successful running the nvidia default variant, I tried to run the TensorRT variant (
default-nvidia-tensorrtllm
). But it does not start. No modifications to the image/s or compose file (except for changing the variant). The older image versions (<1.14) do work as expected.System: memory: 64GiB System Memory processor: 13th Gen Intel(R) Core(TM) i5-13500 display: AD104GL [RTX 4000 SFF Ada Generation]