-
hellow, I failed to covert trt-llm Llama3.2 3B when I tried to run convert_checkpoint.py.
(like this link - https://github.com/NVIDIA/TensorRT-LLM/issues/2339)
I want to know if Llama3.2 3B model con…
-
I solved the issue for Windows. First, download Visual Studio 2022 with the following configuration.
 and [discussions](https://github.com/ultralytics/ultralytics/discussi…
-
Hello everyone,
we have recently set up a rootless docker instance alongside our existing docker on one of our servers, but ran into issues mounting host GPUs into the rootless containers. A workar…
-
Since jetson supports triton inference server, I am considering applying it.
So, I have a few questions.
1. In an environment where multiple AI models are run in Jetson, is there any advantage to …
-
### Your current environment
The output of `python collect_env.py`
```text
Model name: Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz
CPU family: 6
Mo…
-
# Docker Build File
**Plan**: Base docker build file on nvidia/cuda image, copy source code of project, define docker volumes, ...
## To Do:
- [x] run cctest: `run_training.py`
- [x] ins…
hrhee updated
2 years ago
-
When starting python app.py I get this error:
NameError: name 'is_torch_npu_available' is not defined. Did you mean: 'is_torch_xla_available'?