-
I converted superpoint to ONNX format using your Python script and got .engine file running cpp script.
When I load .engine file on python, I only get 'scores' and 'descriptors'. How to get 'keypoint…
-
I am attempting to convert the pretrained weights of the KeepTrack model to TensorRT for inference. As I am new to TensorRT and ONNX, I would greatly appreciate any guidance or suggestions on how to s…
-
## Bug Description
In [the CI tests](https://github.com/pytorch/TensorRT/actions/runs/11191996718/job/31115878141?pr=3167), all tests of cumsum was failed on CUDA 11.8 and 12.1, but works on 12.4.…
-
# Installation Guide
For those running into issues with installation, here’s a streamlined guide! This has been tested on the following container:
- **Container**: `runpod/pytorch:2.0.1-py3.10-cud…
-
Hi! I have been using torch_tensorrt for speedup of pytorch models and have been loving it. But sometimes i face problems while conversion.
In this case, i was using segmentation-models-pytorch(sm…
-
hellow, I failed to covert trt-llm Llama3.2 3B when I tried to run convert_checkpoint.py.
(like this link - https://github.com/NVIDIA/TensorRT-LLM/issues/2339)
I want to know if Llama3.2 3B model con…
-
## Bug Description
when I use dynamic shape in trt, will raise error,
```
ERROR:torch_tensorrt [TensorRT Conversion Context]:ITensor::getDimensions: Error Code 4: Internal Error (Tensor [SLICE…
-
## Bug Description
it report _to_copy is not supported, when we use things like `x.to(torch.uint8)`
```
torch_tensorrt.dynamo.conversion._TRTInterpreter.UnsupportedOperatorException: Conversion …
-
Code file name "clip_txt.py":
_MODELS = [
'RN50::openai',
'RN50::yfcc15m',
'RN50::cc12m',
'RN101::openai',
'RN101::yfcc15m',
'RN50x4::openai',
'ViT-B-32::openai',
…
gyd-a updated
1 month ago
-
### Model Name
mobilellm
### Model Source
facebook/MobileLLM-1B
### Model Cortexso HuggingFace Repo
https://huggingface.co/cortexso/mobilellm
### Model Description
- MobileLLM is introduced: "[…