-
I converted superpoint to ONNX format using your Python script and got .engine file running cpp script.
When I load .engine file on python, I only get 'scores' and 'descriptors'. How to get 'keypoint…
-
# Installation Guide
For those running into issues with installation, here’s a streamlined guide! This has been tested on the following container:
- **Container**: `runpod/pytorch:2.0.1-py3.10-cud…
-
Hi, I'm having an issue with tensorrt conversion of model which uses 3D convolutions and processes 5D input.
Code to reproduce error (I cut the model to minimal example):
```
import tensorflow as…
-
Code file name "clip_txt.py":
_MODELS = [
'RN50::openai',
'RN50::yfcc15m',
'RN50::cc12m',
'RN101::openai',
'RN101::yfcc15m',
'RN50x4::openai',
'ViT-B-32::openai',
…
gyd-a updated
3 weeks ago
-
## What
I am trying to export a model that contains `nn.InstanceNorm2d` (the call from the module can be found [here](https://github.com/princeton-vl/RAFT/blob/3fa0bb0a9c633ea0a9bb8a79c576b6785d4e6a0…
-
This issue is related to `tp.mean` and `tp.var` failures when implementing `BatchNorm` using **Tripy** for Resnet50 model.
```python
class TPBatchNorm(tp.Module):
def __init__(self, num_features,…
-
Hi! I have been using torch_tensorrt for speedup of pytorch models and have been loving it. But sometimes i face problems while conversion.
In this case, i was using segmentation-models-pytorch(sm…
-
### Model Name
mobilellm
### Model Source
facebook/MobileLLM-1B
### Model Cortexso HuggingFace Repo
https://huggingface.co/cortexso/mobilellm
### Model Description
- MobileLLM is introduced: "[…
-
## Environment
- **GPUs**: 4x NVIDIA A100 (80GB) (nvlink. azure Standard_NC96ads_A100_v4)
- **TensorRT-LLM Version**: 0.15.0.dev2024102200
- **Environment**: Docker container
- **Memory Usage per GPU…
-
@maudzung
Hi，Maudzung, nice work! I'm trying to use TensorRT to speed up the inference. Do you have some scripts that transfer the Complex-YOLOv4-Pytorch from pytorch(pth file) to TensorRT?
Thank…