-
为什么我在测试video的时候,不加--coco_transfer测试显示7fps, 加了--coco_transfer测试显示只有4fps, 我的显卡为P40,在测试的过程转换tensorrt是成功的,没报错。是不是我哪里搞的不对?
-
output = self.consensus(base_out)
File "/usr/local/lib/python3.6/dist-packages/torch/nn/modules/module.py", line 547, in __call__
result = self.forward(*input, **kwargs)
File "/home/lixi…
-
```
from torch2trt import torch2trt
import torch
bn = torch.nn.BatchNorm2d(2).cuda()
bn.eval()
x = torch.ones(1, 2, 3, 3).cuda()
# convert to TensorRT feeding sample data as input
bn.eval…
-
when i run model_trt = torch2trt(model, [x]):
[TensorRT] ERROR: (Unnamed Layer* 0) [Shuffle]: uninferred dimensions are not an exact divisor of input dimensions, so inferred dimension cannot be …
-
I have failed with this https://github.com/NVIDIA-AI-IOT/torch2trt.
thanks
![image](https://user-images.githubusercontent.com/58082063/86442934-b292ba00-bd38-11ea-8201-4f012a08d498.png)
-
## Description
my workflow:
pytorch small network -> pytorch to onnx -> onnx to tensorrt (engine generation failed)
## Environment
**TensorRT Version**: TensorRT 7.1.3
**GPU Type**: R…
twmht updated
3 years ago
-
Requirement has been build success:
- mmdet == 2.3.0
- https://github.com/grimoire/torch2trt_dynamic
- https://github.com/grimoire/amirstan_plugin --> libamirstan_plugin.so based on gcc7.1
t…
-
hi
how can I do to infer DL pretrained models with best performance?
Do you have tutorials on how to use for istance inception v4 with similar performance as in this benchmark repo?
thanks
-
I am working on deploy models in tx2
My model works fine on my desktop, with custom layer and batch support. take less than 40ms (vs pytorch 60ms+)
But when I use the engine builded on tx2, the mode…
-
I want to speed up the part of faster-rcnn-fpn, which is extractor of feature map. the feature map size is large. and I get the output of tensorrt which is mem_alloc object, but I need pytorch tensor …