grimoire torch2trt_dynamic issues

grimoire / torch2trt_dynamic

A pytorch to tensorrt convert with dynamic shape support

MIT License

257 stars 34 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Is Amirstan_plugin now compulsory?

#39 albertodallolio opened 1 month ago
3
Import ERROR

#38 jg0014 opened 5 months ago
1
Is "inputs" used when quantizing to int8 with provided dataset?

#37 lebionick closed 6 months ago
8
Can it be uploaded/released to pypi.org?

#36 albertodallolio opened 7 months ago
1
Encountered known unsupported method torch.nn.functional.has_torch_function_variadic

#35 zhouchang413057247 opened 7 months ago
1
optimize topk

#34 grimoire closed 9 months ago
0
Refactor 2024

#33 grimoire closed 9 months ago
0
getPluginCreator could not find plugin RepeatDimsPluginDynamic version 1

#32 yantiantianlx opened 2 years ago
2
No module named 'torch2trt_dynamic.converters.identity'

#31 xuweidongkobe closed 2 years ago
2
WARNING: Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: (+ (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (+ (# 3 (SHAPE input_0)) -1) 2) 2) 2) 2) 2) 1) (+ (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (+ (# 2 (SHAPE input_0)) -1) 2) 2) 2) 2) 2) 1)

#30 LeoRainly opened 2 years ago
4
remove unused plugin

#29 grimoire closed 2 years ago
0
Consumes 25% of RAM

#28 sathisha-beltech opened 2 years ago
0
Error number of channels in input tensor to a convolution layer must not be dynamic

#27 Kracozebr opened 2 years ago
2
Consider adding support for DLA (Deep learning accelerator) modules

#26 tehkillerbee opened 3 years ago
3
ease type cast

#25 grimoire closed 3 years ago
0
how to add a converter for custom operateion written by c++

#24 deemoo-wang opened 3 years ago
1
Fix #22, TRT8 AttributeError: 'tensorrt.tensorrt.Builder' object has no attribute 'int8_calibrator'

#23 v-qjqs closed 3 years ago
0
TRT8 AttributeError: 'tensorrt.tensorrt.Builder' object has no attribute 'int8_calibrator'

#22 v-qjqs closed 3 years ago
0
Error Code 9: Internal Error ((Unnamed Layer* 3886) [ElementWise]: broadcast dimensions must be conformable )

#21 Tailwhip opened 3 years ago
3
add better repeat

#20 grimoire closed 3 years ago
0
No warnings, but [TensorRT] ERROR: INVALID_ARGUMENT: Cannot find binding of given name: input_0

#19 iAlexKai closed 3 years ago
16
Warning: Encountered known unsupported method torch.Tensor.__format__

#18 iAlexKai closed 3 years ago
4
Does int8 calibration DatasetCalibrator buffer support multiple inputs?

#17 0yueyunfei0 closed 3 years ago
2
RuntimeError: NVRTC error when convert model

#16 HHZ94 opened 3 years ago
5
Error, while converting fastrcnn torchvision model

#15 dimabendera opened 3 years ago
2
converted bart model is slower than the original one during inference time

#14 zangyuchen2008 opened 3 years ago
13
Hi, how to solve it with list output?

#13 lucasjinreal opened 3 years ago
2
set_calibration_profile not exist

#12 Chen-cyw opened 3 years ago
1
load libtorch2trt_dynamic.so error

#11 Chen-cyw opened 3 years ago
5
Max_error in Interpolate Plugin

#10 zhujiandream opened 4 years ago
2
Is it possible to disable dynamic_shape feature?

#9 111qqz closed 4 years ago
2
topk issue

#8 niaoyu closed 4 years ago
2
Why official torch2trt doesn't invoke any plugin, but this invoke too many plugins even with simple model

#7 lucasjinreal opened 4 years ago
4
is this library supposed to be compatible with original torch2trt library?

#6 gengshenghong closed 4 years ago
4
install error

#5 zkloveai opened 4 years ago
2
c++ inference

#4 lucasjinreal opened 4 years ago
7
fix interpolate dynamic input

#3 huliang2016 opened 4 years ago
1
Any idea on how to support ConvTranspose2d？

#2 huliang2016 closed 4 years ago
5
/libamirstan_plugin.so

#1 semchan opened 4 years ago
3