search

NVIDIA-AI-IOT / torch2trt

An easy to use PyTorch to TensorRT converter
MIT License
4.58k stars 675 forks source link

Encountered known unsupported method torch.Tensor.add #578

Open yuchen2580 opened 3 years ago

yuchen2580 commented 3 years ago

Hi,

Facing this issue when use tensorrt 7.1.3 + pytorch 1.7.0 + torchvision 0.8.1 The network is a very simple MLP.

Warning: Encountered known unsupported method torch.Tensor.add
Warning: Encountered known unsupported method torch.Tensor.add
Warning: Encountered known unsupported method torch.Tensor.add
Warning: Encountered known unsupported method torch.Tensor.add
Warning: Encountered known unsupported method torch.Tensor.add
Warning: Encountered known unsupported method torch.Tensor.add
Warning: Encountered known unsupported method torch.Tensor.add
Warning: Encountered known unsupported method torch.Tensor.add
Warning: Encountered known unsupported method torch.norm
Warning: Encountered known unsupported method torch.Tensor.norm
Warning: Encountered known unsupported method torch.Tensor.div

Aren't these the base operations? Can somebody explain why I cannot use tensorrt to transfer the model?

jaybdub commented 3 years ago

Hi @yuchen2580,

Thanks for reaching out!

This is unusual, most of these ops are implemented.

Do you mind sharing the steps you took to convert the model?

Best, John

Chelovek760 commented 3 years ago

Hi! I have same error def forward(self, input: Tensor) -> Tensor: _0 = self.avgpool _1 = self.layer4 _2 = self.layer3 _3 = self.layer2 _4 = (self.layer1).forward((self.conv).forward(input, ), ) _5 = (_1).forward((_2).forward((_3).forward(_4, ), ), ) _6 = (_0).forward(_5, ) _7 = ops.prim.NumToTensor(torch.size(_6, 0)) input0 = torch.view(_6, [int(_7), -1]) _8 = torch.div(input0, torch.norm(input0, 2, [1], True)) return _8

zhLawliet commented 3 years ago

Warning: Encountered known unsupported method torch.Tensor.hash Warning: Encountered known unsupported method torch.Tensor.hash Warning: Encountered known unsupported method torch.Tensor.hash Warning: Encountered known unsupported method torch.Tensor.get_device Warning: Encountered known unsupported method torch.Tensor.cuda

FZfangzheng commented 3 years ago

Maybe x.add should be changed to torch.add

liuhao-97 commented 5 months ago

I set the model to eval() and solve this