Closed narendasan closed 1 year ago
Seeing this issue with the latest main
File "/home/dperi/Downloads/env/lib/python3.8/site-packages/torch_tensorrt/_compile.py", line 125, in compile
return torch_tensorrt.ts.compile(
File "/home/dperi/Downloads/env/lib/python3.8/site-packages/torch_tensorrt/ts/_compiler.py", line 136, in compile
compiled_cpp_mod = _C.compile_graph(module._c, _parse_compile_spec(spec))
RuntimeError: required keyword attribute 'test_element' is undefined
I will try 1.3 branch
@narendasan Is this the error message you got ?
RuntimeError: [Error thrown at core/conversion/converters/impl/matrix_multiply.cpp:50] Expected selfDims.nbDims == 3 to be true but got false
Expected 3-dimensional tensor, but got -1-dimensional tensor for argument #1 'batch1' (while checking arguments for bmm)
DEBUG: [Torch-TensorRT TorchScript Conversion Context] - Freezing tensor 0x36d63b10 as an IConstantLayer
DEBUG: [Torch-TensorRT] - Output tensor shape: [8, -1]
INFO: [Torch-TensorRT TorchScript Conversion Context] - Adding Layer %115 : Tensor = aten::unsqueeze(%114, %11) # layer_norm.py:96:20 (ctx.AddLayer)
DEBUG: [Torch-TensorRT TorchScript Conversion Context] - Node input is an already converted tensor
DEBUG: [Torch-TensorRT TorchScript Conversion Context] - Node input is a result of a previously evaluated value
DEBUG: [Torch-TensorRT] - ITensor name: (Unnamed Layer* 199) [ElementWise]_output
DEBUG: [Torch-TensorRT] - ITensor shape: [8, -1]
DEBUG: [Torch-TensorRT] - ITensor type: Bool
ERROR: [Torch-TensorRT TorchScript Conversion Context] - 3: (Unnamed Layer* 200) [Shuffle]: has zero placeholder that refers to invalid axis 2.
DEBUG: [Torch-TensorRT] - Output tensor shape: []
Intermediate unsqueeze layer errors out. Probably a bug there. I will need to debug this.
This issue has not seen activity for 90 days, Remove stale label or comment or this will be closed in 10 days
Bug Description
Trying to run the following reproducer and hitting issues
To Reproduce
Expected behavior
This should be supported in at least the dynamic batch case
Environment
conda
,pip
,libtorch
, source):Additional context