pytorch / TensorRT

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
https://pytorch.org/TensorRT
BSD 3-Clause "New" or "Revised" License
2.59k stars 350 forks source link

🐛 [Bug] select scatter decomposition device handling #3064

Open peri044 opened 3 months ago

peri044 commented 3 months ago

Bug Description

The input and src tensor can be on cpu but the index tensor is being casted to gpu:0 and this results in src and index tensor are on different devices issue. Cast it to the same device as input.

To Reproduce

Expected behavior

Environment

Build information about Torch-TensorRT can be found by turning on debug messages

Additional context

apbose commented 3 months ago

Thanks for pointing out the bug. Will look at this, this week