search

Kaggle / docker-python

Kaggle Python docker image
Apache License 2.0
2.47k stars 954 forks source link

Torch Tensor RT 1.3.0 #1210

Closed MPWARE-TEAM closed 6 months ago

MPWARE-TEAM commented 1 year ago

New feature

Torch Tensor RT 1.3.0 It requires:

It looks like it's not so easy as I've noticed some issues with code under torch_tensorrt/fx package when importing torch_tensorrt

Sources:

Motivation

Allow compilation and execution of (most) models as Torch script much faster than regular inference. Useful for "Code" competitions.

SohierDane commented 1 year ago

Context on the speedups that competitors are realizing by installing the tensorrt from wheels: https://www.kaggle.com/competitions/rsna-breast-cancer-detection/discussion/375881

djherbis commented 1 year ago

I think that CUDA requirement is a dealbreaker for putting it in the image @SohierDane #1182 is the closest we've gotten to a CUDA upgrade (we rely on the DLVM base image upgrades happening first) and that's still only getting us to CUDA 11.3.

I think this is a case where it's best if users manually install this since it will break other things in the image, but they don't have to care about that since they know which packages they need to work.