search

pytorch / data

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.
BSD 3-Clause "New" or "Revised" License
1.13k stars 152 forks source link

Would TorchData provide GPU support for loading and preprocessing images? #761

Open songyuc opened 2 years ago

songyuc commented 2 years ago

🚀 The feature

Would TorchData provide GPU support for loading and preprocessing images?

Motivation, pitch

When I am learning PyTorch, I find, currently, it do not support using GPU to load images or any other transforms of preprocessing and encoding data. I want to know whether this would be taken into consideration into the design of TorchData.

Alternatives

Currently, NVIDIA-DALI is an impressive alternative for loading and preprocessing images with GPU.

Additional context

No response

msaroufim commented 2 years ago

Hi @songyuc this is something I'm working on and will keep you posted on plans

songyuc commented 2 years ago

Hi @songyuc this is something I'm working on and will keep you posted on plans

I am looking forward to your contribution sincerely🥳

Atharva-Phatak commented 2 years ago

@msaroufim I am interested to help you out if its possible. Seems pretty useful :). Let me know if I can do anything here.

songyuc commented 1 year ago

Just for discussion, would torch.cuda.Stream facilitate GPU data loading?

wenleix commented 1 year ago

cc @dracifer