pytorch / torcharrow

High performance model preprocessing library on PyTorch
https://pytorch.org/torcharrow/beta/index.html
BSD 3-Clause "New" or "Revised" License
642 stars 78 forks source link

Any plan to support GPU? #493

Open whbldhwj opened 1 year ago

whbldhwj commented 1 year ago

Hi,

This looks like a really interesting project! I saw currently torcharrow runs on CPU with the Velox backend. Just wondering any plan to offload some of the ops to GPU? If exists, what's the technical path? Any plan to reuse the cudf/rapids library?

Thanks, Jie

dracifer commented 1 year ago

Thanks @whbldhwj ! we do plan on supporting GPU. Current prototype is based on PyTorch itself. Would you mind sharing if have particular use cases that can benefit from GPU processing?