search

libffcv / ffcv

FFCV: Fast Forward Computer Vision (and other ML workloads!)
https://ffcv.io
Apache License 2.0
2.8k stars 180 forks source link

Add writer.from_iterable_dataset for writing IterableDatasets to .beton #224

Closed ericjang closed 2 months ago

ericjang commented 2 years ago

The current normalizer transform when operating on GPU tensors uses cupy, which assumes device=0 unless otherwise stated. This results in a bug where trying to run ffcv pipelines with Normalize on any other gpu causes an error to be raised claiming that the tensors are on different devices.

hmgxr128 commented 1 year ago

Has it been fixed? I also encountered this bug today