ray-project / ray_lightning

Pytorch Lightning Distributed Accelerators using Ray
Apache License 2.0
211 stars 34 forks source link

Pytorch Lightning DataModule Support? #130

Open Hamptonjc opened 2 years ago

Hamptonjc commented 2 years ago

I've been trying to run a distributed setup with Ray Lightning however it seems the worker nodes aren't downloading the data via my data module's prepare_data() function. I have set the data module's hook "prepare_data_per_node" to True, but the issue persists. The documentation doesn't mention data modules, thus I am wondering if Ray Lightning supports them?