search

Clay-foundation / model

The Clay Foundation Model (in development)
https://clay-foundation.github.io/model/
Apache License 2.0
347 stars 44 forks source link

Automate progressive image resizing #237

Closed yellowcap closed 3 months ago

yellowcap commented 5 months ago

To train the multi size images architecture, we need to either stop/restart the model every ~10 epochs, changing progressively the image size in the data loader.

Preferrably we would implement a pytorch hook to make this change automatically.

yellowcap commented 3 months ago

Good idea but not on the roadmap for now.

srmsoumya commented 3 months ago

Note: While doing multinode with slurm, we have to adjust num_tasks, num_workers while changing the chip_size, this was not trivial to implement, will skip this for now.