issues
search
mila-iqia
/
cookiecutter-pyml
MIT License
19
stars
8
forks
source link
Multi-GPU friendly data processing.
#103
Open
marondeau-mila
opened
1 year ago
marondeau-mila
commented
1 year ago
Split the download and the loading.
In general, separated the processing into functions that can be called independently
For example, to create the split once, and reload it as needed.
Also tried to do some light refactoring to simplify customization.