microsoft / nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
https://nni.readthedocs.io
MIT License
14k stars 1.81k forks source link

reload data make insufficient memory space #5722

Open HouJian2020 opened 9 months ago

HouJian2020 commented 9 months ago

I'm new to NNI. I learn that we have to load same data for every trail, if the data is very large, this framework is waste time and memory space, can’t execute trails by parallel.