Out of memory when decompressing the data package

nginyc / rafiki

Rafiki is a distributed system that supports training and deployment of machine learning models using AutoML, built with ease-of-use in mind.

Apache License 2.0

36 stars 23 forks source link

Open nudles opened 5 years ago

nudles commented 5 years ago

When the data file (zip) is large, there could be out-of-memory issue during the decompressing process.

nudles commented 5 years ago

Can we support uploading a directory? Then we do not need to do compression and decompression.