Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
The fit() function of gluon.estimator only supports input from gluon.DataLoader. One limitation of gluon.DataLoader is that it accesses training data with index. Therefore, it is impractical to train the estimator on continuous data stream.
It will be great if the fit() function can support inputs from any iterable object instead of gluon.DataLoader and modify the following check.
if not isinstance(train_data, DataLoader):
raise ValueError("Estimator only support input as Gluon DataLoader. Alternatively, you "
"can transform your DataIter or any NDArray into Gluon DataLoader. "
"Refer to gluon.data.dataloader")
Description
The
fit()
function ofgluon.estimator
only supports input fromgluon.DataLoader
. One limitation ofgluon.DataLoader
is that it accesses training data with index. Therefore, it is impractical to train theestimator
on continuous data stream.It will be great if the
fit()
function can support inputs from anyiterable
object instead ofgluon.DataLoader
and modify the following check.References