intel-analytics / BigDL-Tutorials

Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL
208 stars 123 forks source link

Refactor dasta preprocessing #34

Open zhichao-li opened 6 years ago

zhichao-li commented 6 years ago

Sample should be construct just before the optimization and should not be used as the container for preprocessing.

jason-dai commented 6 years ago

Can you point out where the problematic codes are? I think the preferred approach is to use ndarray for data preprocessing?