Closed WeichenXu123 closed 7 years ago
Unpersist useless coeffs DV and grads DV generated by VLineSearchDiffFunction in the next iteration, avoid memory leak.
VLineSearchDiffFunction
Persist the result of VectorFreeLBFGS.takeStep, avoid re-compute the coeffs DV in each iteration.
VectorFreeLBFGS.takeStep
Add RosenbrockExample, usage:
mvn clean package -DskipTests # it will generate `spark-vlbfgs-1.0-SNAPSHOT.jar` in target directory. spark-submit --master yarn --num-executors 3 --executor-cores 2 --class org.apache.spark.ml.example.RosenbrockExample /path/to/spark-vlbfgs-1.0-SNAPSHOT.jar
and open UI URL: http://driverhost:8899 to check running status.
Move RealDataSuite into example as VLORRealDataExample.
RealDataSuite
VLORRealDataExample
Several minor updates in testcases.
Unpersist useless coeffs DV and grads DV generated by
VLineSearchDiffFunction
in the next iteration, avoid memory leak.Persist the result of
VectorFreeLBFGS.takeStep
, avoid re-compute the coeffs DV in each iteration.Add RosenbrockExample, usage:
and open UI URL: http://driverhost:8899 to check running status.
Move
RealDataSuite
into example asVLORRealDataExample
.Several minor updates in testcases.