yanboliang / spark-vlbfgs

Vector-free L-BFGS implementation for Spark MLlib
Apache License 2.0
46 stars 17 forks source link

Improve VLBFGS VOWLQN checkpoint #32

Closed WeichenXu123 closed 7 years ago

WeichenXu123 commented 7 years ago

Improve VLBFGS VOWLQN checkpoint, set checkpoint before job run on RDD (the previous solution is generate a pseudo RDD `rdd.map(x => x) to set checkpoint), improve effieciency.