Cache / persist S over each iteration

quinngroup / dr1dl-pyspark

Dictionary Learning in PySpark

Apache License 2.0

1 stars 1 forks source link

Cache / persist S over each iteration #64

Closed magsol closed 8 years ago

magsol commented 8 years ago

Not sure how we missed this before, but this is likely causing a huge bottleneck in processing. We are not caching S after each iteration; this is causing S to be recomputed from scratch.