danzafar / tidyspark

tidyspark: a tidyverse implementation of SparkR built for simplicity, elegance, and ease of use.
Other
22 stars 0 forks source link

Implement caching and persisting for `spark_tbl` #53

Closed danzafar closed 4 years ago

danzafar commented 4 years ago

This one could be a little tricky. A "child" dataframe of an operation needs to inherit the caching, so may require changes across the code base. Will need to review how SparkR handles this.

will implement two functions: