WinVector / replyr

Patches for using dplyr with Databases and Big Data
https://winvector.github.io/replyr/
Other
67 stars 12 forks source link

Feature: parameterize "materialize" op in replyr #7

Closed JohnMount closed 7 years ago

JohnMount commented 7 years ago

Right now replyr considers its materialization operator to be dplyr::compute(). For Sparklyr we need to look into both spaklyr::sdf_checkpoint() (a new op in the development version) and user-specified sparklyr::spark_write_parquet() plus sparklyr::spark_read_parquet().