OHDSI / PatientLevelPrediction

An R package for performing patient level prediction in an observational database in the OMOP Common Data Model.
https://ohdsi.github.io/PatientLevelPrediction
188 stars 89 forks source link

Spark Support #149

Open jkylearmstrong opened 5 years ago

jkylearmstrong commented 5 years ago

Request to add spark support.

jreps commented 5 years ago

Hi,

I tested integrating Spark a couple of years ago and found that the overhead to set up the parallelization wasn't worth it with the data size I was using. Do you currently find the runPLP to be slow? I can probably find the old code and add it back if you are have having performance issues.

Best wishes, Jenna