AndrewC160 / ROMOPOmics

R package to parse datasets into SQLite-friendly tables
Other
4 stars 2 forks source link

Optimize expand_entry_columns() #4

Closed ngiangre closed 4 years ago

ngiangre commented 4 years ago

with the full TCGA data set it takes about 2 minutes to churn out the appropriate OMOP tables. If you have a chance to improve it I would be much obliged!

AndrewC160 commented 4 years ago

I've got a much simpler methods that doesn't use Reduce() or merge; runs in about 20 seconds on the full TCGA set now. Short version: for each separate observation, make a new table and rbind() them together, THEN pivot_wider().