PNNL-CompBio / coderdata

Automation scripts and benchmark dataset package for cancer drug prediction deep learning models.
Other
11 stars 3 forks source link

Update local build script for efficiency and upload #155

Closed sgosline closed 5 months ago

sgosline commented 7 months ago

Current local build script is slow, and doesn't upload data to figshare. I'd like to add the following modifications:

1- multithread the docker, omics, and experiment sections, as these can be run in parallel 2- add in an --upload argument that takes the files processed and uploads them to figshare 3- add in schema checking to build file before upload