AlexsLemonade / refinebio

Refine.bio harmonizes petabytes of publicly available biological data into ready-to-use datasets for cancer researchers and AI/ML scientists.
https://www.refine.bio/
Other
128 stars 19 forks source link

Migrate affymetrix image to renv #3181

Closed arkid15r closed 1 year ago

arkid15r commented 1 year ago

Context

We're currently trying to pin R dependencies (#3170) to prevent them from breaking between deploys. At this moment I'm in the process of updating the workers. Currently I'm working on rebuilding the affymetrix image using the newrenv approach.

Problem or idea

The affymetrix image build process takes at least 8 hours and differs from other images a bit (see the install_ensg_pkgs.R script). The install_ensg_pkgs.R script may require a special approach as it uses custom packages. We need to figure out whether it's possible to use renv with an external repository or leave it as an extra step for docker image build.

Solution or next step

arkid15r commented 1 year ago

Implemented in https://github.com/AlexsLemonade/refinebio/pull/3167 and https://github.com/AlexsLemonade/refinebio/pull/3241