AlexsLemonade / refinebio

Refine.bio harmonizes petabytes of publicly available biological data into ready-to-use datasets for cancer researchers and AI/ML scientists.
https://www.refine.bio/
Other
129 stars 19 forks source link

Use self-hosted runners for disk space dependent jobs #3279

Closed arkid15r closed 1 year ago

arkid15r commented 1 year ago

Context

In order to restore staging/prod deploy process CI/CD tests need to be fixed.

Problem or idea

We have a few test jobs failing due to insufficient disk space:

Solution or next step

Add self-hosted runners support. Migrate the jobs to the larger runners.

arkid15r commented 1 year ago

The larger runners are in use for affymetrix/agilent tests only. In case of disk space issues w/ other images we should try jlumbroso/free-disk-space@main GH action first