AlexsLemonade / refinebio

Refine.bio harmonizes petabytes of publicly available biological data into ready-to-use datasets for cancer researchers and AI/ML scientists.
https://www.refine.bio/
Other
126 stars 19 forks source link

Optimize GHA deployment scripts #3300

Closed arkid15r closed 11 months ago

arkid15r commented 1 year ago

Context

The https://github.com/AlexsLemonade/refinebio/pull/3285, https://github.com/AlexsLemonade/refinebio/pull/3290 and https://github.com/AlexsLemonade/refinebio/pull/3299 going to provide efficient cross-environment build process and consistent test execution time.

Problem or idea

However, the scripts we use for staging/prod deployment are still sort of out-of-date in terms of build efficiency and cache usage.

Solution or next step

Update .github scripts to minimize code duplication (if any) and use optimized Docker image build approach.