search

ebi-ait / hca-ebi-dev-team

Repository for hca ebi dev team agile management. See zenhub board
0 stars 0 forks source link

Create script to trigger file archiver jobs in parallel #159

Open aaclan-ebi opened 4 years ago

aaclan-ebi commented 4 years ago

As a user I want to be able to run the file archiver in parallel automatically, so that the conversions happens quicker.

Investigation of File Archiver deployment is being tracked in ticket #104

While waiting for the completion of that the file archiving will be a manual process. The goal of this ticket is to simplify that process by creating a script to trigger file archiver jobs in EBI cluster. The script will read the file upload plan that will be downloaded by the user from the archiver service.

Check if @ESapenaVentura has a script that can be used.

aaclan-ebi commented 4 years ago

Improve the current process: https://docs.google.com/document/d/1S4fyCSqB3nLrCUssNMwSp6ff8tmeipMi_slnXW2Lrq4/edit#heading=h.so4e90sf86mv