search

icgc-argo / ega-file-transfer

0 stars 0 forks source link

Transfer ESAD-UK non-PCAWG WGS data #3

Closed hknahal closed 3 years ago

hknahal commented 3 years ago

EGA has confirmed staging of data is complete. Transfer 20TB of data (108 donors) to Collab (https://github.com/icgc-argo/ega-file-transfer/blob/master/ega_xml/v20200915/ESAD-UK/ESAD-UK_WGS_Audit_ICGC28.tsv). This is non-PCAWG WGS data.

hknahal commented 3 years ago

Running 216 jobs (108 donors)

VM: 10.0.0.13 Queue ID: d636a322-8d1d-46ec-830c-77cd8db09150

hknahal commented 3 years ago

Status as of Nov 3:

VM: 10.0.0.13 Completed: 104 Running: 3 Resume: 1 Queued: 48

Moved 60 queued jobs to different VM: VM: 10.1.0.6 Queue ID: e473fb3e-d288-4881-98b1-72192d40ca96 Queued: 58 Running: 2

hknahal commented 3 years ago

Collab was offline today, but back online now (Nov 6) Restarted JTracker and re-started jobs on both VMs. Currently running jobs.

VM: 10.0.0.13 Queue ID: d636a322-8d1d-46ec-830c-77cd8db09150 Completed: 137 Running: 3 Resume: 1 Queued: 14

VM: 10.1.0.6 Queue ID: e473fb3e-d288-4881-98b1-72192d40ca96 Completed: 15 Queued: 42 Running: 3

hknahal commented 3 years ago

All (215) jobs completed except for one failed job.

Details:

VM: 10.0.0.13 Queue ID: d636a322-8d1d-46ec-830c-77cd8db09150 Completed: 155 Failed: 1

VM: 10.1.0.6 Queue ID: e473fb3e-d288-4881-98b1-72192d40ca96 Completed: 60