search

ebi-ait / dcp-ingest-central

Central point of access for the Ingestion Service of the HCA DCP
Apache License 2.0
0 stars 0 forks source link

Issue with downloading files from hca-util-upload area #564

Open Wkt8 opened 2 years ago

Wkt8 commented 2 years ago

Description of the task:

Attempting to move files from the hca-util-upload-area 4777804d-1b93-4bbf-955f-1c5083e2c504 to a specific ftp location: lftp ftp-private-2.ebi.ac.uk/kwkrk75w-3u4pe7e6pe9mc/ 

I am attempting to do this via moving specific files from the hca-util upload area to the data/wteh/ folder in the EC2, and then moving from the data/wteh/ folder to the ftp location.

The issue here is with moving from the hca-util upload area to the data/wteh/ folder.

hca-util download -f 5478STDY7698210_S1_L001_I1_001.fastq.gz 5478STDY7698210_S1_L001_R1_001.fastq.gz 5478STDY7698210_S1_L001_R2_001.fastq.gz 5698STDY7839908_S1_L001_I1_001.fastq.gz 5698STDY7839908_S1_L001_R1_001.fastq.gz 5698STDY7839908_S1_L001_R2_001.fastq.gz 5698STDY7839910_S1_L001_I1_001.fastq.gz 5698STDY7839910_S1_L001_R1_001.fastq.gz 5698STDY7839910_S1_L001_R2_001.fastq.gz 5698STDY7839918_S1_L001_I1_001.fastq.gz 5698STDY7839918_S1_L001_R1_001.fastq.gz 5698STDY7839918_S1_L001_R2_001.fastq.gz 5891STDY8062349_S1_L001_I1_001.fastq.gz 5891STDY8062349_S1_L001_R1_001.fastq.gz 5891STDY8062349_S1_L001_R2_001.fastq.gz 5891STDY8062350_S1_L001_I1_001.fastq.gz 5891STDY8062350_S1_L001_R1_001.fastq.gz 5891STDY8062350_S1_L001_R2_001.fastq.gz 5891STDY8062351_S1_L001_I1_001.fastq.gz 5891STDY8062351_S1_L001_R1_001.fastq.gz 5891STDY8062351_S1_L001_R2_001.fastq.gz 5891STDY8062352_S1_L001_I1_001.fastq.gz 5891STDY8062352_S1_L001_R1_001.fastq.gz 5891STDY8062352_S1_L001_R2_001.fastq.gz 5891STDY8062353_S1_L001_I1_001.fastq.gz 5891STDY8062353_S1_L001_R1_001.fastq.gz 5891STDY8062353_S1_L001_R2_001.fastq.gz 5891STDY8062354_S1_L001_I1_001.fastq.gz 5891STDY8062354_S1_L001_R1_001.fastq.gz 5891STDY8062354_S1_L001_R2_001.fastq.gz 5891STDY8062355_S1_L001_I1_001.fastq.gz 5891STDY8062355_S1_L001_R1_001.fastq.gz 5891STDY8062355_S1_L001_R2_001.fastq.gz 5891STDY8062356_S1_L001_I1_001.fastq.gz 5891STDY8062356_S1_L001_R1_001.fastq.gz 5891STDY8062356_S1_L001_R2_001.fastq.gz WSSS8011222_S1_L001_I1_001.fastq.gz WSSS8011222_S1_L001_R1_001.fastq.gz WSSS8011222_S1_L001_R2_001.fastq.gz WSSS8012016_S1_L001_I1_001.fastq.gz WSSS8012016_S1_L001_R1_001.fastq.gz WSSS8012016_S1_L001_R2_001.fastq.gz 5891STDY9030806_S1_L001_I1_001.fastq.gz 5891STDY9030806_S1_L001_R1_001.fastq.gz 5891STDY9030806_S1_L001_R2_001.fastq.gz 5891STDY9030807_S1_L001_I1_001.fastq.gz 5891STDY9030807_S1_L001_R1_001.fastq.gz 5891STDY9030807_S1_L001_R2_001.fastq.gz 5891STDY9030808_S1_L001_I1_001.fastq.gz 5891STDY9030808_S1_L001_R1_001.fastq.gz 5891STDY9030808_S1_L001_R2_001.fastq.gz 5891STDY9030809_S1_L001_I1_001.fastq.gz 5891STDY9030809_S1_L001_R1_001.fastq.gz 5891STDY9030809_S1_L001_R2_001.fastq.gz 5891STDY9030810_S1_L001_I1_001.fastq.gz 5891STDY9030810_S1_L001_R1_001.fastq.gz 5891STDY9030810_S1_L001_R2_001.fastq.gz SIGAA10_S1_L001_I1_001.fastq.gz SIGAA10_S1_L001_R1_001.fastq.gz SIGAA10_S1_L001_R2_001.fastq.gz SIGAB10_S1_L001_I1_001.fastq.gz SIGAB10_S1_L001_R1_001.fastq.gz SIGAB10_S1_L001_R2_001.fastq.gz SIGAC10_S1_L001_I1_001.fastq.gz SIGAC10_S1_L001_R1_001.fastq.gz SIGAC10_S1_L001_R2_001.fastq.gz SIGAE6_S1_L001_I1_001.fastq.gz SIGAE6_S1_L001_R1_001.fastq.gz SIGAE6_S1_L001_R2_001.fastq.gz SIGAG12_S1_L001_I1_001.fastq.gz SIGAG12_S1_L001_R1_001.fastq.gz SIGAG12_S1_L001_R2_001.fastq.gz SIGAG6_S1_L001_I1_001.fastq.gz SIGAG6_S1_L001_R1_001.fastq.gz SIGAG6_S1_L001_R2_001.fastq.gz SIGAH10_S1_L001_I1_001.fastq.gz SIGAH10_S1_L001_R1_001.fastq.gz SIGAH10_S1_L001_R2_001.fastq.gz SIGAH12_S1_L001_I1_001.fastq.gz SIGAH12_S1_L001_R1_001.fastq.gz SIGAH12_S1_L001_R2_001.fastq.gz SIGAH4_S1_L001_I1_001.fastq.gz SIGAH4_S1_L001_R1_001.fastq.gz SIGAH4_S1_L001_R2_001.fastq.gz SLX-15847.SIGAF6_S1_L001_I1_001.fastq.gz SLX-15847.SIGAF6_S1_L001_R1_001.fastq.gz SLX-15847.SIGAF6_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713176_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713176_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713176_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713177_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713177_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713177_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713178_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713178_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713178_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713179_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713179_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713179_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713180_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713180_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713180_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713181_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713181_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713181_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713184_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713184_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713184_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713185_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713185_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713185_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713186_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713186_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713186_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713187_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713187_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713187_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713188_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713188_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713188_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713189_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713189_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713189_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713190_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713190_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713190_S1_L001_R2_001.fastq.gz WSSS_F_LNG8713191_S1_L001_I1_001.fastq.gz WSSS_F_LNG8713191_S1_L001_R1_001.fastq.gz WSSS_F_LNG8713191_S1_L001_R2_001.fastq.gz 5891STDY8062333_S1_L001_I1_001.fastq.gz 5891STDY8062333_S1_L001_R1_001.fastq.gz 5891STDY8062333_S1_L001_R2_001.fastq.gz 5891STDY8062334_S1_L001_I1_001.fastq.gz 5891STDY8062334_S1_L001_R1_001.fastq.gz 5891STDY8062334_S1_L001_R2_001.fastq.gz 5891STDY8062335_S1_L001_I1_001.fastq.gz 5891STDY8062335_S1_L001_R1_001.fastq.gz 5891STDY8062335_S1_L001_R2_001.fastq.gz 5891STDY8062336_S1_L001_I1_001.fastq.gz 5891STDY8062336_S1_L001_R1_001.fastq.gz 5891STDY8062336_S1_L001_R2_001.fastq.gz 5891STDY8062337_S1_L001_I1_001.fastq.gz 5891STDY8062337_S1_L001_R1_001.fastq.gz 5891STDY8062337_S1_L001_R2_001.fastq.gz 5891STDY8062338_S1_L001_I1_001.fastq.gz 5891STDY8062338_S1_L001_R1_001.fastq.gz 5891STDY8062338_S1_L001_R2_001.fastq.gz 5891STDY8062339_S1_L001_I1_001.fastq.gz 5891STDY8062339_S1_L001_R1_001.fastq.gz 5891STDY8062339_S1_L001_R2_001.fastq.gz 5891STDY8062340_S1_L001_I1_001.fastq.gz 5891STDY8062340_S1_L001_R1_001.fastq.gz 5891STDY8062340_S1_L001_R2_001.fastq.gz 5891STDY9030811_S1_L001_I1_001.fastq.gz 5891STDY9030811_S1_L001_R1_001.fastq.gz 5891STDY9030811_S1_L001_R2_001.fastq.gz 5891STDY9030812_S1_L001_I1_001.fastq.gz 5891STDY9030812_S1_L001_R1_001.fastq.gz 5891STDY9030812_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306366_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306366_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306366_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306367_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306367_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306367_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306368_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306368_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306368_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306369_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306369_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306369_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306370_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306370_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306370_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306371_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306371_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306371_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306372_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306372_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306372_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306373_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306373_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306373_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306380_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306380_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306380_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306381_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306381_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306381_S1_L001_R2_001.fastq.gz 5891STDY8062341_S1_L001_I1_001.fastq.gz 5891STDY8062341_S1_L001_R1_001.fastq.gz 5891STDY8062341_S1_L001_R2_001.fastq.gz 5891STDY8062342_S1_L001_I1_001.fastq.gz 5891STDY8062342_S1_L001_R1_001.fastq.gz 5891STDY8062342_S1_L001_R2_001.fastq.gz 5891STDY8062343_S1_L001_I1_001.fastq.gz 5891STDY8062343_S1_L001_R1_001.fastq.gz 5891STDY8062343_S1_L001_R2_001.fastq.gz 5891STDY8062344_S1_L001_I1_001.fastq.gz 5891STDY8062344_S1_L001_R1_001.fastq.gz 5891STDY8062344_S1_L001_R2_001.fastq.gz 5891STDY8062345_S1_L001_I1_001.fastq.gz 5891STDY8062345_S1_L001_R1_001.fastq.gz 5891STDY8062345_S1_L001_R2_001.fastq.gz 5891STDY8062346_S1_L001_I1_001.fastq.gz 5891STDY8062346_S1_L001_R1_001.fastq.gz 5891STDY8062346_S1_L001_R2_001.fastq.gz 5891STDY8062347_S1_L001_I1_001.fastq.gz 5891STDY8062347_S1_L001_R1_001.fastq.gz 5891STDY8062347_S1_L001_R2_001.fastq.gz 5891STDY8062348_S1_L001_I1_001.fastq.gz 5891STDY8062348_S1_L001_R1_001.fastq.gz 5891STDY8062348_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306374_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306374_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306374_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306375_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306375_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306375_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306376_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306376_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306376_S1_L001_R2_001.fastq.gz WSSS_F_LNG9306377_S1_L001_I1_001.fastq.gz WSSS_F_LNG9306377_S1_L001_R1_001.fastq.gz WSSS_F_LNG9306377_S1_L001_R2_001.fastq.gz WSSS_F_LNG10211449_S1_L001_I1_001.fastq.gz WSSS_F_LNG10211449_S1_L001_R1_001.fastq.gz WSSS_F_LNG10211449_S1_L001_R2_001.fastq.gz WSSS_F_LNG10211450_S1_L001_I1_001.fastq.gz WSSS_F_LNG10211450_S1_L001_R1_001.fastq.gz WSSS_F_LNG10211450_S1_L001_R2_001.fastq.gz WSSS_F_LNG10211451_S1_L001_I1_001.fastq.gz WSSS_F_LNG10211451_S1_L001_R1_001.fastq.gz WSSS_F_LNG10211451_S1_L001_R2_001.fastq.gz

Screenshot 2021-12-02 at 10.00.43.png

Acceptance criteria for the task:

Able to move files to Annotare.

aaclan-ebi commented 2 years ago

Converting this ops ticket to a bug:

Steps to replicate:

  1. Set up hca-util
  2. Try to download all the files (See hca-util download command in Wei's comment above)

Actual behaviour: CLI shows that the download failed for the files.

Expected behaviour: Download all files successfully