enasequence / enaBrowserTools

A collection of scripts to assist in the retrieval of data from the ENA Browser
Apache License 2.0
74 stars 15 forks source link

Can't download in parallel #75

Closed Aduboahen closed 1 year ago

Aduboahen commented 1 year ago

Downloads work fine when I run enaGroupGet for each accession but throw this error when I use parallel. I'm trying to download fastq files with ERS accesssions.

Error with FTP transfer: <urlopen error ftp error: ConnectionResetError(104, 'Connection reset by peer')

lilim-ebi commented 1 year ago

Hi,

Could you please show a more detailed error message and the commands that you were using? Thanks!

Aduboahen commented 1 year ago

Error with FTP transfer: <urlopen error ftp error: ConnectionResetError(104, 'Connection reset by peer')> Error with FTP transfer occurred for file: ERR8704660_1.fastq.gzError with FTP transfer: <urlopen error ftp error: ConnectionResetError(104, 'Connection reset by peer')> Error with FTP transfer occurred for file: ERR8704660_2.fastq.gzError with FTP transfer: <urlopen error ftp error: ConnectionResetError(104, 'Connection reset by peer')> Failed to download file after two attempts

cut -d, -f3 $HOME/accessions/react_accessions_sorted.csv | tail -n +2 | parallel --eta --verbose "enaGroupGet -f fastq {}"

lilim-ebi commented 1 year ago

Sorry, there's nothing I can do in the tool to fix this issue. The server sometimes has issues which causes the errors you've been experiencing. I understand that it's frustrating, but if it worked sequentially, keep using that.

Aduboahen commented 1 year ago

Alright. Thank you.

suranjayathilaka commented 1 year ago

You can report issues with the ftp server directly to the relevant team using this form: https://embl.service-now.com/sp?id=sc_cat_item_public&sys_id=5d33b3e01b45991025c35525464bcb6f&1659445303672%22