Open famosab opened 7 months ago
I run into the same error, have you solved this problem? It seems like related to 'requests' package in python...
No unfortunately not, I opened a ticket with the EGA helpdesk but they did not have time to have a look yet.
I use another Download Tool (Live Outbox), and it works fine and really fast! You give it a try! Here’s the link to it: https://ega-archive.org/access/download/files/live-outbox/
2024年1月16日 18:25,Famke Bäuerle @.***> 写道:
No unfortunately not, I opened a ticket with the EGA helpdesk but they did not have time to have a look yet.
— Reply to this email directly, view it on GitHub https://github.com/EGA-archive/ega-download-client/issues/218#issuecomment-1893460815, or unsubscribe https://github.com/notifications/unsubscribe-auth/AUGY2ULM3GFGW7ROJPK525DYOZITNAVCNFSM6AAAAABBSZQLNSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJTGQ3DAOBRGU. You are receiving this because you commented.
That works partially for me. I can connect on my local machine (but not on our hpc) and I can only download whole datasets not single files (as the one that I mentioned in my original comment). @Yangwanyi1028 Do you have any solutions to that?
I can download a single file in my case, and here's how it work:
Thanks! That worked for me too.
Do you know anything about the files that have .unavailable.
in their filenames? Does that mean that I do not have the rights to download? In my case all .bam
files have that in their names while the .bai
files do not have that.
@famosab Could you please confirm that this issue is still not solved?
I can check again, I decided to focus on other data first because I did not manage to do the download. Have you updated the client or changed something that I need to know before trying again?
Edit: Now I also run into the following errors:
which leads to the mentioned restart of the download. So maybe the issue is not within the screen session.
Here is a partial output of the log file
Download passed time and job time do not match
I am running pyega3 to download one
bam
file which is around 150GB. Since I am downloading on our hpc, I run the download from within a screen session to which I assign ressources using SLURM commands.Description of the bug
Everytime I detach my screen and re-attach later to check the progess, the time passed indicated by the download progress is shorter than the total running time of the job. Also the download progress is not as fast I expected when I detach. With my most recent try I saw that the download progress bar reset after downloading less than 10GB
Used versions
Red Hat Enterprise Linux 8.8 (Ootpa)
3.10.13
EGA python client version 5.1.0
To Reproduce
screen -S dl
srun -N 1 --ntasks-per-node=8 --mem=5G --time=2800
EGAF00001074790
Observed behaviour
I seems that the progress bar does not continue when detaching. Sometimes the progress even resets to 0%.
Expected behaviour
Continuous download when detaching.
Screenshots and error messages
Screenshot from download bar (11min)![image](https://github.com/EGA-archive/ega-download-client/assets/45968370/b4948f5e-01d0-4776-bdd4-f7f881654cbb)
Joblist showing how long the job has been running (1h 44min)![Screenshot 2024-01-09 at 10 36 56](https://github.com/EGA-archive/ega-download-client/assets/45968370/985b3752-e85c-4817-b1ae-8bc886a65f98)
Additional context
I added
-c 20 -ms 1073741824
to improve download speed from ~300KB/s to ~8MB/s based on Issue #192.