search

galaxyproject / galaxy

Data intensive science for everyone.
https://galaxyproject.org
Other
1.38k stars 999 forks source link

depot.galaxyproject.org server is very slow #18972

Open mashehu opened 2 days ago

mashehu commented 2 days ago

Describe the bug Downloading singularity images from depot.galaxyproject.org is very slow ~20-50KiB/s.

Galaxy Version and/or server at which you observed the bug Galaxy Version: (check /api/version if you don't know) Commit: (run git rev-parse HEAD if you run this Galaxy server)

Browser and Operating System Operating System: macOS Browser: Firefox, Chrome, Safari

To Reproduce Steps to reproduce the behavior:

  1. run singularity pull --name depot.galaxyproject.org-singularity-multiqc-1.25.1--pyhdfd78af_0.img.pulling.1728550459893 https://depot.galaxyproject.org/singularity/multiqc:1.25.1--pyhdfd78af_0

Expected behavior Faster download speed

Screenshots If applicable, add screenshots to help explain your problem.

Additional context Started noticing it this morning (CEST)

bgruening commented 2 days ago

You should not download images from there. We have a distributed system using CVMFS to get images, please use that.

nsoranzo commented 2 days ago

We currently use depot.galaxyproject.org in a test, which has started failing with urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='depot.galaxyproject.org', port=443): Read timed out., see e.g. https://github.com/galaxyproject/galaxy/actions/runs/11273715764/job/31351337921

mvdbeek commented 1 day ago

@natefoo any ideas why depot has become that slow ?

natefoo commented 1 day ago

It's fine now as far as I can tell, but I've had sporadic issues with network performance on other PSU-hosted stuff lately, so this could be related. We're looking into it.