pepkit / geofetch

Builds a PEP from SRA or GEO accessions
https://pep.databio.org/geofetch/
BSD 2-Clause "Simplified" License
45 stars 5 forks source link

Make geofetch more efficient #121

Open khoroshevskyi opened 1 year ago

khoroshevskyi commented 1 year ago

For small basic file, the most time consumption is taking fetching data (API) image

khoroshevskyi commented 1 year ago

for bigger projects (>1000) the most time consuming is also API: image

khoroshevskyi commented 1 year ago

The most time consuming function besides API is this: image

khoroshevskyi commented 1 year ago

@nsheff I think it doesn't worse to spend time on speeding time on this issue, as most time consuming function is hitting endpoints and downloading soft files