My name is Nate and I work with Lili at NIST in the flow cytometry consortium. I'm trying to download all the FCS files from WG2 (~2600 files) onto an analysis computer using the API in a script. The script specifically is using basic auth and one worker download process (ie not parallel).
In the past week it seemed Labcas went down a few times (as in I couldn't log in, and it seemed that way for others as well). When I ran my script, it worked for the first ~100 requests but then failed with Http 502/503, and after that I couldn't log into labcas from the web interface. So while I'm not sure if my script resulted in labcas going offline, the timing seemed to fit.
What is the best way to download large amounts of data from Labcas using the API? I've read the docs available online and there was no indication of a rate limit, so I'm surprised that this happened assuming that my script is to blame.
From Nathan:
Hi Ben, David, and Heather,
My name is Nate and I work with Lili at NIST in the flow cytometry consortium. I'm trying to download all the FCS files from WG2 (~2600 files) onto an analysis computer using the API in a script. The script specifically is using basic auth and one worker download process (ie not parallel).
In the past week it seemed Labcas went down a few times (as in I couldn't log in, and it seemed that way for others as well). When I ran my script, it worked for the first ~100 requests but then failed with Http 502/503, and after that I couldn't log into labcas from the web interface. So while I'm not sure if my script resulted in labcas going offline, the timing seemed to fit.
What is the best way to download large amounts of data from Labcas using the API? I've read the docs available online and there was no indication of a rate limit, so I'm surprised that this happened assuming that my script is to blame.
Thank you, Nate