search

broadinstitute / lrma-cloud-utils

A python library for interacting with GCS, Cromwell, and Terra
BSD 3-Clause "New" or "Revised" License
4 stars 1 forks source link

retry on 503s #33

Open SHuang-Broad opened 3 months ago

SHuang-Broad commented 3 months ago

Sometimes it looks like we're bringing down the server

FireCloudServerError: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head><script src="https://us.jsagent.tcell.insight.rapid7.com/tcellagent.min.js" tcellappid="FCProd-EBOgM" tcellapikey="AQQBBAFLGLOxL7VE9IF9ESlLvCxD5Ykr_7xkQKq_rgn_P58IWjOhOzIh6p3aI4pTWaprlUw" tcellbaseurl="https://us.agent.tcell.insight.rapid7.com/api/v1"></script>
<title>503 Service Unavailable</title>
</head><body>
<h1>Service Unavailable</h1>
<p>The server is temporarily unable to service your
request due to maintenance downtime or capacity
problems. Please try again later.</p>
</body></html>
SHuang-Broad commented 3 months ago

It might be as simple as inserting 503 to this https://github.com/broadinstitute/lrma-cloud-utils/blob/129aaf4d282697318b741dd31a53fdfbfe773d37/src/lrmaCU/utils.py#L64