Open jeremyyeo opened 5 days ago
I think the problem is - when polling for jobs, sometimes the dbt Cloud API may return non-JSON or empty JSON - this causes dbtc to crash because it doesn't handle this case.
https://stackoverflow.com/questions/16573332/jsondecodeerror-expecting-value-line-1-column-1-char-0
I believe the issue is that the request methods aren't resilient to network errors. Have traced this to the fact that the dbt Cloud API's load balancer can return a 502 error so there is no actual json during response.json()
: https://github.com/dpguthrie/dbtc/blob/main/dbtc/client/admin.py#L100
We'll probably want to have some sort of retry for such errors I think.
Some customers are running into errors when triggering jobs:
I don't see a way to get any verbose logging so it's hard to say what exactly is in the returned response that isn't confirming here.