search

deis / workflow

The open source PaaS for Kubernetes.
https://deis.com/workflow/
MIT License
1.3k stars 181 forks source link

Failure to put git images to Azure Blob. #340

Closed monaka closed 8 years ago

monaka commented 8 years ago

Yesterday Workflow on my cruster works fine. But today I got errors like this. I tried a dozen time and 100% reproduced. Where is an entry point for debugging this?

$ git push -u deis master
Counting objects: 8, done.
Delta compression using up to 2 threads.
Compressing objects: 100% (5/5), done.
Writing objects: 100% (8/8), 927 bytes | 0 bytes/s, done.
Total 8 (delta 0), reused 0 (delta 0)
Starting build... but first, coffee!
22016/06/23 03:40:01 Put https://{censored}.blob.core.windows.net/builder?restype=container: dial tcp: i/o timeout
remote: 2016/06/23 03:40:02 Error running git receive hook [Build pod exited with code 1, stopping build.]
bacongobbler commented 8 years ago

the i/o timeout indicates that the builder is having some trouble connecting to azure. Can you confirm that azure is up/down for you?

monaka commented 8 years ago

There is no trouble event from Azure. And WAL-E in deis-database puts wabs://database with no trouble. So my Azure Storage has been up. Are rerated code in Builder? I'll check it.

monaka commented 8 years ago

There had "dial tcp: i/o timeout" error in some tests on the upstream. https://travis-ci.org/Azure/azure-sdk-for-go/builds/122566057 https://travis-ci.org/Azure/azure-sdk-for-go/builds/122568002 I'm not sure if they are related on this issue now.

monaka commented 8 years ago

This was fixed automagically by re-installing. I close this for now. I'll open new issue on deis/builder (or azure-sdk-for-go) if I could reproduce it.