teamhephy / builder

MIT License
3 stars 12 forks source link

Google PROTOCOL_ERROR #14

Open Cryptophobia opened 6 years ago

Cryptophobia commented 6 years ago

From @scottrobertson on March 19, 2017 2:25

Hey

Getting the following error when trying to deploy:

2017/03/19 02:22:48 Post https://www.googleapis.com/storage/v1/b?alt=json stream error: stream ID 3; PROTOCOL_ERROR

This is intermittent. Not sure if this is Google's issue or something on my end. Any ideas?

Deployments have been working fine. This error started to happen last night.

Copied from original issue: deis/builder#497

Cryptophobia commented 6 years ago

From @scottrobertson on March 19, 2017 2:26

It's worth noting that this has taken my app down.

Cryptophobia commented 6 years ago

From @vdice on March 21, 2017 15:45

@scottrobertson is this behavior still occurring? If so, are there any logs from the builder or controller pods during time of error? I take it GCS is being used for off-cluster storage?

Cryptophobia commented 6 years ago

From @bacongobbler on March 21, 2017 15:52

All of the other bugs related to this "stream error: PROTOCOL_ERROR" bug points at http/2 somewhere. I think this has resolved itself over the weekend though: https://deis.slack.com/archives/C0Q7XKSF4/p1489919024672279

Cryptophobia commented 6 years ago

From @bacongobbler on April 1, 2017 15:39

@scottrobertson any potential action items you'd like to see in this ticket or do you think we can close this?

Cryptophobia commented 6 years ago

From @scottrobertson on April 1, 2017 15:45

@bacongobbler it's not happened again. I assume it was something on Google's end since it was happening at the same time every night.

Cryptophobia commented 6 years ago

From @scottrobertson on April 20, 2017 0:31

Hitting this again:

Counting objects: 9045, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (2844/2844), done.
Writing objects: 100% (9045/9045), 2.18 MiB | 0 bytes/s, done.
Total 9045 (delta 6302), reused 8652 (delta 6031)
remote: Resolving deltas: 100% (6302/6302), done.
remote: 2017/04/20 00:30:24 Error creating storage driver (Post https://www.googleapis.com/storage/v1/b?alt=json&project=app-slug: stream error: stream ID 3; PROTOCOL_ERROR)