deis / builder

Git server and application builder for Deis Workflow
https://deis.com
MIT License
40 stars 41 forks source link

intermittent ssh exchange identifcation failure #285

Closed vdice closed 8 years ago

vdice commented 8 years ago

Summary

CI has seen failures relating to ssh when deploying an app via git push.

Description

The failure looks like:

16:52:12 ------------------------------
16:52:12 Apps with a deployed app 
16:52:12   can't create an existing app
16:52:12   /go/src/github.com/deis/workflow-e2e/tests/apps_test.go:135
16:52:13 $ deis login http://deis.10.99.253.8.nip.io --username=test-81 --password=asdf1234
16:52:13 Logged in as test-81
16:52:13 $ deis apps:create test-174487287 
16:52:14 Creating Application... ...done, created test-174487287
16:52:14 Git remote deis added
16:52:14 remote available at ssh://git@deis.10.99.253.8.nip.io:2222/test-174487287.git
16:52:14 $ GIT_SSH=/tmp/deis-workflow-home629812519/.ssh/git-ssh git push deis master
16:52:24 
ssh_exchange_identification: Connection closed by remote host
16:52:24 fatal: Could not read from remote repository.
16:52:24 
16:52:24 Please make sure you have the correct access rights
16:52:24 and the repository exists.
16:52:24 $ deis apps:destroy --app= --confirm=
16:52:24  !    WARNING: Potentially Destructive Action
16:52:24  !    This command will destroy the application: test-174487287
16:52:24  !    To proceed, type "test-174487287" or re-run this command with --confirm=test-174487287
16:52:24 
16:52:24 > Error: App test-174487287 does not match confirm , aborting.
16:52:24 
16:52:24 • Failure in Spec Setup (BeforeEach) [11.841 seconds]
16:52:24 Apps
16:52:24 /go/src/github.com/deis/workflow-e2e/tests/apps_test.go:204
16:52:24   with a deployed app
16:52:24   /go/src/github.com/deis/workflow-e2e/tests/apps_test.go:174
16:52:24     can't create an existing app [BeforeEach]
16:52:24     /go/src/github.com/deis/workflow-e2e/tests/apps_test.go:135
16:52:24 
16:52:24     No future change is possible.  Bailing out early after 10.016s.
16:52:24     Got stuck at:
16:52:24         ssh_exchange_identification: Connection closed by remote host
16:52:24         fatal: Could not read from remote repository.
16:52:24         
16:52:24         Please make sure you have the correct access rights
16:52:24         and the repository exists.
16:52:24         
16:52:24     Waiting for:
16:52:24         Done, test-174487287:v\d deployed to Deis
16:52:24 
16:52:24     /go/src/github.com/deis/workflow-e2e/tests/tests_suite_test.go:362
16:52:24 ------------------------------

This is taken from workflow-test-pr build 258 and logs from this run can be seen here

Another example job exists here

Replication Steps

This error is intermittent but has by runs of the workflow-test-pr job

cc @smothiki @kmala

arschles commented 8 years ago

Could this be related to the health check failing?

smothiki commented 8 years ago

@vdice are we running tests after all the components are up and running ? @arschles the only error I could see here was boot binary not being executable

arschles commented 8 years ago

@smothiki ah, ok. ignore me then

vdice commented 8 years ago

@smothiki yes. Logic can be seen here.

kmala commented 8 years ago

looks like this is not intermittent....i got this on all my e2e tests for builder PR #283