EngineerBetter / control-tower

Deploy and operate Concourse CI in a single command
https://www.engineerbetter.com
Apache License 2.0
121 stars 39 forks source link

Error while upgrading an environment #57

Open nbrys opened 4 years ago

nbrys commented 4 years ago

Because the built-in pipeline hangs i tried upgrading the environment from the cli: /control-tower-darwin-amd64 deploy --iaas aws --region eu-west-1 concourse-id

But i get the following error:


  Creating VM for instance 'bosh/0' from stemcell 'ami-0a8dd0a21930bc6ab light'... Failed (00:09:51)
Failed deploying (00:09:51)

Stopping registry... Finished (00:00:00)
Cleaning up rendered CPI jobs... Finished (00:00:00)

Deploying:
  Creating instance 'bosh/0':
    Creating VM:
      Creating vm with stemcell cid 'ami-0a8dd0a21930bc6ab light':
        CPI 'create_vm' method responded with error: CmdError{"type":"Unknown","message":"Address 10.0.0.6 is in use.","ok_to_retry":false}

Exit code 1
exit status 1```

Offcourse `10.0.0.6` is in use by the current running environment
crsimmons commented 4 years ago

That's strange. 10.0.0.6 is the IP the director should be on. Can you see a vm on that IP in the AWS console? Generally the upgrade would delete the director before trying to create it. Did this happen earlier in your deploy?

What version of Control Tower are you upgrading from and to?

nbrys commented 4 years ago

I have a vm with that ip: bosh/0

I'm not very sure about the version we are upgrading from. We are running concourse 5.6.0. We are trying to upgrade to latest control tower release

crsimmons commented 4 years ago

When you run the deploy command do you see it deleting the existing director? Something like:

Started deploying
  Waiting for the agent on VM 'vm-cf762ded-1163-411e-6481-ad0869ed5bd2'... Finished (00:00:00)
  Stopping jobs on instance 'unknown/0'... Finished (00:00:01)
  Unmounting disk 'disk-f54b86d9-6367-4c60-46f3-6b95dc2de995'... Finished (00:00:06)
  Deleting VM 'vm-cf762ded-1163-411e-6481-ad0869ed5bd2'... Finished (00:00:50)