search

cloudfoundry / bosh-google-cpi-release

BOSH Google CPI
Apache License 2.0
63 stars 96 forks source link

Loss of network when using `migrated_from` #317

Closed simonjohansson closed 3 years ago

simonjohansson commented 4 years ago

Howdie!

Yesterday we renamed all of our workers using migrated_from . 

- name: teamx
   ....
  migrated_from:
  - name: concourse-worker-teamx

Upon deploying bosh correctly changed the name of the Jobs, and everything was working as expected except that all our workers lost connectivity to the internet. Internal GCP networking between ATCs and workers was still working.

The only solution to get back to a working state was to bosh -d concourse recreate.

Anyone has any idea what could have happened?

evandbrown commented 4 years ago

Do your workers have outbound Internet connectivity via a NAT? If so, I wonder if a route or firewall change affected them.

On Thu, Feb 13, 2020 at 2:51 AM Simon Johansson notifications@github.com wrote:

Howdie!

Yesterday we renamed all of our workers using migrated_from https://bosh.io/docs/migrated-from/ .

  • name: teamx .... migrated_from:
    • name: concourse-worker-teamx

Upon deploying bosh correctly changed the name of the Jobs, and everything was working as expected except that all our workers lost connectivity to the internet. Internal GCP networking between ATCs and workers was still working.

The only solution to get back to a working state was to bosh -d concourse recreate.

Anyone has any idea what could have happened?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/cloudfoundry/bosh-google-cpi-release/issues/317?email_source=notifications&email_token=AAFAMLKQ4NPZI4U46YEYLLDRCUQZ7A5CNFSM4KUPWOX2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4INHCQCQ, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFAMLKSJQH3P2K7JH2JF43RCUQZ7ANCNFSM4KUPWOXQ .

simonjohansson commented 4 years ago

My workers lives in a subnet from a shared VPC and gets outbound network traffic via a tag, I believe there is some NAT instances in the shared VPC, I'll try to get ahold of someone with access to the networking project to clarify.

bosh-admin-bot commented 3 years ago

This issue was marked as Stale because it has been open for 21 days without any activity. If no activity takes place in the coming 7 days it will automatically be close. To prevent this from happening remove the Stale label or comment below.

bosh-admin-bot commented 3 years ago

This issue was closed because it has been labeled Stale for 7 days without subsequent activity. Feel free to re-open this issue at any time by commenting below.