F5Networks / f5-google-gdm-templates

Google Deployment Templates for quickly deploying BIG-IP services in Google Cloud Platform
28 stars 45 forks source link

Swap does not take place #56

Closed gwolfis closed 3 years ago

gwolfis commented 4 years ago

Do you already have an issue opened with F5 support?

Partner has opened a case on behalf of the customer C3389447. This stops a customer project at the moment.

20200922 cloudinit-log.txt 20200922 restjavad.0.log.txt

Description

The GDM templates startup levering the internet access from NIC0 to configure what is defined in cloud-init. After this phase, NIC0 and NIC1 should swap and make that NIC0 no becomes a TMM interface and NIC1 becomes management. This is not happening.

I kept a bootstrap timing of ~10min to leave the BIG-IP to do its job, but even after this time, swap hasn't happened. Also a manual reboot does not help.

As you can see in below config, only the management got configured.

[admin@bigip1-gert-bigip-3nic:Active:Standalone] ~ # ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/24 scope host lo valid_lft forever preferred_lft forever inet 127.2.0.2/24 brd 127.2.0.255 scope host lo:1 valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1460 qdisc mq master mgmt state UP qlen 1000 link/ether 42:01:0a:00:01:0a brd ff:ff:ff:ff:ff:ff inet6 fe80::4001:aff:fe00:10a/64 scope link valid_lft forever preferred_lft forever 5: mgmt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1460 qdisc noqueue state UP qlen 1000 link/ether 42:01:0a:00:01:0a brd ff:ff:ff:ff:ff:ff inet 10.0.1.10/32 brd 10.0.1.10 scope global mgmt valid_lft forever preferred_lft forever inet6 fe80::4001:aff:fe00:10a/64 scope link valid_lft forever preferred_lft forever 9: tmm: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 00:98:76:54:32:10 brd ff:ff:ff:ff:ff:ff inet 127.1.1.254/24 brd 127.1.1.255 scope global tmm valid_lft forever preferred_lft forever inet6 fc00:f5::1/64 scope global valid_lft forever preferred_lft forever inet6 fe80::298:76ff:fe54:3210/64 scope link valid_lft forever preferred_lft forever 11: tmm_bp: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 02:01:23:45:00:fe brd ff:ff:ff:ff:ff:ff inet 127.20.0.254/16 brd 127.20.255.255 scope global tmm_bp valid_lft forever preferred_lft forever inet6 fe80::1:23ff:fe45:fe/64 scope link valid_lft forever preferred_lft forever [admin@bigip1-gert-bigip-3nic:Active:Standalone] ~ # ip route default via 10.0.1.1 dev mgmt metric 4096 10.0.1.0/24 via 10.0.1.1 dev mgmt metric 4096 10.0.1.1 dev mgmt scope link metric 4096 127.1.1.0/24 dev tmm proto kernel scope link src 127.1.1.254 127.7.0.0/16 via 127.1.1.253 dev tmm 127.20.0.0/16 dev tmm_bp proto kernel scope link src 127.20.0.254

[admin@bigip1-gert-bigip-3nic:Active:Standalone] ~ # tmsh list sys management-ip sys management-ip 10.0.1.10/32 { description configured-by-dhcp } [admin@bigip1-gert-bigip-3nic:Active:Standalone] ~ # tmsh admin@(bigip1-gert-bigip-3nic)(cfg-sync Standalone)(Active)(/Common)(tmos)# list sys management-route sys management-route default { description configured-by-dhcp gateway 10.0.1.1 network default } sys management-route dhclient_route2 { description configured-by-dhcp gateway 10.0.1.1 network 10.0.1.0/24 } sys management-route dhclient_route1 { description configured-by-dhcp network 10.0.1.1/32 type interface }

Template

template used is v3.7.1 /f5-google-gdm-templates/supported/standalone/3nic/existing-stack/payg

Severity Level

For bugs, enter the bug severity level. Do not set any labels.

Severity: 2

Severity level definitions:

  1. Severity 1 (Critical) : Defect is causing systems to be offline and/or nonfunctional. immediate attention is required.
  2. Severity 2 (High) : Defect is causing major obstruction of system operations.
  3. Severity 3 (Medium) : Defect is causing intermittent errors in system operations.
  4. Severity 4 (Low) : Defect is causing infrequent interuptions in system operations.
  5. Severity 5 (Trival) : Defect is not causing any interuptions to system operations, but none-the-less is a bug.
gwolfis commented 3 years ago

The customer issue was not filling in the template correctly and this can lead to a silently failure of the template resulting that the NICs aren't swapped. it is essential that all 'required' fields are filled in and nothing is left with a <> value.

Next to this the provided feedback from the field let to PM improving the templates with more guidance, which soon will be available in a GDM update.