openstreetmap / operations

OSMF Operations Working Group issue tracking
https://operations.osmfoundation.org/
98 stars 13 forks source link

Bonded Interfaces with down links cause systemd-networkd-wait-online failure #1106

Closed Firefishy closed 1 week ago

Firefishy commented 1 week ago

With systemd version < 256 when bonded interfaces with 1 or more disconnected slave links the interface state is set to degraded-carrier. systemd-networkd-wait-online then waits and eventually fails with a timeout. This bug was corrected in https://github.com/systemd/systemd/pull/27776

Ubuntu 22.04 and Debian 12 adding the following to the bond0.network fixes the issue:

[Link]
RequiredFamilyForOnline=ipv4
RequiredForOnline=degraded-carrier

RequiredFamilyForOnline is not available in Ubuntu 20.04

Affected systems include piasa

Firefishy commented 1 week ago

The default in systemd v256 is RequiredFamilyForOnline=any, RequiredForOnline=degraded-carrier on bonded links.

tomhughes commented 1 week ago

Actually since https://github.com/systemd/systemd/pull/27776 (first in v254) a bond link will show as routable even if not all interfaces have carrier.

Also in v256 the default for RequiredForOnline is degraded-carrier but only if RequiredFamilyForOnline is any which it isn't by default.

That said the proposal here is probably the best option for versions before 254.

tomhughes commented 1 week ago

Fixed in https://github.com/openstreetmap/chef/commit/5f5aedb730d3ac6bec7dd28cdb809d4d8b8d2049.