search

canonical / lxd

Powerful system container and virtual machine manager
https://canonical.com/lxd
GNU Affero General Public License v3.0
4.32k stars 925 forks source link

macvlan NICs losing connectivity when LXD is reloaded #11089

Closed markrattray closed 1 year ago

markrattray commented 1 year ago

Required information

Issue description

All instances are using MACVLAN interfaces for now till I get everything over to LXD.

All VMs are dropping off the network. When trying to restart them they just go into a stopped state. When trying to start them we then get the error message:

~$ lxc start vmname
Error: Failed to start device "eth0": Failed to set the MAC address: Failed to run: ip link set dev macd8b62eeb address 00:16:3e:87:19:1f: exit status 2 (RTNETLINK answers: Address already in use))

I notice that the dev name changes every time I try start the VM…

Failed to run: ip link set dev macd8b62eeb address 00:16:3e:87:19:1f
Failed to run: ip link set dev macef515ed2 address 00:16:3e:87:19:1f
Failed to run: ip link set dev mac99318f7d address 00:16:3e:87:19:1f
...

I can manually delete the device and start the VM:

ip link show | grep -B 1 '00:16:3e:87:19:1f'
    29: maca35b59f9@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:87:19:1f brd ff:ff:ff:ff:ff:ff

sudo ip link delete maca35b59f9
lxc start vmname

Interestingly it doesn't matter whether this is a Windows image I built or those using Ubuntu Server & Desktop VM images downloaded from the default image repo images.linuxcontainers.org.

Steps to reproduce

  1. Create VM (images:ubuntu/22.04/cloud) with MACVLAN interface
  2. Wait about a week for VMs to start loosing network connectivity
  3. Try restart them

Information to attach

last reboot due to this issue

$ last | grep reboot
reboot   system boot  5.15.0-52-generi Thu Oct 27 17:18

dmesg

root@server1:/home/someadmin# dmesg | grep windowsvm1
[  121.322993] audit: type=1400 audit(1666905560.115:61): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd-windowsvm1_</var/snap/lxd/common/lxd>" pid=16353 comm="apparmor_parser"
[  121.341129] audit: type=1400 audit(1666905560.131:62): apparmor="DENIED" operation="open" profile="lxd-windowsvm1_</var/snap/lxd/common/lxd>" name="/var/lib/snapd/hostfs/run/systemd/resolve/stub-resolv.conf" pid=16413 comm="lxd" requested_mask="r" denied_mask="r" fsuid=0 ouid=101
[588092.580580] audit: type=1400 audit(1667493544.754:269): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxd-windowsvm1_</var/snap/lxd/common/lxd>" pid=2179130 comm="apparmor_parser"
[588092.600952] audit: type=1400 audit(1667493544.774:270): apparmor="DENIED" operation="open" profile="lxd-windowsvm1_</var/snap/lxd/common/lxd>" name="/var/lib/snapd/hostfs/run/systemd/resolve/stub-resolv.conf" pid=2179134 comm="lxd" requested_mask="r" denied_mask="r" fsuid=0 ouid=101

root@server1:/home/someadmin# dmesg | grep maca35b59f9

instance log: before "ip link delete {device}" The qemu.log disappears even though the instance is running, but only reappears when the instance is started successfully.

root@server1:~$ lxc info --show-log ubuntudesktopvm2
Name: ubuntudesktopvm2
Status: RUNNING
Type: virtual-machine
Architecture: x86_64
Location: server1.domain.tld
PID: 22501
Created: 2022/08/24 04:29 EDT
Last Used: 2022/10/27 17:19 EDT

Resources:
  Processes: 132
  Disk usage:
    root: 7.12GiB
  CPU usage:
    CPU usage (in seconds): 35027
  Memory usage:
    Memory (current): 3.70GiB
    Memory (peak): 3.84GiB
  Network usage:
    enp5s0:
      Type: broadcast
      State: UP
      Host interface: mac08fe77dc
      MAC address: 00:16:3e:0c:57:c6
      MTU: 1500
      Bytes received: 529.02MB
      Bytes sent: 305.63MB
      Packets received: 3759880
      Packets sent: 1370752
      IP addresses:
        inet6: fe80::216:3eff:fe0c:57c6/64 (link)
    lo:
      Type: loopback
      State: UP
      MTU: 65536
      Bytes received: 6.63GB
      Bytes sent: 6.63GB
      Packets received: 49331802
      Packets sent: 49331802
      IP addresses:
        inet:  127.0.0.1/8 (local)
        inet6: ::1/128 (local)
Error: open /var/snap/lxd/common/lxd/logs/ubuntudesktopvm2/qemu.log: no such file or directory

container config #1: windowsvm1

# lxc config show windowsvm1 --expanded
architecture: x86_64
config:
  cloud-init.user-data: |
    #cloud-config
    first_logon_behaviour: false
    set_timezone: America/New_York
    users:
      - name: someadmin
        passwd: someadminpassword
        primary_group: Administrators
    winrm_enable_basic_auth: true
    winrm_configure_https_listener: true
  image.architecture: amd64
  image.description: MS WS 2022 S,D,c (20220817-2048z)
  image.os: Windows
  image.release: "2022"
  image.serial: 20220817-2048z
  image.type: virtual-machine
  image.variant: Standard, Desktop Experience, cloudbase-init
  limits.cpu: "4"
  limits.memory: 6GiB
  security.syscalls.intercept.sysinfo: "true"
  volatile.base_image: c870435e5901d2f20f3bd0418a4945fbae4f38f4327eec8bf9b5343cfa4574f6
  volatile.cloud-init.instance-id: c821ad49-9fd6-4d9a-b14d-2a1746ce46c9
  volatile.eth0.host_name: mac0a7e5062
  volatile.eth0.hwaddr: 00:16:3e:87:19:1f
  volatile.eth0.last_state.created: "false"
  volatile.last_state.power: RUNNING
  volatile.uuid: 2c78483b-2a86-4cd5-9e4c-69f47e602f28
  volatile.vsock_id: "33"
devices:
  eth0:
    name: eth0
    nictype: macvlan
    parent: eno1
    type: nic
  root:
    path: /
    pool: sp00
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

container config #2: ubuntudesktopvm1

lxc config show ubuntudesktopvm1 --expanded
architecture: x86_64
config:
  cloud-init.user-data: |
    #cloud-config
    packages:
      - apt-transport-https
      - gpg
    package_upgrade: true
    timezone: America/New_York
  image.architecture: amd64
  image.description: Ubuntu jammy amd64 (20220821_07:42)
  image.os: Ubuntu
  image.release: jammy
  image.serial: "20220821_07:42"
  image.type: disk-kvm.img
  image.variant: desktop
  limits.cpu: "6"
  limits.memory: 6GiB
  security.syscalls.intercept.sysinfo: "true"
  volatile.base_image: d7c196be900f47cbcc6167031bc1521ec31a11e6b117ebebbc6234f41fe57edf
  volatile.cloud-init.instance-id: add76d39-6ffa-43b9-8331-67b172686ff7
  volatile.eth0.host_name: mac22d6f498
  volatile.eth0.hwaddr: 00:16:3e:f9:d2:d5
  volatile.eth0.last_state.created: "false"
  volatile.last_state.power: RUNNING
  volatile.uuid: 092a4884-128c-4b05-b4b5-876d322f9df9
  volatile.vsock_id: "37"
devices:
  eth0:
    name: eth0
    nictype: macvlan
    parent: eno1
    type: nic
  root:
    path: /
    pool: sp00
    size: 30GiB
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

Main daemon log: cat /var/snap/lxd/common/lxd/logs/lxd.log

cat /var/snap/lxd/common/lxd/logs/lxd.log
time="2022-10-31T15:34:15-04:00" level=warning msg=" - Couldn't find the CGroup network priority controller, network priority will be ignored"
time="2022-10-31T15:34:23-04:00" level=warning msg="Failed to delete operation" class=task description="Pruning leftover image files" err="Operation not found" operation=0579cc32-cea0-44a1-9bfb-614c4b0f7d11 project= status=Success
time="2022-10-31T15:34:24-04:00" level=warning msg="Failed to delete operation" class=task description="Remove orphaned operations" err="Operation not found" operation=b36749d9-3590-45e2-9370-01beb5d5560b project= status=Success
time="2022-10-31T15:34:24-04:00" level=warning msg="Failed to delete operation" class=task description="Cleaning up expired images" err="Operation not found" operation=2073d73d-a990-461c-b36c-025debcfb13d project= status=Success
time="2022-11-03T12:18:18-04:00" level=error msg="Failed writing error for HTTP response" err="open /var/snap/lxd/common/lxd/logs/windowsvm1/qemu.log: no such file or directory" url="/1.0/instances/{name}/logs/{file}" writeErr="<nil>"

Output of the client with --debug n/a

Main daemon log: cat /var/snap/lxd/common/lxd/logs/lxd.log.1

cat /var/snap/lxd/common/lxd/logs/lxd.log.1
time="2022-10-27T17:18:45-04:00" level=warning msg=" - Couldn't find the CGroup network priority controller, network priority will be ignored"
time="2022-10-27T17:18:55-04:00" level=warning msg="Failed to delete operation" class=task description="Pruning leftover image files" err="Operation not found" operation=fcbca487-bcf3-47ad-94b1-4823f8082a10 project= status=Success
time="2022-10-27T17:18:55-04:00" level=warning msg="Failed to delete operation" class=task description="Cleaning up expired images" err="Operation not found" operation=493db1a7-1e7c-4ec5-840d-f05e24bf0aec project= status=Success
time="2022-10-27T17:18:55-04:00" level=warning msg="Failed to delete operation" class=task description="Remove orphaned operations" err="Operation not found" operation=9294261c-4769-429d-815d-f0b2c7e0a963 project= status=Success
time="2022-10-27T17:18:56-04:00" level=warning msg="Failed to delete operation" class=task description="Synchronizing images" err="Operation not found" operation=c9944a20-8fa9-4365-85d1-e80a6cb29943 project= status=Success
time="2022-10-27T17:19:21-04:00" level=warning msg="Starting VM without default firmware (-bios or -kernel in raw.qemu)" instance=citrixnetscaler1 instanceType=virtual-machine project=default
time="2022-10-27T17:19:23-04:00" level=warning msg="Starting VM without default firmware (-bios or -kernel in raw.qemu)" instance=citrixnetscaler2 instanceType=virtual-machine project=default
time="2022-10-27T17:20:18-04:00" level=error msg="Failed to advertise vsock address" err="Failed connecting to lxd-agent: Get \"https://custom.socket/1.0\": dial vsock vm(37):8443: connect: connection timed out" instance=ubuntudesktopvm1 instanceType=virtual-machine project=default
time="2022-10-27T17:20:19-04:00" level=warning msg="Could not get VM state from agent" err="Failed connecting to agent: Get \"https://custom.socket/1.0\": dial vsock vm(37):8443: connect: connection timed out" instance=ubuntudesktopvm1 instanceType=virtual-machine project=default
time="2022-10-27T17:20:19-04:00" level=error msg="Failed writing error for HTTP response" err="write unix /var/snap/lxd/common/lxd/unix.socket->@: write: broken pipe" url=/1.0/instances writeErr="write unix /var/snap/lxd/common/lxd/unix.socket->@: write: broken pipe"
time="2022-10-27T17:20:34-04:00" level=error msg="Failed to advertise vsock address" err="Failed connecting to lxd-agent: Get \"https://custom.socket/1.0\": dial vsock vm(39):8443: connect: connection timed out" instance=ubuntudesktopvm2 instanceType=virtual-machine project=default
time="2022-10-31T15:33:53-04:00" level=warning msg="Could not handover member's responsibilities" err="Failed to transfer leadership: No online voter found"

lxc monitor

[lxd_11089_lxcmonitor.txt](https://github.com/lxc/lxd/files/9933256/lxd_11089_lxcmonitor.txt)
markrattray commented 1 year ago

OK Tom, sorry to confuse matters and happy to do again with another Windows VM.

I do think now that the stop --force is doing it's job just fine and not providing the same scenario as the problem at hand.

I believe what I sent this morning is what you asked for, using a different Windows VM called mw2022-qvm-mad01 that has not available on the network since the automatic LXD refresh on 29th Nov. Notice the QVM in the middle of the name.

Yesterday was the Dev server called mw2022-dvm-mad01 and it is back on the network following the troubleshooting we did so I think it's not a good candidate for troubleshooting anymore. Notice the DVM in the middle of the name.

If I was to do this again, I assume I would need to choose a different VM from the list I provided this morning that are still in the state where they are no longer available on the network... is this a correct assumption or do you want me to reuse the mw2022-dvm-mad01 instance that is now back on the network?

Thanks Tom.

tomponline commented 1 year ago

Yes lets pick a windows VM that you have the macvlan interface deletion issue that is also not connected to the network.

markrattray commented 1 year ago

ooh one more thing: what would you like in the Windows VM in place of ip l command?

tomponline commented 1 year ago

I guess ipconfig /all (is that a thing still?)

tomponline commented 1 year ago

Something that shows mac address

markrattray commented 1 year ago

So this is for a Windows VM I'm calling mw2022-ivm-cxv01 which has been unavailable since the auto Snap refresh on 29th Nov.

Spoiler: the stop --force does its' job and this VM started without having to delete the device via ip link delete

Before Stop

lxc config show --expanded mw2022-ivm-cxv01

architecture: x86_64
config:
  image.architecture: amd64
  image.description: MS WS 2022 S,D,c (20220817-2048z)
  image.os: Windows
  image.release: "2022"
  image.serial: 20220817-2048z
  image.type: virtual-machine
  image.variant: Standard, Desktop Experience, cloudbase-init
  limits.cpu: "4"
  limits.memory: 6GiB
  security.syscalls.intercept.sysinfo: "true"
  volatile.base_image: c870435e5901d2f20f3bd0418a4945fbae4f38f4327eec8bf9b5343cfa4574f6
  volatile.cloud-init.instance-id: 656bbecb-6940-4725-a4dd-3e4fe29ab655
  volatile.eth0.host_name: mac231cccb5
  volatile.eth0.hwaddr: 00:16:3e:f3:dd:b2
  volatile.eth0.last_state.created: "false"
  volatile.last_state.power: RUNNING
  volatile.uuid: 916b5e77-d1ec-4515-9190-51ea7fa47333
  volatile.vsock_id: "31"
devices:
  eth0:
    name: eth0
    nictype: macvlan
    parent: eno1
    type: nic
  root:
    path: /
    pool: sp00
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

ip l

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 10000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d4 brd ff:ff:ff:ff:ff:ff
    altname enp1s0f0
3: eno2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d5 brd ff:ff:ff:ff:ff:ff
    altname enp1s0f1
4: eno3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d6 brd ff:ff:ff:ff:ff:ff
    altname enp2s0f0
5: eno4: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d7 brd ff:ff:ff:ff:ff:ff
    altname enp2s0f1
6: idrac: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether e0:db:55:06:77:c3 brd ff:ff:ff:ff:ff:ff
113: mac38af0240@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:90:94:89 brd ff:ff:ff:ff:ff:ff
118: mace1713df6@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:8a:35:ed brd ff:ff:ff:ff:ff:ff
130: mac83bcc53e@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:a5:13:0b brd ff:ff:ff:ff:ff:ff
132: maccf88b6f4@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:1d:71:a5 brd ff:ff:ff:ff:ff:ff
133: mac1a1709f2@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:f9:d2:d5 brd ff:ff:ff:ff:ff:ff
134: macbb32a1cb@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:0c:57:c6 brd ff:ff:ff:ff:ff:ff
139: mac05660c50@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:c1:5f:52 brd ff:ff:ff:ff:ff:ff
140: macc15cacf7@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:a0:bf:dd brd ff:ff:ff:ff:ff:ff
143: macf3522c51@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:5b:3a:88 brd ff:ff:ff:ff:ff:ff
144: mac231cccb5@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:f3:dd:b2 brd ff:ff:ff:ff:ff:ff
145: macc2b65fbc@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:f7:e4:ce brd ff:ff:ff:ff:ff:ff
146: macda472719@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:12:55:8d brd ff:ff:ff:ff:ff:ff
147: mac51fd35aa@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:1b:a0:f1 brd ff:ff:ff:ff:ff:ff
152: mac731bd6e2@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:6a:a0:00 brd ff:ff:ff:ff:ff:ff
155: macceda4f28@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:cc:ea:86 brd ff:ff:ff:ff:ff:ff
156: mac2ea24845@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:d8:f4:3c brd ff:ff:ff:ff:ff:ff
157: mace4b3f948@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:d9:88:f1 brd ff:ff:ff:ff:ff:ff

ipconfig /all

Windows IP Configuration

   Host Name . . . . . . . . . . . . : mw2022-ivm-cxv01
   Primary Dns Suffix  . . . . . . . : domain.tld
   Node Type . . . . . . . . . . . . : Hybrid
   IP Routing Enabled. . . . . . . . : No
   WINS Proxy Enabled. . . . . . . . : No
   DNS Suffix Search List. . . . . . : domain.tld
                                       pd.domain.tld
                                       pq.domain.tld

Ethernet adapter Ethernet Instance 0:

   Connection-specific DNS Suffix  . : domain.tld
   Description . . . . . . . . . . . : Red Hat VirtIO Ethernet Adapter
   Physical Address. . . . . . . . . : 00-16-3E-F3-DD-B2
   DHCP Enabled. . . . . . . . . . . : Yes
   Autoconfiguration Enabled . . . . : Yes
   Link-local IPv6 Address . . . . . : fe80::7fa6:8a6e:72d1:343f%11(Preferred)
   Autoconfiguration IPv4 Address. . : 169.254.38.199(Preferred)
   Subnet Mask . . . . . . . . . . . : 255.255.0.0
   Default Gateway . . . . . . . . . :
   DHCPv6 IAID . . . . . . . . . . . : 100668990
   DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-2A-8F-4A-0C-00-16-3E-F3-DD-B2
   DNS Servers . . . . . . . . . . . : fec0:0:0:ffff::1%1
                                       fec0:0:0:ffff::2%1
                                       fec0:0:0:ffff::3%1
   NetBIOS over Tcpip. . . . . . . . : Enabled
   Connection-specific DNS Suffix Search List :
                                       domain.tld
                                       pd.domain.tld
                                       pq.domain.tld

netsh interface show interface

Admin State    State          Type             Interface Name
-------------------------------------------------------------------------
Enabled        Connected      Dedicated        Ethernet Instance 0

After Stop - Before Start

lxc config show --expanded mw2022-ivm-cxv01

architecture: x86_64
config:
  image.architecture: amd64
  image.description: MS WS 2022 S,D,c (20220817-2048z)
  image.os: Windows
  image.release: "2022"
  image.serial: 20220817-2048z
  image.type: virtual-machine
  image.variant: Standard, Desktop Experience, cloudbase-init
  limits.cpu: "4"
  limits.memory: 6GiB
  security.syscalls.intercept.sysinfo: "true"
  volatile.base_image: c870435e5901d2f20f3bd0418a4945fbae4f38f4327eec8bf9b5343cfa4574f6
  volatile.cloud-init.instance-id: 656bbecb-6940-4725-a4dd-3e4fe29ab655
  volatile.eth0.hwaddr: 00:16:3e:f3:dd:b2
  volatile.last_state.power: STOPPED
  volatile.last_state.ready: "false"
  volatile.uuid: 916b5e77-d1ec-4515-9190-51ea7fa47333
  volatile.vsock_id: "31"
devices:
  eth0:
    name: eth0
    nictype: macvlan
    parent: eno1
    type: nic
  root:
    path: /
    pool: sp00
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

ip l

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 10000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d4 brd ff:ff:ff:ff:ff:ff
    altname enp1s0f0
3: eno2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d5 brd ff:ff:ff:ff:ff:ff
    altname enp1s0f1
4: eno3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d6 brd ff:ff:ff:ff:ff:ff
    altname enp2s0f0
5: eno4: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d7 brd ff:ff:ff:ff:ff:ff
    altname enp2s0f1
6: idrac: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether e0:db:55:06:77:c3 brd ff:ff:ff:ff:ff:ff
113: mac38af0240@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:90:94:89 brd ff:ff:ff:ff:ff:ff
118: mace1713df6@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:8a:35:ed brd ff:ff:ff:ff:ff:ff
130: mac83bcc53e@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:a5:13:0b brd ff:ff:ff:ff:ff:ff
132: maccf88b6f4@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:1d:71:a5 brd ff:ff:ff:ff:ff:ff
133: mac1a1709f2@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:f9:d2:d5 brd ff:ff:ff:ff:ff:ff
134: macbb32a1cb@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:0c:57:c6 brd ff:ff:ff:ff:ff:ff
139: mac05660c50@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:c1:5f:52 brd ff:ff:ff:ff:ff:ff
140: macc15cacf7@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:a0:bf:dd brd ff:ff:ff:ff:ff:ff
143: macf3522c51@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:5b:3a:88 brd ff:ff:ff:ff:ff:ff
145: macc2b65fbc@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:f7:e4:ce brd ff:ff:ff:ff:ff:ff
146: macda472719@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:12:55:8d brd ff:ff:ff:ff:ff:ff
147: mac51fd35aa@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:1b:a0:f1 brd ff:ff:ff:ff:ff:ff
152: mac731bd6e2@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:6a:a0:00 brd ff:ff:ff:ff:ff:ff
155: macceda4f28@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:cc:ea:86 brd ff:ff:ff:ff:ff:ff
156: mac2ea24845@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:d8:f4:3c brd ff:ff:ff:ff:ff:ff
157: mace4b3f948@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:d9:88:f1 brd ff:ff:ff:ff:ff:ff

After Start

lxc config show --expanded mw2022-ivm-cxv01

architecture: x86_64
config:
  image.architecture: amd64
  image.description: MS WS 2022 S,D,c (20220817-2048z)
  image.os: Windows
  image.release: "2022"
  image.serial: 20220817-2048z
  image.type: virtual-machine
  image.variant: Standard, Desktop Experience, cloudbase-init
  limits.cpu: "4"
  limits.memory: 6GiB
  security.syscalls.intercept.sysinfo: "true"
  volatile.base_image: c870435e5901d2f20f3bd0418a4945fbae4f38f4327eec8bf9b5343cfa4574f6
  volatile.cloud-init.instance-id: 656bbecb-6940-4725-a4dd-3e4fe29ab655
  volatile.eth0.host_name: mac7ea10900
  volatile.eth0.hwaddr: 00:16:3e:f3:dd:b2
  volatile.eth0.last_state.created: "false"
  volatile.last_state.power: RUNNING
  volatile.last_state.ready: "false"
  volatile.uuid: 916b5e77-d1ec-4515-9190-51ea7fa47333
  volatile.vsock_id: "31"
devices:
  eth0:
    name: eth0
    nictype: macvlan
    parent: eno1
    type: nic
  root:
    path: /
    pool: sp00
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

ip l

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 10000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d4 brd ff:ff:ff:ff:ff:ff
    altname enp1s0f0
3: eno2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d5 brd ff:ff:ff:ff:ff:ff
    altname enp1s0f1
4: eno3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d6 brd ff:ff:ff:ff:ff:ff
    altname enp2s0f0
5: eno4: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 10000
    link/ether 90:b1:1c:2a:a1:d7 brd ff:ff:ff:ff:ff:ff
    altname enp2s0f1
6: idrac: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether e0:db:55:06:77:c3 brd ff:ff:ff:ff:ff:ff
113: mac38af0240@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:90:94:89 brd ff:ff:ff:ff:ff:ff
118: mace1713df6@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:8a:35:ed brd ff:ff:ff:ff:ff:ff
130: mac83bcc53e@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:a5:13:0b brd ff:ff:ff:ff:ff:ff
132: maccf88b6f4@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:1d:71:a5 brd ff:ff:ff:ff:ff:ff
133: mac1a1709f2@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:f9:d2:d5 brd ff:ff:ff:ff:ff:ff
134: macbb32a1cb@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:0c:57:c6 brd ff:ff:ff:ff:ff:ff
139: mac05660c50@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:c1:5f:52 brd ff:ff:ff:ff:ff:ff
140: macc15cacf7@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:a0:bf:dd brd ff:ff:ff:ff:ff:ff
143: macf3522c51@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:5b:3a:88 brd ff:ff:ff:ff:ff:ff
145: macc2b65fbc@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:f7:e4:ce brd ff:ff:ff:ff:ff:ff
146: macda472719@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:12:55:8d brd ff:ff:ff:ff:ff:ff
147: mac51fd35aa@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:1b:a0:f1 brd ff:ff:ff:ff:ff:ff
152: mac731bd6e2@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:6a:a0:00 brd ff:ff:ff:ff:ff:ff
155: macceda4f28@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:cc:ea:86 brd ff:ff:ff:ff:ff:ff
156: mac2ea24845@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:d8:f4:3c brd ff:ff:ff:ff:ff:ff
157: mace4b3f948@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:d9:88:f1 brd ff:ff:ff:ff:ff:ff
158: mac7ea10900@eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP mode DEFAULT group default qlen 500
    link/ether 00:16:3e:f3:dd:b2 brd ff:ff:ff:ff:ff:ff

ipconfig /all

Windows IP Configuration

   Host Name . . . . . . . . . . . . : mw2022-ivm-cxv01
   Primary Dns Suffix  . . . . . . . : domain.tld
   Node Type . . . . . . . . . . . . : Hybrid
   IP Routing Enabled. . . . . . . . : No
   WINS Proxy Enabled. . . . . . . . : No
   DNS Suffix Search List. . . . . . : domain.tld
                                       pd.domain.tld
                                       pq.domain.tld

Ethernet adapter Ethernet Instance 0:

   Connection-specific DNS Suffix  . : domain.tld
   Description . . . . . . . . . . . : Red Hat VirtIO Ethernet Adapter
   Physical Address. . . . . . . . . : 00-16-3E-F3-DD-B2
   DHCP Enabled. . . . . . . . . . . : Yes
   Autoconfiguration Enabled . . . . : Yes
   Link-local IPv6 Address . . . . . : fe80::7fa6:8a6e:72d1:343f%11(Preferred) 
   IPv4 Address. . . . . . . . . . . : 192.168.0.153(Preferred) 
   Subnet Mask . . . . . . . . . . . : 255.255.255.0
   Lease Obtained. . . . . . . . . . : Tuesday, December 6, 2022 11:47:25 AM
   Lease Expires . . . . . . . . . . : Tuesday, December 6, 2022 4:47:24 PM
   Default Gateway . . . . . . . . . : 192.168.0.254
   DHCP Server . . . . . . . . . . . : 192.168.0.11
   DHCPv6 IAID . . . . . . . . . . . : 100668990
   DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-2A-8F-4A-0C-00-16-3E-F3-DD-B2
   DNS Servers . . . . . . . . . . . : 192.168.0.13
                                       192.168.0.12
   NetBIOS over Tcpip. . . . . . . . : Enabled
   Connection-specific DNS Suffix Search List :
                                       domain.tld
                                       pd.domain.tld
                                       pq.domain.tld

netsh interface show interface

Admin State    State          Type             Interface Name
-------------------------------------------------------------------------
Enabled        Connected      Dedicated        Ethernet Instance 0

lxc monitor

Let run for 5 secs before and after lxc stop --force mw2022-ivm-cxv01

time="2022-12-06T06:43:44-05:00" level=debug msg="Event listener server handler started" id=668da493-f591-45e6-923e-678efcbe4e86 local=/var/snap/lxd/common/lxd/unix.socket remote=@
time="2022-12-06T06:43:44-05:00" level=debug msg="Syscall handler received fds 67(/proc/<pid>), 70(/proc/<pid>/mem), and 71([seccomp notify])"
time="2022-12-06T06:43:44-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=71 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193175 seccomp_notify_mem_fd=70 seccomp_notify_pid=1396594 syscall_number=99
time="2022-12-06T06:43:44-05:00" level=debug msg="Send seccomp notification for id(14489745358209193175)"
time="2022-12-06T06:43:45-05:00" level=debug msg="Syscall handler received fds 67(/proc/<pid>), 70(/proc/<pid>/mem), and 71([seccomp notify])"
time="2022-12-06T06:43:45-05:00" level=debug msg="Send seccomp notification for id(14489745358209193176)"
time="2022-12-06T06:43:45-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=71 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193176 seccomp_notify_mem_fd=70 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:46-05:00" level=debug msg="Syscall handler received fds 67(/proc/<pid>), 70(/proc/<pid>/mem), and 71([seccomp notify])"
time="2022-12-06T06:43:46-05:00" level=debug msg="Send seccomp notification for id(14489745358209193177)"
time="2022-12-06T06:43:46-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=71 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193177 seccomp_notify_mem_fd=70 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:47-05:00" level=debug msg="Syscall handler received fds 67(/proc/<pid>), 70(/proc/<pid>/mem), and 71([seccomp notify])"
time="2022-12-06T06:43:47-05:00" level=debug msg="Send seccomp notification for id(14489745358209193178)"
time="2022-12-06T06:43:47-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=71 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193178 seccomp_notify_mem_fd=70 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:47-05:00" level=debug msg="Heartbeat updating local raft members" members="[{{1 us2204-iph-lxd03.domain.tld:8443 voter} us2204-iph-lxd03.domain.tld}]"
time="2022-12-06T06:43:47-05:00" level=debug msg="Starting heartbeat round" local="us2204-iph-lxd03.domain.tld:8443" mode=normal
time="2022-12-06T06:43:47-05:00" level=debug msg="Completed heartbeat round" duration=3.262625ms local="us2204-iph-lxd03.domain.tld:8443"
time="2022-12-06T06:43:48-05:00" level=debug msg="Syscall handler received fds 67(/proc/<pid>), 70(/proc/<pid>/mem), and 71([seccomp notify])"
time="2022-12-06T06:43:48-05:00" level=debug msg="Send seccomp notification for id(14489745358209193179)"
time="2022-12-06T06:43:48-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=71 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193179 seccomp_notify_mem_fd=70 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:49-05:00" level=debug msg="Syscall handler received fds 67(/proc/<pid>), 70(/proc/<pid>/mem), and 71([seccomp notify])"
time="2022-12-06T06:43:49-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=71 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193180 seccomp_notify_mem_fd=70 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:49-05:00" level=debug msg="Send seccomp notification for id(14489745358209193180)"
time="2022-12-06T06:43:50-05:00" level=debug msg="Syscall handler received fds 67(/proc/<pid>), 70(/proc/<pid>/mem), and 71([seccomp notify])"
time="2022-12-06T06:43:50-05:00" level=debug msg="Send seccomp notification for id(14489745358209193181)"
time="2022-12-06T06:43:50-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=71 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193181 seccomp_notify_mem_fd=70 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:50-05:00" level=debug msg="Handling API request" ip=@ method=GET protocol=unix url=/1.0 username=root
time="2022-12-06T06:43:50-05:00" level=debug msg="Handling API request" ip=@ method=GET protocol=unix url=/1.0/events username=root
time="2022-12-06T06:43:50-05:00" level=debug msg="Handling API request" ip=@ method=PUT protocol=unix url=/1.0/instances/mw2022-ivm-cxv01/state username=root
time="2022-12-06T06:43:50-05:00" level=debug msg="Event listener server handler started" id=deb07053-cb22-4a0e-9a81-11acb31c2d4e local=/var/snap/lxd/common/lxd/unix.socket remote=@
time="2022-12-06T06:43:50-05:00" level=debug msg="Stop started" instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default stateful=false
time="2022-12-06T06:43:50-05:00" level=debug msg="New operation" class=task description="Stopping instance" operation=1bdf1516-b257-4385-8eb5-d8b3de9bbf0a project=default
time="2022-12-06T06:43:50-05:00" level=debug msg="Started operation" class=task description="Stopping instance" operation=1bdf1516-b257-4385-8eb5-d8b3de9bbf0a project=default
time="2022-12-06T06:43:50-05:00" level=debug msg="Instance operation lock created" action=stop instance=mw2022-ivm-cxv01 project=default reusable=false
time="2022-12-06T06:43:50-05:00" level=debug msg="Handling API request" ip=@ method=GET protocol=unix url=/1.0/operations/1bdf1516-b257-4385-8eb5-d8b3de9bbf0a username=root
time="2022-12-06T06:43:50-05:00" level=debug msg="Waiting for VM process to finish" instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default
time="2022-12-06T06:43:50-05:00" level=debug msg="onStop hook started" instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default target=stop
time="2022-12-06T06:43:50-05:00" level=debug msg="Instance stopped" instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default
time="2022-12-06T06:43:51-05:00" level=debug msg="Syscall handler received fds 70(/proc/<pid>), 71(/proc/<pid>/mem), and 114([seccomp notify])"
time="2022-12-06T06:43:51-05:00" level=debug msg="Send seccomp notification for id(14489745358209193182)"
time="2022-12-06T06:43:51-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=114 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193182 seccomp_notify_mem_fd=71 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:51-05:00" level=debug msg="VM process finished" instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default
time="2022-12-06T06:43:51-05:00" level=debug msg="Failed to unmount" attempt=0 err="device or resource busy" path=/var/snap/lxd/common/lxd/devices/mw2022-ivm-cxv01/config.mount
time="2022-12-06T06:43:51-05:00" level=debug msg="Stopping device" device=eth0 instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default type=nic
time="2022-12-06T06:43:51-05:00" level=debug msg="Stopping device" device=root instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default type=disk
time="2022-12-06T06:43:51-05:00" level=debug msg="UnmountInstance started" instance=mw2022-ivm-cxv01 project=default
time="2022-12-06T06:43:51-05:00" level=debug msg="Failed to unmount" attempt=0 err="device or resource busy" path=/var/snap/lxd/common/lxd/storage-pools/sp00/virtual-machines/mw2022-ivm-cxv01
time="2022-12-06T06:43:52-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 70(/proc/<pid>/mem), and 71([seccomp notify])"
time="2022-12-06T06:43:52-05:00" level=debug msg="Send seccomp notification for id(14489745358209193183)"
time="2022-12-06T06:43:52-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=71 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193183 seccomp_notify_mem_fd=70 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:52-05:00" level=debug msg="Unmounted ZFS dataset" dev=sp00/virtual-machines/mw2022-ivm-cxv01 driver=zfs path=/var/snap/lxd/common/lxd/storage-pools/sp00/virtual-machines/mw2022-ivm-cxv01 pool=sp00 volName=mw2022-ivm-cxv01
time="2022-12-06T06:43:52-05:00" level=debug msg="Deactivated ZFS volume" dev=sp00/virtual-machines/mw2022-ivm-cxv01.block driver=zfs pool=sp00 volName=mw2022-ivm-cxv01
time="2022-12-06T06:43:52-05:00" level=debug msg="UnmountInstance finished" instance=mw2022-ivm-cxv01 project=default
time="2022-12-06T06:43:52-05:00" level=debug msg="onStop hook finished" instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default target=stop
time="2022-12-06T06:43:52-05:00" level=debug msg="Instance operation lock finished" action=stop err="<nil>" instance=mw2022-ivm-cxv01 project=default reusable=false
time="2022-12-06T06:43:52-05:00" level=debug msg="Stop finished" instance=mw2022-ivm-cxv01 instanceType=virtual-machine project=default stateful=false
time="2022-12-06T06:43:52-05:00" level=debug msg="Success for operation" class=task description="Stopping instance" operation=1bdf1516-b257-4385-8eb5-d8b3de9bbf0a project=default
time="2022-12-06T06:43:52-05:00" level=debug msg="Event listener server handler stopped" listener=deb07053-cb22-4a0e-9a81-11acb31c2d4e local=/var/snap/lxd/common/lxd/unix.socket remote=@
time="2022-12-06T06:43:53-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:53-05:00" level=debug msg="Send seccomp notification for id(14489745358209193184)"
time="2022-12-06T06:43:53-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193184 seccomp_notify_mem_fd=67 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:54-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:54-05:00" level=debug msg="Send seccomp notification for id(14489745358209193185)"
time="2022-12-06T06:43:54-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193185 seccomp_notify_mem_fd=67 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:55-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:55-05:00" level=debug msg="Send seccomp notification for id(14489745358209193186)"
time="2022-12-06T06:43:55-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193186 seccomp_notify_mem_fd=67 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:55-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:55-05:00" level=debug msg="Send seccomp notification for id(14489745358209193187)"
time="2022-12-06T06:43:55-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193187 seccomp_notify_mem_fd=67 seccomp_notify_pid=1397622 syscall_number=99
time="2022-12-06T06:43:55-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:55-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193188 seccomp_notify_mem_fd=67 seccomp_notify_pid=1397623 syscall_number=99
time="2022-12-06T06:43:55-05:00" level=debug msg="Send seccomp notification for id(14489745358209193188)"
time="2022-12-06T06:43:56-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:56-05:00" level=debug msg="Send seccomp notification for id(14489745358209193189)"
time="2022-12-06T06:43:56-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193189 seccomp_notify_mem_fd=67 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:57-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:57-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193190 seccomp_notify_mem_fd=67 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:57-05:00" level=debug msg="Send seccomp notification for id(14489745358209193190)"
time="2022-12-06T06:43:57-05:00" level=debug msg="Starting heartbeat round" local="us2204-iph-lxd03.domain.tld:8443" mode=normal
time="2022-12-06T06:43:57-05:00" level=debug msg="Heartbeat updating local raft members" members="[{{1 us2204-iph-lxd03.domain.tld:8443 voter} us2204-iph-lxd03.domain.tld}]"
time="2022-12-06T06:43:57-05:00" level=debug msg="Completed heartbeat round" duration=5.034611ms local="us2204-iph-lxd03.domain.tld:8443"
time="2022-12-06T06:43:58-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:58-05:00" level=debug msg="Send seccomp notification for id(14489745358209193191)"
time="2022-12-06T06:43:58-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193191 seccomp_notify_mem_fd=67 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:43:59-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:43:59-05:00" level=debug msg="Send seccomp notification for id(14489745358209193192)"
time="2022-12-06T06:43:59-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193192 seccomp_notify_mem_fd=67 seccomp_notify_pid=618570 syscall_number=99
time="2022-12-06T06:44:00-05:00" level=debug msg="Syscall handler received fds 63(/proc/<pid>), 67(/proc/<pid>/mem), and 70([seccomp notify])"
time="2022-12-06T06:44:00-05:00" level=debug msg="Send seccomp notification for id(14489745358209193193)"
time="2022-12-06T06:44:00-05:00" level=debug msg="Handling sysinfo syscall" audit_architecture=3221225534 container=us2204-isc-vtm01 project="{{map[features.images:true features.networks:true features.profiles:true features.storage.buckets:true features.storage.volumes:true] Default LXD project} default []}" seccomp_notify_fd=70 seccomp_notify_flags=0 seccomp_notify_id=14489745358209193193 seccomp_notify_mem_fd=67 seccomp_notify_pid=618570 syscall_number=99
tomponline commented 1 year ago

Hrm weird, well good I suppose. Does it only break if you dont use -f with lxc stop?

For any remaining VMs with connectivity issues, please can you run on the host sudo tcpdump -i <associated macvlan interface from volatile.eth0.host_name> -nn and then generate some traffic inside the VM.

Can you see if you are getting any traffic to the macvlan interface on the host?

markrattray commented 1 year ago

Well I rarely use -f in case of corruption so in this scenario I use the LXD Console to get into the Windows VM and reboot it normally... and they wont start unless I go an and delete the interface. Generally I've not had much success using lxc restart / stop with the Windows & BSD VMs (nothing happens) so don't use the commands for them, however it naturally works pretty well with Linux Containers and VMs.

FYI... the reason for MACVLAN is that this project is a migration/switch from vSphere (ESXi) to LXD so needed the MACVLAN interfaces to work with existing network devices, topology and infrastructure, and then was going to try to deploy OVN in stage 2.

Dynamic Address

For the tcpdump, I've used another Windows VM that's not available on the network. Started the tcpdump command on the host and then via the LXD Console pinged 8.8.8.8 in the VM. Unfortunately it has lost its DHCP IP so not much going on in there.

Windows VM: ping 8.8.8.8

Pinging 8.8.8.8 with 32 bytes of data:
PING: transmit failure. General failure.
PING: transmit failure. General failure.
PING: transmit failure. General failure.
PING: transmit failure. General failure.

tcpdump -i mac51fd35aa -nn

10:59:17.274496 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:17.434857 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:17.481289 IP 192.168.0.32.50951 > 224.0.0.252.5355: UDP, length 27
10:59:17.481452 IP 192.168.0.32.54663 > 224.0.0.252.5355: UDP, length 27
10:59:17.627102 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:17.629021 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:17.840831 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:17.965629 IP 192.168.0.32.50592 > 239.255.255.250.1900: UDP, length 174
10:59:18.059595 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:18.059625 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:18.097079 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:18.298759 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:18.622036 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:18.654997 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:18.981229 IP 192.168.0.32.50592 > 239.255.255.250.1900: UDP, length 174
10:59:19.117297 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:19.322584 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:19.675009 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:19.796639 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:19.796909 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:19.796909 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:19.797137 IP 192.168.0.33.65040 > 224.0.0.252.5355: UDP, length 27
10:59:19.797248 IP 192.168.0.33.64264 > 224.0.0.252.5355: UDP, length 27
10:59:20.141119 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:20.213771 IP 192.168.0.33.65040 > 224.0.0.252.5355: UDP, length 27
10:59:20.213834 IP 192.168.0.33.64264 > 224.0.0.252.5355: UDP, length 27
10:59:20.346602 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:20.588837 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:20.593457 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:20.593656 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:20.593854 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:20.594395 IP 192.168.0.32.53601 > 224.0.0.252.5355: UDP, length 27
10:59:20.594717 IP 192.168.0.32.65288 > 224.0.0.252.5355: UDP, length 27
10:59:20.699113 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:20.744654 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:20.744805 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:20.745264 IP 192.168.0.34.54940 > 224.0.0.252.5355: UDP, length 27
10:59:20.745553 IP 192.168.0.34.51971 > 224.0.0.252.5355: UDP, length 27
10:59:20.745678 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:20.792403 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:20.792980 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:21.012582 IP 192.168.0.32.65288 > 224.0.0.252.5355: UDP, length 27
10:59:21.012626 IP 192.168.0.32.53601 > 224.0.0.252.5355: UDP, length 27
10:59:21.161446 IP 192.168.0.34.51971 > 224.0.0.252.5355: UDP, length 27
10:59:21.161620 IP 192.168.0.34.54940 > 224.0.0.252.5355: UDP, length 27
10:59:21.165064 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:21.370556 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:21.402028 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:21.403178 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:21.521119 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:21.606553 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:21.606616 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:21.722996 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:21.739699 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:21.739921 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:22.029796 IP 192.168.0.87.61410 > 239.255.255.250.1900: UDP, length 175
10:59:22.168976 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:22.189402 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:22.235047 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:22.235136 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:22.235385 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:22.235701 IP 192.168.0.32.64982 > 224.0.0.252.5355: UDP, length 27
10:59:22.235910 IP 192.168.0.32.57997 > 224.0.0.252.5355: UDP, length 27
10:59:22.317470 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:22.352190 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:22.352475 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:22.353039 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:22.354053 IP 192.168.0.240.53121 > 224.0.0.252.5355: UDP, length 27
10:59:22.354818 IP 192.168.0.240.49296 > 224.0.0.252.5355: UDP, length 27
10:59:22.394506 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:22.653281 IP 192.168.0.32.64982 > 224.0.0.252.5355: UDP, length 27
10:59:22.653281 IP 192.168.0.32.57997 > 224.0.0.252.5355: UDP, length 27
10:59:22.751021 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:22.756392 IP 192.168.0.240.49296 > 224.0.0.252.5355: UDP, length 27
10:59:22.756534 IP 192.168.0.240.53121 > 224.0.0.252.5355: UDP, length 27
10:59:22.997131 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:23.042462 IP 192.168.0.87.61410 > 239.255.255.250.1900: UDP, length 175
10:59:23.090197 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:23.090363 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:23.090500 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:23.091004 IP 192.168.0.34.55992 > 224.0.0.252.5355: UDP, length 27
10:59:23.091338 IP 192.168.0.34.61909 > 224.0.0.252.5355: UDP, length 27
10:59:23.098571 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:23.212327 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:23.212576 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:23.212577 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:23.212768 IP 192.168.0.241.57827 > 224.0.0.252.5355: UDP, length 27
10:59:23.212940 IP 192.168.0.241.64221 > 224.0.0.252.5355: UDP, length 27
10:59:23.213088 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:23.247066 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:23.247123 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:23.397389 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:23.397750 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:23.398327 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:23.399529 IP 192.168.0.20.59872 > 224.0.0.252.5355: UDP, length 27
10:59:23.400192 IP 192.168.0.20.53548 > 224.0.0.252.5355: UDP, length 27
10:59:23.418548 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:23.505320 IP 192.168.0.34.61909 > 224.0.0.252.5355: UDP, length 27
10:59:23.505444 IP 192.168.0.34.55992 > 224.0.0.252.5355: UDP, length 27
10:59:23.621627 IP 192.168.0.241.64221 > 224.0.0.252.5355: UDP, length 27
10:59:23.621627 IP 192.168.0.241.57827 > 224.0.0.252.5355: UDP, length 27
10:59:23.762773 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:23.771107 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:23.797261 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:23.797349 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:23.797505 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:23.797783 IP 192.168.0.32.49911 > 224.0.0.252.5355: UDP, length 27
10:59:23.798026 IP 192.168.0.32.55608 > 224.0.0.252.5355: UDP, length 27
10:59:23.810067 IP 192.168.0.20.53548 > 224.0.0.252.5355: UDP, length 27
10:59:23.810182 IP 192.168.0.20.59872 > 224.0.0.252.5355: UDP, length 27
10:59:23.833639 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:23.856814 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:23.964608 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:24.059026 IP 192.168.0.87.61410 > 239.255.255.250.1900: UDP, length 175
10:59:24.083895 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:24.084344 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:24.150201 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:24.214641 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:24.215774 IP 192.168.0.32.55608 > 224.0.0.252.5355: UDP, length 27
10:59:24.215793 IP 192.168.0.32.49911 > 224.0.0.252.5355: UDP, length 27
10:59:24.237122 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:24.398318 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:24.398565 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:24.442596 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:24.559635 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:24.614965 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:24.727160 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:24.794045 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:24.794070 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:24.794997 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:24.907492 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:25.069256 IP 192.168.0.87.61410 > 239.255.255.250.1900: UDP, length 175
10:59:25.261360 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:25.309681 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:25.466546 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:25.672337 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:25.672541 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:25.672637 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:25.673240 IP 192.168.0.20.51346 > 224.0.0.252.5355: UDP, length 27
10:59:25.673511 IP 192.168.0.20.61918 > 224.0.0.252.5355: UDP, length 27
10:59:25.818997 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:26.084089 IP 192.168.0.20.61918 > 224.0.0.252.5355: UDP, length 27
10:59:26.084132 IP 192.168.0.20.51346 > 224.0.0.252.5355: UDP, length 27
10:59:26.285232 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:26.461724 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:26.490492 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:26.673534 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:26.674080 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:26.843156 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:27.177562 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:27.177905 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:27.177905 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:27.178145 IP 192.168.0.33.54049 > 224.0.0.252.5355: UDP, length 27
10:59:27.178310 IP 192.168.0.33.65306 > 224.0.0.252.5355: UDP, length 27
10:59:27.235343 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:27.309145 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:27.514568 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:27.579341 IP 192.168.0.20.61919 > 239.255.255.250.1900: UDP, length 175
10:59:27.595003 IP 192.168.0.33.65306 > 224.0.0.252.5355: UDP, length 27
10:59:27.595087 IP 192.168.0.33.54049 > 224.0.0.252.5355: UDP, length 27
10:59:27.867002 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:27.921589 ARP, Request who-has 192.168.0.120 tell 192.168.0.1, length 46
10:59:27.954397 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:28.173166 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:28.173451 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:28.333439 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:28.538557 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:28.587993 IP 192.168.0.20.61919 > 239.255.255.250.1900: UDP, length 175
10:59:28.735900 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:28.891001 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:29.357188 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:29.532351 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:29.532351 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:29.532495 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:29.532793 IP 192.168.0.32.59082 > 224.0.0.252.5355: UDP, length 27
10:59:29.533025 IP 192.168.0.32.50257 > 224.0.0.252.5355: UDP, length 27
10:59:29.562449 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:29.595898 IP 192.168.0.20.61919 > 239.255.255.250.1900: UDP, length 175
10:59:29.658894 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:29.659148 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:29.660824 IP 192.168.0.240.55331 > 224.0.0.252.5355: UDP, length 27
10:59:29.660850 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:29.661406 IP 192.168.0.240.51640 > 224.0.0.252.5355: UDP, length 27
10:59:29.915099 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:29.950313 IP 192.168.0.32.59082 > 224.0.0.252.5355: UDP, length 27
10:59:29.950313 IP 192.168.0.32.50257 > 224.0.0.252.5355: UDP, length 27
10:59:30.074182 IP 192.168.0.240.51640 > 224.0.0.252.5355: UDP, length 27
10:59:30.074334 IP 192.168.0.240.55331 > 224.0.0.252.5355: UDP, length 27
10:59:30.294218 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:30.381183 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:30.398239 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:30.398470 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:30.398820 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:30.400359 IP 192.168.0.34.55427 > 224.0.0.252.5355: UDP, length 27
10:59:30.401680 IP 192.168.0.34.53978 > 224.0.0.252.5355: UDP, length 27
10:59:30.421213 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:30.493230 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:30.493459 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:30.493460 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:30.493837 IP 192.168.0.241.56922 > 224.0.0.252.5355: UDP, length 27
10:59:30.494041 IP 192.168.0.241.58814 > 224.0.0.252.5355: UDP, length 27
10:59:30.544214 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:30.544270 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:30.586553 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:30.603895 IP 192.168.0.20.61919 > 239.255.255.250.1900: UDP, length 175
10:59:30.671421 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:30.672499 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:30.808763 IP 192.168.0.34.53978 > 224.0.0.252.5355: UDP, length 27
10:59:30.808828 IP 192.168.0.34.55427 > 224.0.0.252.5355: UDP, length 27
10:59:30.914336 IP 192.168.0.241.58814 > 224.0.0.252.5355: UDP, length 27
10:59:30.914366 IP 192.168.0.241.56922 > 224.0.0.252.5355: UDP, length 27
10:59:30.939001 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:31.059834 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:31.168352 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:31.190330 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:31.254645 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:31.402871 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:31.403298 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:31.405316 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:31.491143 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:31.610491 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:31.965172 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:31.966996 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:32.014859 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:32.429221 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:32.447576 IP6 fe80::216:3eff:fe6b:f6a2 > ff02::2: ICMP6, router solicitation, length 16
10:59:32.450024 IP 192.168.0.77.54170 > 239.255.255.250.1900: UDP, length 175
10:59:32.634509 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:32.987104 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:33.001533 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:33.002159 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:33.002362 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:33.004100 IP 192.168.0.20.50751 > 224.0.0.252.5355: UDP, length 27
10:59:33.005072 IP 192.168.0.20.51626 > 224.0.0.252.5355: UDP, length 27
10:59:33.414695 IP 192.168.0.20.51626 > 224.0.0.252.5355: UDP, length 27
10:59:33.414858 IP 192.168.0.20.50751 > 224.0.0.252.5355: UDP, length 27
10:59:33.453221 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:33.456819 IP 192.168.0.77.54170 > 239.255.255.250.1900: UDP, length 175
10:59:33.658571 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:33.762539 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:34.002158 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:34.002984 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:34.010992 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:34.465144 IP 192.168.0.77.54170 > 239.255.255.250.1900: UDP, length 175
10:59:34.481425 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:34.500994 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:34.501249 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:34.501724 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:34.502988 IP 192.168.0.33.50851 > 224.0.0.252.5355: UDP, length 27
10:59:34.503904 IP 192.168.0.33.63958 > 224.0.0.252.5355: UDP, length 27
10:59:34.527621 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:34.682477 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:34.912148 IP 192.168.0.33.63958 > 224.0.0.252.5355: UDP, length 27
10:59:34.912265 IP 192.168.0.33.50851 > 224.0.0.252.5355: UDP, length 27
10:59:35.035006 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:35.271650 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:35.471228 IP 192.168.0.77.54170 > 239.255.255.250.1900: UDP, length 175
10:59:35.490547 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:35.491182 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:35.501256 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:35.619591 ARP, Request who-has 192.168.0.54 tell 192.168.0.53, length 46
10:59:35.706488 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:36.021481 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:36.525267 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:36.730574 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:36.802705 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:36.802980 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:36.803283 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:36.804677 IP 192.168.0.33.54313 > 224.0.0.252.5355: UDP, length 27
10:59:36.805552 IP 192.168.0.33.62456 > 224.0.0.252.5355: UDP, length 27
10:59:36.828804 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:36.828965 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:36.829045 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:36.829326 IP 192.168.0.32.58619 > 224.0.0.252.5355: UDP, length 27
10:59:36.829549 IP 192.168.0.32.52622 > 224.0.0.252.5355: UDP, length 27
10:59:36.963886 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:36.964730 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:36.965982 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:36.967962 IP 192.168.0.240.53122 > 224.0.0.252.5355: UDP, length 27
10:59:36.969298 IP 192.168.0.240.51370 > 224.0.0.252.5355: UDP, length 27
10:59:37.224490 IP 192.168.0.33.62456 > 224.0.0.252.5355: UDP, length 27
10:59:37.224616 IP 192.168.0.33.54313 > 224.0.0.252.5355: UDP, length 27
10:59:37.247328 IP 192.168.0.32.52622 > 224.0.0.252.5355: UDP, length 27
10:59:37.247361 IP 192.168.0.32.58619 > 224.0.0.252.5355: UDP, length 27
10:59:37.386795 IP 192.168.0.240.53122 > 224.0.0.252.5355: UDP, length 27
10:59:37.386795 IP 192.168.0.240.51370 > 224.0.0.252.5355: UDP, length 27
10:59:37.516371 IP 192.168.0.69.54831 > 239.255.255.250.1900: UDP, length 175
10:59:37.549441 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:37.568340 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:37.575468 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:37.715339 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:37.754477 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:37.780873 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:37.780979 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:37.781121 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:37.781432 IP 192.168.0.241.62087 > 224.0.0.252.5355: UDP, length 27
10:59:37.781660 IP 192.168.0.241.57159 > 224.0.0.252.5355: UDP, length 27
10:59:37.790253 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:37.790448 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:37.790937 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:37.792010 IP 192.168.0.34.61040 > 224.0.0.252.5355: UDP, length 27
10:59:37.792897 IP 192.168.0.34.63858 > 224.0.0.252.5355: UDP, length 27
10:59:37.818525 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:37.818796 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:37.841120 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:37.841295 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:37.966021 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:38.201060 IP 192.168.0.241.62087 > 224.0.0.252.5355: UDP, length 27
10:59:38.201060 IP 192.168.0.241.57159 > 224.0.0.252.5355: UDP, length 27
10:59:38.201450 IP 192.168.0.34.61040 > 224.0.0.252.5355: UDP, length 27
10:59:38.201593 IP 192.168.0.34.63858 > 224.0.0.252.5355: UDP, length 27
10:59:38.341148 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:38.365380 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
10:59:38.466697 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
10:59:38.529595 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:38.530590 IP 192.168.0.69.54831 > 239.255.255.250.1900: UDP, length 175
10:59:38.568023 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:38.573241 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:38.778487 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:38.778513 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:38.783989 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:39.095929 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:39.096029 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:39.096161 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:39.096480 IP 192.168.0.32.61913 > 224.0.0.252.5355: UDP, length 27
10:59:39.096725 IP 192.168.0.32.57582 > 224.0.0.252.5355: UDP, length 27
10:59:39.283511 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
10:59:39.323262 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
10:59:39.513057 IP 192.168.0.32.61913 > 224.0.0.252.5355: UDP, length 27
10:59:39.513075 IP 192.168.0.32.57582 > 224.0.0.252.5355: UDP, length 27
10:59:39.546630 IP 192.168.0.69.54831 > 239.255.255.250.1900: UDP, length 175
10:59:39.597304 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:39.802578 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:39.841296 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:40.091449 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:40.306272 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:40.306699 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:40.307203 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:40.308354 IP 192.168.0.20.50926 > 224.0.0.252.5355: UDP, length 27
10:59:40.309217 IP 192.168.0.20.64112 > 224.0.0.252.5355: UDP, length 27
10:59:40.553257 IP 192.168.0.69.54831 > 239.255.255.250.1900: UDP, length 175
10:59:40.561126 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:40.606906 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
10:59:40.621460 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:40.719358 IP 192.168.0.20.50926 > 224.0.0.252.5355: UDP, length 27
10:59:40.720172 IP 192.168.0.20.64112 > 224.0.0.252.5355: UDP, length 27
10:59:40.826461 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:41.067677 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:41.306786 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
10:59:41.307212 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
10:59:41.562997 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:41.645331 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
10:59:41.650594 IP 192.168.0.88.50912 > 239.255.255.250.1900: UDP, length 175
10:59:41.829953 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
10:59:41.850460 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
10:59:42.130452 IP6 fe80::250:56ff:febc:9548 > ff02::2: ICMP6, router solicitation, length 16
10:59:42.587029 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
10:59:42.657757 IP 192.168.0.88.50912 > 239.255.255.250.1900: UDP, length 175
10:59:42.669277 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46

Static address

I thought to try give the WIndows VM a static address of 192.168.0.100 and then try ping a server that will respond on the network 192.168.0.10, while a new tcpdump session running. It didn't help.

Windows VM: ping 192.168.0.10

Reply from 192.168.0.100: Destination host unreachable
Reply from 192.168.0.100: Destination host unreachable
Reply from 192.168.0.100: Destination host unreachable
Reply from 192.168.0.100: Destination host unreachable

tcpdump -i mac51fd35aa -nn

11:36:06.486994 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:06.487094 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:06.487238 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:06.487549 IP 192.168.0.32.52254 > 224.0.0.252.5355: UDP, length 27
11:36:06.487767 IP 192.168.0.32.58327 > 224.0.0.252.5355: UDP, length 27
11:36:06.500903 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:06.690190 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:06.808512 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:06.809493 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:06.809932 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:06.810417 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:06.811447 IP 192.168.0.20.61220 > 224.0.0.252.5355: UDP, length 27
11:36:06.812051 IP 192.168.0.20.52847 > 224.0.0.252.5355: UDP, length 27
11:36:06.814914 IP 192.168.0.240.64412 > 224.0.0.252.5355: UDP, length 27
11:36:06.815096 IP 192.168.0.240.56827 > 224.0.0.252.5355: UDP, length 27
11:36:06.870072 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:06.905332 IP 192.168.0.32.52254 > 224.0.0.252.5355: UDP, length 27
11:36:06.905332 IP 192.168.0.32.58327 > 224.0.0.252.5355: UDP, length 27
11:36:07.092182 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:07.145524 ARP, Request who-has 192.168.0.137 tell 192.168.0.35, length 46
11:36:07.156612 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:07.222089 IP 192.168.0.20.61220 > 224.0.0.252.5355: UDP, length 27
11:36:07.222936 IP 192.168.0.20.52847 > 224.0.0.252.5355: UDP, length 27
11:36:07.233276 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:07.271943 IP 192.168.0.76.49910 > 239.255.255.250.1900: UDP, length 175
11:36:07.407483 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:07.499059 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:07.499095 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:07.583820 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:07.810624 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:07.811410 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:07.838989 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:07.894182 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:07.910438 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:07.998925 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:08.115983 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:08.142776 ARP, Request who-has 192.168.0.137 tell 192.168.0.35, length 46
11:36:08.281820 IP 192.168.0.76.49910 > 239.255.255.250.1900: UDP, length 175
11:36:08.344059 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:08.858988 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:08.917961 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:09.139986 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:09.288017 IP 192.168.0.76.49910 > 239.255.255.250.1900: UDP, length 175
11:36:09.303720 IP 192.168.0.59.5353 > 224.0.0.251.5353: 0 PTR (QM)? _googlecast._tcp.local. (40)
11:36:09.883102 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:09.936107 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:09.936375 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:09.936550 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:09.937085 IP 192.168.0.34.64961 > 224.0.0.252.5355: UDP, length 27
11:36:09.937462 IP 192.168.0.34.60003 > 224.0.0.252.5355: UDP, length 27
11:36:09.941929 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:10.164110 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:10.346357 IP 192.168.0.34.64961 > 224.0.0.252.5355: UDP, length 27
11:36:10.346520 IP 192.168.0.34.60003 > 224.0.0.252.5355: UDP, length 27
11:36:10.692703 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:10.907020 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:10.927358 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:10.927437 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:10.966067 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:11.188030 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:11.403861 ARP, Request who-has 192.168.0.137 tell 192.168.0.35, length 46
11:36:11.473980 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:11.931013 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:11.989994 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:12.029854 ARP, Request who-has 192.168.0.47 tell 192.168.0.1, length 46
11:36:12.042465 IP 192.168.0.76.138 > 192.168.0.255.138: UDP, length 201
11:36:12.137786 ARP, Request who-has 192.168.0.137 tell 192.168.0.35, length 46
11:36:12.212068 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:12.282771 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:12.282853 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:12.283494 IP 192.168.0.33.60606 > 224.0.0.252.5355: UDP, length 27
11:36:12.283925 IP 192.168.0.33.56550 > 224.0.0.252.5355: UDP, length 27
11:36:12.284041 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:12.458909 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:12.459033 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:12.459033 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:12.459317 IP 192.168.0.241.59859 > 224.0.0.252.5355: UDP, length 27
11:36:12.459628 IP 192.168.0.241.55856 > 224.0.0.252.5355: UDP, length 27
11:36:12.697499 IP 192.168.0.33.56550 > 224.0.0.252.5355: UDP, length 27
11:36:12.697499 IP 192.168.0.33.60606 > 224.0.0.252.5355: UDP, length 27
11:36:12.873201 IP 192.168.0.241.59859 > 224.0.0.252.5355: UDP, length 27
11:36:12.873229 IP 192.168.0.241.55856 > 224.0.0.252.5355: UDP, length 27
11:36:13.014003 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:13.072195 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:13.140831 ARP, Request who-has 192.168.0.137 tell 192.168.0.35, length 46
11:36:13.216954 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:13.236125 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:13.280146 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:13.280198 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:13.467318 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:13.683205 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:13.683452 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:13.684010 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:13.685120 IP 192.168.0.240.58407 > 224.0.0.252.5355: UDP, length 27
11:36:13.685987 IP 192.168.0.240.52774 > 224.0.0.252.5355: UDP, length 27
11:36:13.783878 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:13.784149 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:13.784538 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:13.784957 IP 192.168.0.32.56974 > 224.0.0.252.5355: UDP, length 27
11:36:13.785305 IP 192.168.0.32.54153 > 224.0.0.252.5355: UDP, length 27
11:36:13.846641 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:13.975254 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:14.038127 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:14.096624 IP 192.168.0.240.52774 > 224.0.0.252.5355: UDP, length 27
11:36:14.096661 IP 192.168.0.240.58407 > 224.0.0.252.5355: UDP, length 27
11:36:14.125693 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:14.125929 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:14.125929 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:14.126310 IP 192.168.0.20.50612 > 224.0.0.252.5355: UDP, length 27
11:36:14.126649 IP 192.168.0.20.61359 > 224.0.0.252.5355: UDP, length 27
11:36:14.202162 IP 192.168.0.32.56974 > 224.0.0.252.5355: UDP, length 27
11:36:14.202162 IP 192.168.0.32.54153 > 224.0.0.252.5355: UDP, length 27
11:36:14.260043 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:14.429774 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:14.530409 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:14.537093 IP 192.168.0.20.50612 > 224.0.0.252.5355: UDP, length 27
11:36:14.537254 IP 192.168.0.20.61359 > 224.0.0.252.5355: UDP, length 27
11:36:14.685995 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:14.796156 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:14.796224 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:14.882501 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:15.061945 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:15.126278 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:15.126436 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:15.194034 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:15.284035 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:15.296032 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:15.639771 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:16.085958 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:16.137166 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:16.308142 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:16.404579 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:16.405110 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:16.405809 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:16.407068 IP 192.168.0.20.60375 > 224.0.0.252.5355: UDP, length 27
11:36:16.407640 IP 192.168.0.20.52522 > 224.0.0.252.5355: UDP, length 27
11:36:16.817921 IP 192.168.0.20.60375 > 224.0.0.252.5355: UDP, length 27
11:36:16.819287 IP 192.168.0.20.52522 > 224.0.0.252.5355: UDP, length 27
11:36:17.110185 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:17.145173 ARP, Request who-has 192.168.0.137 tell 192.168.0.36, length 46
11:36:17.146999 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:17.164010 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:17.258395 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:17.259274 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:17.259711 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:17.261241 IP 192.168.0.34.56328 > 224.0.0.252.5355: UDP, length 27
11:36:17.262126 IP 192.168.0.34.57878 > 224.0.0.252.5355: UDP, length 27
11:36:17.332079 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:17.405021 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:17.405619 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:17.672095 IP 192.168.0.34.57878 > 224.0.0.252.5355: UDP, length 27
11:36:17.672251 IP 192.168.0.34.56328 > 224.0.0.252.5355: UDP, length 27
11:36:17.918568 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:18.015351 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:18.133978 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:18.170989 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:18.250269 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:18.250721 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:18.356096 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:18.812623 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:19.158045 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:19.195102 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:19.380135 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:19.656727 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:19.656928 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:19.657860 IP 192.168.0.33.52376 > 224.0.0.252.5355: UDP, length 27
11:36:19.658346 IP 192.168.0.33.52632 > 224.0.0.252.5355: UDP, length 27
11:36:19.658501 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:19.744413 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:19.744627 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:19.744627 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:19.744807 IP 192.168.0.241.62373 > 224.0.0.252.5355: UDP, length 27
11:36:19.745007 IP 192.168.0.241.51511 > 224.0.0.252.5355: UDP, length 27
11:36:20.070990 IP 192.168.0.33.52376 > 224.0.0.252.5355: UDP, length 27
11:36:20.071063 IP 192.168.0.33.52632 > 224.0.0.252.5355: UDP, length 27
11:36:20.166107 IP 192.168.0.241.62373 > 224.0.0.252.5355: UDP, length 27
11:36:20.166107 IP 192.168.0.241.51511 > 224.0.0.252.5355: UDP, length 27
11:36:20.182135 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:20.222992 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:20.399177 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:20.404074 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:20.497514 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:20.664920 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:20.665078 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:20.743059 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:20.983404 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:20.983606 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:20.983989 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:20.985161 IP 192.168.0.240.61236 > 224.0.0.252.5355: UDP, length 27
11:36:20.985889 IP 192.168.0.240.61003 > 224.0.0.252.5355: UDP, length 27
11:36:21.094306 IP 192.168.0.76.58727 > 239.255.255.250.1900: UDP, length 175
11:36:21.112922 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:21.113109 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:21.113260 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:21.113601 IP 192.168.0.32.58925 > 224.0.0.252.5355: UDP, length 27
11:36:21.113815 IP 192.168.0.32.56677 > 224.0.0.252.5355: UDP, length 27
11:36:21.205932 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:21.211414 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:21.242997 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:21.260548 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:21.384988 IP 192.168.0.240.61003 > 224.0.0.252.5355: UDP, length 27
11:36:21.385031 IP 192.168.0.240.61236 > 224.0.0.252.5355: UDP, length 27
11:36:21.407847 ARP, Request who-has 192.168.0.137 tell 192.168.0.35, length 46
11:36:21.428111 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:21.530488 IP 192.168.0.32.58925 > 224.0.0.252.5355: UDP, length 27
11:36:21.530488 IP 192.168.0.32.56677 > 224.0.0.252.5355: UDP, length 27
11:36:21.679573 ARP, Request who-has 192.168.0.137 tell 192.168.0.36, length 46
11:36:21.727107 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:21.874375 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:21.983446 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:22.096299 IP 192.168.0.76.58727 > 239.255.255.250.1900: UDP, length 175
11:36:22.124363 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:22.124456 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:22.136210 ARP, Request who-has 192.168.0.137 tell 192.168.0.35, length 46
11:36:22.229977 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:22.267191 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:22.452200 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:22.496415 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:22.639993 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:22.649317 ARP, Request who-has 192.168.0.137 tell 192.168.0.36, length 46
11:36:22.924827 IP6 fe80::216:3eff:fe52:691a > ff02::2: ICMP6, router solicitation, length 16
11:36:23.103520 IP 192.168.0.76.58727 > 239.255.255.250.1900: UDP, length 175
11:36:23.142205 ARP, Request who-has 192.168.0.137 tell 192.168.0.35, length 46
11:36:23.254119 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:23.294986 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:23.476145 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:23.651473 ARP, Request who-has 192.168.0.137 tell 192.168.0.36, length 46
11:36:23.689856 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:23.690394 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:23.691487 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:23.692725 IP 192.168.0.20.59322 > 224.0.0.252.5355: UDP, length 27
11:36:23.693592 IP 192.168.0.20.60349 > 224.0.0.252.5355: UDP, length 27
11:36:24.103877 IP 192.168.0.20.59322 > 224.0.0.252.5355: UDP, length 27
11:36:24.104468 IP 192.168.0.20.60349 > 224.0.0.252.5355: UDP, length 27
11:36:24.104647 IP 192.168.0.76.58727 > 239.255.255.250.1900: UDP, length 175
11:36:24.180247 IP 192.168.0.20.60350 > 239.255.255.250.1900: UDP, length 175
11:36:24.278020 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:24.314986 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:24.441882 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:24.500153 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:24.583347 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:24.584069 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:24.584678 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:24.585574 IP 192.168.0.34.64259 > 224.0.0.252.5355: UDP, length 27
11:36:24.586520 IP 192.168.0.34.53384 > 224.0.0.252.5355: UDP, length 27
11:36:24.691227 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:24.691688 IP 192.168.0.20.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:24.995474 IP 192.168.0.34.53384 > 224.0.0.252.5355: UDP, length 27
11:36:24.995625 IP 192.168.0.34.64259 > 224.0.0.252.5355: UDP, length 27
11:36:25.180680 IP 192.168.0.20.60350 > 239.255.255.250.1900: UDP, length 175
11:36:25.198918 IP 192.168.0.20.137 > 192.168.0.255.137: UDP, length 50
11:36:25.301991 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:25.324766 ARP, Request who-has 192.168.0.128 tell 192.168.0.1, length 46
11:36:25.343169 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:25.351136 IP 192.168.0.81.56240 > 239.255.255.250.1900: UDP, length 175
11:36:25.354664 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:25.524174 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:25.573843 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:25.574382 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:25.579061 IP 192.168.0.76.55339 > 239.255.255.250.1900: UDP, length 175
11:36:26.104871 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:26.181711 IP 192.168.0.20.60350 > 239.255.255.250.1900: UDP, length 175
11:36:26.326163 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:26.362991 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:26.364465 IP 192.168.0.81.56240 > 239.255.255.250.1900: UDP, length 175
11:36:26.548124 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:26.591215 IP 192.168.0.76.55339 > 239.255.255.250.1900: UDP, length 175
11:36:26.899874 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:26.901587 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:26.901587 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:26.901811 IP 192.168.0.34.57274 > 224.0.0.252.5355: UDP, length 27
11:36:26.902595 IP 192.168.0.34.54591 > 224.0.0.252.5355: UDP, length 27
11:36:27.016850 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:27.017064 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:27.017064 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:27.017344 IP 192.168.0.241.49939 > 224.0.0.252.5355: UDP, length 27
11:36:27.017534 IP 192.168.0.241.63202 > 224.0.0.252.5355: UDP, length 27
11:36:27.034019 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:27.034234 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:27.034610 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:27.035680 IP 192.168.0.33.58247 > 224.0.0.252.5355: UDP, length 27
11:36:27.036321 IP 192.168.0.33.59779 > 224.0.0.252.5355: UDP, length 27
11:36:27.190192 IP 192.168.0.20.60350 > 239.255.255.250.1900: UDP, length 175
11:36:27.323066 IP 192.168.0.34.54591 > 224.0.0.252.5355: UDP, length 27
11:36:27.323136 IP 192.168.0.34.57274 > 224.0.0.252.5355: UDP, length 27
11:36:27.349899 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:27.364519 IP 192.168.0.81.56240 > 239.255.255.250.1900: UDP, length 175
11:36:27.386990 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:27.427635 IP 192.168.0.241.63202 > 224.0.0.252.5355: UDP, length 27
11:36:27.427652 IP 192.168.0.241.49939 > 224.0.0.252.5355: UDP, length 27
11:36:27.447235 IP 192.168.0.33.58247 > 224.0.0.252.5355: UDP, length 27
11:36:27.447275 IP 192.168.0.33.59779 > 224.0.0.252.5355: UDP, length 27
11:36:27.572139 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:27.591928 IP 192.168.0.76.55339 > 239.255.255.250.1900: UDP, length 175
11:36:27.651223 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:27.771428 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:27.806689 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:27.901535 IP 192.168.0.34.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:28.027342 IP 192.168.0.241.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:28.041281 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:28.041292 IP 192.168.0.33.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:28.239427 IP 192.168.0.77.137 > 192.168.0.255.137: UDP, length 50
11:36:28.241602 IP 192.168.0.77.5353 > 224.0.0.251.5353: 0 A (QM)? imtkdevccdc1.local. (36)
11:36:28.242448 IP 192.168.0.77.5353 > 224.0.0.251.5353: 0 AAAA (QM)? imtkdevccdc1.local. (36)
11:36:28.243337 IP 192.168.0.77.58449 > 224.0.0.252.5355: UDP, length 30
11:36:28.243934 IP 192.168.0.77.56042 > 224.0.0.252.5355: UDP, length 30
11:36:28.268042 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:28.268263 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:28.268615 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:28.269368 IP 192.168.0.240.61479 > 224.0.0.252.5355: UDP, length 27
11:36:28.270005 IP 192.168.0.240.54266 > 224.0.0.252.5355: UDP, length 27
11:36:28.374003 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:28.380133 IP 192.168.0.81.56240 > 239.255.255.250.1900: UDP, length 175
11:36:28.409672 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:28.409720 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:28.409859 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:28.410175 IP 192.168.0.32.59525 > 224.0.0.252.5355: UDP, length 27
11:36:28.410391 IP 192.168.0.32.57988 > 224.0.0.252.5355: UDP, length 27
11:36:28.411183 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:28.435792 IP 192.168.0.34.137 > 192.168.0.255.137: UDP, length 50
11:36:28.523593 IP 192.168.0.241.137 > 192.168.0.255.137: UDP, length 50
11:36:28.592277 IP 192.168.0.33.137 > 192.168.0.255.137: UDP, length 50
11:36:28.596176 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:28.600631 IP 192.168.0.76.55339 > 239.255.255.250.1900: UDP, length 175
11:36:28.654772 IP 192.168.0.77.56042 > 224.0.0.252.5355: UDP, length 30
11:36:28.654859 IP 192.168.0.77.58449 > 224.0.0.252.5355: UDP, length 30
11:36:28.682438 IP 192.168.0.240.54266 > 224.0.0.252.5355: UDP, length 27
11:36:28.682601 IP 192.168.0.240.61479 > 224.0.0.252.5355: UDP, length 27
11:36:28.827560 IP 192.168.0.32.57988 > 224.0.0.252.5355: UDP, length 27
11:36:28.827560 IP 192.168.0.32.59525 > 224.0.0.252.5355: UDP, length 27
11:36:28.991968 IP 192.168.0.77.137 > 192.168.0.255.137: UDP, length 50
11:36:29.019877 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50
11:36:29.171314 IP 192.168.0.32.137 > 192.168.0.255.137: UDP, length 50
11:36:29.242031 IP 192.168.0.77.5353 > 224.0.0.251.5353: 0 A (QM)? imtkdevccdc1.local. (36)
11:36:29.242540 IP 192.168.0.77.5353 > 224.0.0.251.5353: 0 AAAA (QM)? imtkdevccdc1.local. (36)
11:36:29.269977 IP 192.168.0.240.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:29.398210 ARP, Request who-has 192.168.0.26 tell 192.168.0.24, length 46
11:36:29.405906 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 A (QM)? someserver.local. (33)
11:36:29.405988 IP 192.168.0.32.5353 > 224.0.0.251.5353: 0 AAAA (QM)? someserver.local. (33)
11:36:29.434990 ARP, Request who-has 192.168.0.123 tell 192.168.0.166, length 28
11:36:29.620128 ARP, Request who-has 192.168.0.29 tell 192.168.0.27, length 46
11:36:29.769574 IP 192.168.0.77.137 > 192.168.0.255.137: UDP, length 50
11:36:29.779110 IP 192.168.0.240.137 > 192.168.0.255.137: UDP, length 50

Have a great evening!

tomponline commented 1 year ago

I've reproduced the issue! :)

Indeed it seems that restarting the LXD process causes VM macvlan links to break. The reason you saw it before was because the metrics scraper was causing a crash in LXD, now fixed, which was causing it to occur more often. But now you are only seeing it when snap refresh triggers a LXD reload.

I have a hunch that its something to do with the file handles we open for macvlan interfaces to pass into QEMU being left open in LXD. As in principle restarting the LXD process should not impact the macvlan interfaces in anyway as they are passed directly to QEMU.

tomponline commented 1 year ago

Confirmed this is the PR that introduced the issue https://github.com/lxc/lxd/pull/10876

markrattray commented 1 year ago

Oh wow. Congratulations for figuring that one out. This is wonderful news that we have a lead. Thank you Tom !!!

tomponline commented 1 year ago

Got a working PR with a fix, testing it fully now.

markrattray commented 1 year ago

Good afternoon. Thanks for the wonderful news. I was reading that PR and you have killed a few with one stone there. Great work!

Should I update the title of this to match your PR because it's got nothing to do with the issue ?:

macvlan NICs losing connectivity when LXD is reloaded

tomponline commented 1 year ago

Sounds good, thanks

tomponline commented 1 year ago

Added tests to catch regressions:

https://github.com/lxc/lxc-ci/pull/665

tomponline commented 1 year ago

The fix should be in LXD 5.9

tomponline commented 1 year ago

@markrattray does LXD 5.9 in latest/stable channel fix this? You'll need to do lxc restart <instance> first to get a fresh boot after upgrading LXD in order to get the fix.

markrattray commented 1 year ago

Good afternoon Tom

Thanks for checking in.

As soon as I heard it was in latest/candidate I:

So far so good! I'm pretty sure it's also done an auto refresh as well since then...

Last reboot (when I did the above procedure... timezone EST):

$ last | grep reboot
reboot   system boot  5.15.0-56-generi Mon Dec 12 05:58   still running

Snap info (now)... see the time in the refresh-date field

refresh-date: 2 days ago, at 20:14 EST
channels:
  latest/stable:    5.9-4e4cdc6   2022-12-14 (24121) 143MB -
  latest/candidate: 5.9-4e4cdc6   2022-12-12 (24121) 143MB -
  ...
installed:          5.9-4e4cdc6              (24121) 143MB -

Since you contacted me, I've now switched the channel back to latest/stable.

Funny, the stand-alone backup/storage server seemed fine all this time but it eventually happened on it as well so I did the same update procedure on it as well so it's also 5.9.

Thank you very much for your great work and excellent help !!!

markrattray commented 1 year ago

Might have been a few updates since the channel switch, but I wasn't tracking the actual version.... from syslog:

# grep "Stop reason is: snap refresh" /var/log/syslog
Dec 12 04:28:21 us2204-iph-lxd03lxd.daemon[4112723]: => Stop reason is: snap refresh
Dec 12 11:49:34 us2204-iph-lxd03lxd.daemon[2914828]: => Stop reason is: snap refresh
Dec 12 14:54:32 us2204-iph-lxd03lxd.daemon[4154430]: => Stop reason is: snap refresh
Dec 12 20:14:39 us2204-iph-lxd03lxd.daemon[1911528]: => Stop reason is: snap refresh