search

systemd / systemd

The systemd System and Service Manager
https://systemd.io
GNU General Public License v2.0
13.27k stars 3.79k forks source link

systemd-udevd: if the dependencies of events between parent and child devices should be lifted for this kind of network card with PCI bridge. #22457

Closed Jsfastsa closed 2 years ago

Jsfastsa commented 2 years ago

systemd version the issue has been seen with

[root@fedora ~]# systemctl --version systemd 249 (v249.4-2.fc35)

Used distribution

fedora35

Linux kernel version used (uname -a)

uname -a Linux fedora 5.14.10-300.fc35.x86_64 #1 SMP Thu Oct 7 20:48:44 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

CPU architecture issue was seen on

x86_64

Expected behaviour you didn't see

linux-QikjTj:~ # lspci -tv
-+-[0000:7c]---00.0-[7d]----00.0  
+-[0000:7b]-+-00.0  
|           +-01.0  
|           \-02.0  
+-[0000:74]-+-00.0-[75]----00.0  
|           +-01.0-[76]----00.0  
|           +-03.0  
|           \-04.0  
\-[0000:00]-+-00.0-[01-06]----00.0-[02-06]--+-00.0-[03]----00.0  
|                               +-01.0-[04]----00.0  
|                               +-02.0-[05]----00.0  
|                               \-03.0-[06]----00.0  
\-04.0-[07-11]----00.0-[08-11]--+-06.0-[09]----00.0  
+-07.0-[0a]----00.0 
+-08.0-[0b]----00.0  
+-09.0-[0c]----00.0  
+-0a.0-[0d]----00.0 
+-0b.0-[0e]----00.0 
+-0c.0-[0f]----00.0  
+-0d.0-[10]----00.0  
\-0e.0-[11]----00.0 
linux-QikjTj:~ # ll /sys/class/net/
total 0
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth0 -> ../../devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:00.0/0000:03:00.0/net/eth0
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth1 -> ../../devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:01.0/0000:04:00.0/net/eth1
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth10 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0c.0/0000:0f:00.0/net/eth10
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth11 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0d.0/0000:10:00.0/net/eth11
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth12 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0e.0/0000:11:00.0/net/eth12
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth13 -> ../../devices/pci0000:7c/0000:7c:00.0/0000:7d:00.0/net/eth13
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth2 -> ../../devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:02.0/0000:05:00.0/net/eth2
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth3 -> ../../devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:03.0/0000:06:00.0/net/eth3
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth4 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:06.0/0000:09:00.0/net/eth4
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth5 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:07.0/0000:0a:00.0/net/eth5
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth6 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:08.0/0000:0b:00.0/net/eth6
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth7 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:09.0/0000:0c:00.0/net/eth7
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth8 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0a.0/0000:0d:00.0/net/eth8
lrwxrwxrwx 1 root root 0 Feb  8 04:06 eth9 -> ../../devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0b.0/0000:0e:00.0/net/eth9
lrwxrwxrwx 1 root root 0 Feb  8 04:06 lo -> ../../devices/virtual/net/lo

I have a network card with a PCI bridge as shown above. When the system starts, the device 0000:00:00.0 has lower SEQNUM than the child devices in the log of systemd-udevd. I have picked out some key logs.

Feb 08 01:29:53 linux-QikjTj systemd-udevd[959]: 0000:00:00.0: Device (SEQNUM=4124, ACTION=add) is queued Feb 08 01:29:53 linux-QikjTj systemd-udevd[959]: eth0: Device (SEQNUM=4235, ACTION=add) is queued Feb 08 01:29:54 linux-QikjTj systemd-udevd[959]: eth1: Device (SEQNUM=5092, ACTION=add) is queued Feb 08 01:29:55 linux-QikjTj systemd-udevd[959]: eth2: Device (SEQNUM=5126, ACTION=add) is queued Feb 08 01:29:55 linux-QikjTj systemd-udevd[959]: eth3: Device (SEQNUM=5160, ACTION=add) is queued Feb 08 01:29:56 linux-QikjTj systemd-udevd[959]: eth4: Device (SEQNUM=5194, ACTION=add) is queued Feb 08 01:29:57 linux-QikjTj systemd-udevd[959]: eth5: Device (SEQNUM=5198, ACTION=add) is queued Feb 08 01:29:58 linux-QikjTj systemd-udevd[959]: eth6: Device (SEQNUM=5202, ACTION=add) is queued Feb 08 01:29:59 linux-QikjTj systemd-udevd[959]: eth7: Device (SEQNUM=5332, ACTION=add) is queued Feb 08 01:29:59 linux-QikjTj systemd-udevd[959]: eth8: Device (SEQNUM=5462, ACTION=add) is queued Feb 08 01:30:00 linux-QikjTj systemd-udevd[959]: eth9: Device (SEQNUM=5592, ACTION=add) is queued Feb 08 01:30:00 linux-QikjTj systemd-udevd[959]: eth10: Device (SEQNUM=5722, ACTION=add) is queued Feb 08 01:30:01 linux-QikjTj systemd-udevd[959]: eth11: Device (SEQNUM=5852, ACTION=add) is queued Feb 08 01:30:01 linux-QikjTj systemd-udevd[959]: eth12: Device (SEQNUM=5982, ACTION=add) is queued Feb 08 01:29:54 linux-QikjTj systemd-udevd[959]: eth13: Device (SEQNUM=5009, ACTION=move) is queued

Unexpected behaviour you saw

Sometimes when the system starts, eth1 and eth2 have lower SEQNUM than their parent device 0000:00:00.0 . The dependency of device events raises another problem for me. I wonder if the dependencies of events between parent and child devices should be lifted for this kind of network card with PCI bridge.

Feb 08 01:44:48 linux-QikjTj systemd-udevd[943]: eth1: Device (SEQNUM=3785, ACTION=add) is queued Feb 08 01:44:48 linux-QikjTj systemd-udevd[943]: eth2: Device (SEQNUM=3819, ACTION=add) is queued Feb 08 01:44:48 linux-QikjTj systemd-udevd[943]: 0000:00:00.0: Device (SEQNUM=4192, ACTION=add) is queued Feb 08 01:44:48 linux-QikjTj systemd-udevd[943]: 0000:00:00.0: SEQNUM=4192 blocked by SEQNUM=3785 Feb 08 01:44:48 linux-QikjTj systemd-udevd[943]: 0000:00:00.0: SEQNUM=4192 blocked by SEQNUM=3819 Feb 08 01:44:48 linux-QikjTj systemd-udevd[943]: eth0: Device (SEQNUM=4305, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth3: Device (SEQNUM=5062, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth3: SEQNUM=5062 blocked by SEQNUM=4192 Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth4: Device (SEQNUM=5164, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth5: Device (SEQNUM=5185, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth6: Device (SEQNUM=5328, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth7: Device (SEQNUM=5462, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth8: Device (SEQNUM=5596, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth9: Device (SEQNUM=5726, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth10: Device (SEQNUM=5856, ACTION=add) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth11: Device (SEQNUM=5986, ACTION=add) is queued Feb 08 01:44:50 linux-QikjTj systemd-udevd[943]: eth12: Device (SEQNUM=6007, ACTION=move) is queued Feb 08 01:44:49 linux-QikjTj systemd-udevd[943]: eth13: Device (SEQNUM=5146, ACTION=move) is queued

Steps to reproduce the problem

don't know yet. The problem may be device related.

Additional program output to the terminal or log subsystem illustrating the issue

…
yuwata commented 2 years ago

Hm? Could you show the result of udevadm trigger --type=devices --dry-run -v?

yuwata commented 2 years ago

From the removed comment, it seems triggered events are correctly ordered. So, this seems a kernel issue.

Jsfastsa commented 2 years ago

sorry, the comment removed becasue it's not the problem environment. here is the output

linux-QikjTj:~ # udevadm trigger --type=devices --dry-run -v sd-device-enumerator: Scan all dirs sd-device-enumerator: Scanning /sys/bus sd-device-enumerator: Scanning /sys/class /sys/devices/LNXSYSTM:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:01 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:02 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:03 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:04 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:05 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:06 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:07 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:08 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:09 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:0a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:0b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:0c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:0d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:0e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:0f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:10 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:11 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:12 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:13 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:14 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:15 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:16 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:17 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:18 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:19 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:1a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:1b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:1c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:1d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:1e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:1f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:20 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:21 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:22 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:23 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:24 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:25 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:26 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:27 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:28 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:29 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:2a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:2b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:2c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:2d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:2e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:2f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:30 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:31 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:32 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:33 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:34 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:35 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:36 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:37 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:38 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:39 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:3a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:3b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:3c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:3d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:3e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:3f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:40 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:41 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:42 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:43 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:44 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:45 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:46 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:47 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:48 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:49 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:4a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:4b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:4c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:4d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:4e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:4f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:50 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:51 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:52 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:53 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:54 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:55 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:56 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:57 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:58 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:59 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:5a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:5b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:5c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:5d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:5e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:5f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:60 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:61 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:62 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:63 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:64 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:65 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:66 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:67 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:68 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:69 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:6a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:6b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:6c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:6d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:6e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:6f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:70 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:71 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:72 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:73 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:74 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:75 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:76 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:77 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:78 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:79 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:7a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:7b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:7c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:7d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:7e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:7f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:80 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:81 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:82 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:83 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:84 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:85 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:86 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:87 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:88 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:89 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:8a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:8b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:8c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:8d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:8e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:8f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:90 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:91 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:92 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:93 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:94 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:95 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:96 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:97 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:98 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:99 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:9a /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:9b /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:9c /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:9d /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:9e /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:9f /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a0 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a1 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a2 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a3 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a4 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a5 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a6 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a7 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a8 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:a9 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:aa /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ab /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ac /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ad /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ae /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:af /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b0 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b1 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b2 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b3 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b4 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b5 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b6 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b7 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b8 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:b9 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ba /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:bb /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:bc /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:bd /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:be /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:bf /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c0 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c1 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c2 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c3 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c4 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c5 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c6 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c7 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c8 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:c9 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ca /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:cb /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:cc /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:cd /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ce /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:cf /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d0 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d1 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d2 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d3 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d4 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d5 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d6 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d7 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d8 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:d9 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:da /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:db /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:dc /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:dd /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:de /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:df /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e0 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e1 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e2 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e3 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e4 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e5 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e6 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e7 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e8 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:e9 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ea /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:eb /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ec /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ed /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ee /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ef /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f0 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f1 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f2 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f3 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f4 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f5 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f6 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f7 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f8 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:f9 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:fa /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:fb /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:fc /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:fd /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:fe /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0007:ff /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ACPI0013:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/ARMH0011:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0501:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:01 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:02 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:03 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:03/device:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:03/device:00/device:01 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:03/device:02 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:04 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:05 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:05/device:03 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:05/device:04 /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C33:00 /sys/devices/LNXSYSTM:00/LNXSYBUS:01 /sys/devices/breakpoint /sys/devices/kprobe /sys/devices/pci0000:00/0000:00:00.0 /sys/devices/pci0000:00/0000:00:00.0/0000:00:00.0:pcie001 /sys/devices/pci0000:00/0000:00:00.0/0000:00:00.0:pcie002 /sys/devices/pci0000:00/0000:00:00.0/0000:00:00.0:pcie004 /sys/devices/pci0000:00/0000:00:00.0/0000:00:00.0:pcie008 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:00.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:00.0/0000:03:00.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:00.0/0000:03:00.0/net/eth0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:00.0/pci_bus/0000:03 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:01.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:01.0/0000:04:00.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:01.0/0000:04:00.0/net/rename4 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:01.0/pci_bus/0000:04 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:02.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:02.0/0000:05:00.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:02.0/0000:05:00.0/net/eth2 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:02.0/pci_bus/0000:05 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:03.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:03.0/0000:06:00.0 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:03.0/0000:06:00.0/net/eth3 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:03.0/pci_bus/0000:06 /sys/devices/pci0000:00/0000:00:00.0/0000:01:00.0/pci_bus/0000:02 /sys/devices/pci0000:00/0000:00:00.0/pci_bus/0000:01 /sys/devices/pci0000:00/0000:00:04.0 /sys/devices/pci0000:00/0000:00:04.0/0000:00:04.0:pcie001 /sys/devices/pci0000:00/0000:00:04.0/0000:00:04.0:pcie002 /sys/devices/pci0000:00/0000:00:04.0/0000:00:04.0:pcie004 /sys/devices/pci0000:00/0000:00:04.0/0000:00:04.0:pcie008 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:06.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:06.0/0000:09:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:06.0/0000:09:00.0/net/eth4 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:06.0/pci_bus/0000:09 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:07.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:07.0/0000:0a:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:07.0/0000:0a:00.0/net/eth5 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:07.0/pci_bus/0000:0a /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:08.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:08.0/0000:0b:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:08.0/0000:0b:00.0/net/eth6 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:08.0/pci_bus/0000:0b /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:09.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:09.0/0000:0c:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:09.0/0000:0c:00.0/net/eth7 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:09.0/pci_bus/0000:0c /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0a.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0a.0/0000:0d:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0a.0/0000:0d:00.0/net/eth8 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0a.0/pci_bus/0000:0d /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0b.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0b.0/0000:0e:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0b.0/0000:0e:00.0/net/eth9 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0b.0/pci_bus/0000:0e /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0c.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0c.0/0000:0f:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0c.0/0000:0f:00.0/net/eth10 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0c.0/pci_bus/0000:0f /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0d.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0d.0/0000:10:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0d.0/0000:10:00.0/net/eth11 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0d.0/pci_bus/0000:10 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0e.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0e.0/0000:11:00.0 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0e.0/0000:11:00.0/net/eth12 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/0000:08:0e.0/pci_bus/0000:11 /sys/devices/pci0000:00/0000:00:04.0/0000:07:00.0/pci_bus/0000:08 /sys/devices/pci0000:00/0000:00:04.0/pci_bus/0000:07 /sys/devices/pci0000:00/pci_bus/0000:00 /sys/devices/pci0000:74/0000:74:00.0 /sys/devices/pci0000:74/0000:74:00.0/0000:75:00.0 /sys/devices/pci0000:74/0000:74:00.0/pci_bus/0000:75 /sys/devices/pci0000:74/0000:74:01.0 /sys/devices/pci0000:74/0000:74:01.0/0000:76:00.0 /sys/devices/pci0000:74/0000:74:01.0/pci_bus/0000:76 /sys/devices/pci0000:74/0000:74:03.0 /sys/devices/pci0000:74/0000:74:03.0/ata1/ata_port/ata1 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/scsi_host/host0 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0/block/sda /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0/block/sda/sda1 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0/block/sda/sda2 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0/block/sda/sda3 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0/bsg/0:0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0/scsi_device/0:0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0/scsi_disk/0:0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata1/host0/target0:0:0/0:0:0:0/scsi_generic/sg0 /sys/devices/pci0000:74/0000:74:03.0/ata1/link1/ata_link/link1 /sys/devices/pci0000:74/0000:74:03.0/ata1/link1/dev1.0/ata_device/dev1.0 /sys/devices/pci0000:74/0000:74:03.0/ata2/ata_port/ata2 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/scsi_host/host1 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0/block/sdb /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0/block/sdb/sdb1 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0/block/sdb/sdb2 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0/block/sdb/sdb3 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0/bsg/1:0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0/scsi_device/1:0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0/scsi_disk/1:0:0:0 /sys/devices/pci0000:74/0000:74:03.0/ata2/host1/target1:0:0/1:0:0:0/scsi_generic/sg1 /sys/devices/pci0000:74/0000:74:03.0/ata2/link2/ata_link/link2 /sys/devices/pci0000:74/0000:74:03.0/ata2/link2/dev2.0/ata_device/dev2.0 /sys/devices/pci0000:74/0000:74:04.0 /sys/devices/pci0000:74/0000:74:04.0/host2 /sys/devices/pci0000:74/0000:74:04.0/host2/bsg/sas_host2 /sys/devices/pci0000:74/0000:74:04.0/host2/phy-2:0/sas_phy/phy-2:0 /sys/devices/pci0000:74/0000:74:04.0/host2/phy-2:1/sas_phy/phy-2:1 /sys/devices/pci0000:74/0000:74:04.0/host2/phy-2:2/sas_phy/phy-2:2 /sys/devices/pci0000:74/0000:74:04.0/host2/phy-2:3/sas_phy/phy-2:3 /sys/devices/pci0000:74/0000:74:04.0/host2/phy-2:4/sas_phy/phy-2:4 /sys/devices/pci0000:74/0000:74:04.0/host2/phy-2:5/sas_phy/phy-2:5 /sys/devices/pci0000:74/0000:74:04.0/host2/phy-2:6/sas_phy/phy-2:6 /sys/devices/pci0000:74/0000:74:04.0/host2/phy-2:7/sas_phy/phy-2:7 /sys/devices/pci0000:74/0000:74:04.0/host2/sas_host/host2 /sys/devices/pci0000:74/0000:74:04.0/host2/scsi_host/host2 /sys/devices/pci0000:74/pci_bus/0000:74 /sys/devices/pci0000:7b/0000:7b:00.0 /sys/devices/pci0000:7b/0000:7b:01.0 /sys/devices/pci0000:7b/0000:7b:02.0 /sys/devices/pci0000:7b/pci_bus/0000:7b /sys/devices/pci0000:7c/0000:7c:00.0 /sys/devices/pci0000:7c/0000:7c:00.0/0000:7d:00.0 /sys/devices/pci0000:7c/0000:7c:00.0/0000:7d:00.0/net/eth13 /sys/devices/pci0000:7c/0000:7c:00.0/pci_bus/0000:7d /sys/devices/pci0000:7c/pci_bus/0000:7c /sys/devices/platform/1620_ep_controller /sys/devices/platform/1620_ep_controller/sdi_ep_controller/1620_ep_controller /sys/devices/platform/ACPI0007:18 /sys/devices/platform/ACPI0007:19 /sys/devices/platform/ACPI0007:1a /sys/devices/platform/ACPI0007:1b /sys/devices/platform/ACPI0007:1c /sys/devices/platform/ACPI0007:1d /sys/devices/platform/ACPI0007:1e /sys/devices/platform/ACPI0007:1f /sys/devices/platform/ACPI0007:20 /sys/devices/platform/ACPI0007:21 /sys/devices/platform/ACPI0007:22 /sys/devices/platform/ACPI0007:23 /sys/devices/platform/ACPI0007:24 /sys/devices/platform/ACPI0007:25 /sys/devices/platform/ACPI0007:26 /sys/devices/platform/ACPI0007:27 /sys/devices/platform/ACPI0007:28 /sys/devices/platform/ACPI0007:29 /sys/devices/platform/ACPI0007:2a /sys/devices/platform/ACPI0007:2b /sys/devices/platform/ACPI0007:2c /sys/devices/platform/ACPI0007:2d /sys/devices/platform/ACPI0007:2e /sys/devices/platform/ACPI0007:2f /sys/devices/platform/ACPI0007:30 /sys/devices/platform/ACPI0007:31 /sys/devices/platform/ACPI0007:32 /sys/devices/platform/ACPI0007:33 /sys/devices/platform/ACPI0007:34 /sys/devices/platform/ACPI0007:35 /sys/devices/platform/ACPI0007:36 /sys/devices/platform/ACPI0007:37 /sys/devices/platform/ACPI0007:38 /sys/devices/platform/ACPI0007:39 /sys/devices/platform/ACPI0007:3a /sys/devices/platform/ACPI0007:3b /sys/devices/platform/ACPI0007:3c /sys/devices/platform/ACPI0007:3d /sys/devices/platform/ACPI0007:3e /sys/devices/platform/ACPI0007:3f /sys/devices/platform/ACPI0007:40 /sys/devices/platform/ACPI0007:41 /sys/devices/platform/ACPI0007:42 /sys/devices/platform/ACPI0007:43 /sys/devices/platform/ACPI0007:44 /sys/devices/platform/ACPI0007:45 /sys/devices/platform/ACPI0007:46 /sys/devices/platform/ACPI0007:47 /sys/devices/platform/ACPI0007:48 /sys/devices/platform/ACPI0007:49 /sys/devices/platform/ACPI0007:4a /sys/devices/platform/ACPI0007:4b /sys/devices/platform/ACPI0007:4c /sys/devices/platform/ACPI0007:4d /sys/devices/platform/ACPI0007:4e /sys/devices/platform/ACPI0007:4f /sys/devices/platform/ACPI0007:50 /sys/devices/platform/ACPI0007:51 /sys/devices/platform/ACPI0007:52 /sys/devices/platform/ACPI0007:53 /sys/devices/platform/ACPI0007:54 /sys/devices/platform/ACPI0007:55 /sys/devices/platform/ACPI0007:56 /sys/devices/platform/ACPI0007:57 /sys/devices/platform/ACPI0007:58 /sys/devices/platform/ACPI0007:59 /sys/devices/platform/ACPI0007:5a /sys/devices/platform/ACPI0007:5b /sys/devices/platform/ACPI0007:5c /sys/devices/platform/ACPI0007:5d /sys/devices/platform/ACPI0007:5e /sys/devices/platform/ACPI0007:5f /sys/devices/platform/ACPI0007:60 /sys/devices/platform/ACPI0007:61 /sys/devices/platform/ACPI0007:62 /sys/devices/platform/ACPI0007:63 /sys/devices/platform/ACPI0007:64 /sys/devices/platform/ACPI0007:65 /sys/devices/platform/ACPI0007:66 /sys/devices/platform/ACPI0007:67 /sys/devices/platform/ACPI0007:68 /sys/devices/platform/ACPI0007:69 /sys/devices/platform/ACPI0007:6a /sys/devices/platform/ACPI0007:6b /sys/devices/platform/ACPI0007:6c /sys/devices/platform/ACPI0007:6d /sys/devices/platform/ACPI0007:6e /sys/devices/platform/ACPI0007:6f /sys/devices/platform/ACPI0007:70 /sys/devices/platform/ACPI0007:71 /sys/devices/platform/ACPI0007:72 /sys/devices/platform/ACPI0007:73 /sys/devices/platform/ACPI0007:74 /sys/devices/platform/ACPI0007:75 /sys/devices/platform/ACPI0007:76 /sys/devices/platform/ACPI0007:77 /sys/devices/platform/ACPI0007:78 /sys/devices/platform/ACPI0007:79 /sys/devices/platform/ACPI0007:7a /sys/devices/platform/ACPI0007:7b /sys/devices/platform/ACPI0007:7c /sys/devices/platform/ACPI0007:7d /sys/devices/platform/ACPI0007:7e /sys/devices/platform/ACPI0007:7f /sys/devices/platform/ACPI0007:80 /sys/devices/platform/ACPI0007:81 /sys/devices/platform/ACPI0007:82 /sys/devices/platform/ACPI0007:83 /sys/devices/platform/ACPI0007:84 /sys/devices/platform/ACPI0007:85 /sys/devices/platform/ACPI0007:86 /sys/devices/platform/ACPI0007:87 /sys/devices/platform/ACPI0007:88 /sys/devices/platform/ACPI0007:89 /sys/devices/platform/ACPI0007:8a /sys/devices/platform/ACPI0007:8b /sys/devices/platform/ACPI0007:8c /sys/devices/platform/ACPI0007:8d /sys/devices/platform/ACPI0007:8e /sys/devices/platform/ACPI0007:8f /sys/devices/platform/ACPI0007:90 /sys/devices/platform/ACPI0007:91 /sys/devices/platform/ACPI0007:92 /sys/devices/platform/ACPI0007:93 /sys/devices/platform/ACPI0007:94 /sys/devices/platform/ACPI0007:95 /sys/devices/platform/ACPI0007:96 /sys/devices/platform/ACPI0007:97 /sys/devices/platform/ACPI0007:98 /sys/devices/platform/ACPI0007:99 /sys/devices/platform/ACPI0007:9a /sys/devices/platform/ACPI0007:9b /sys/devices/platform/ACPI0007:9c /sys/devices/platform/ACPI0007:9d /sys/devices/platform/ACPI0007:9e /sys/devices/platform/ACPI0007:9f /sys/devices/platform/ACPI0007:a0 /sys/devices/platform/ACPI0007:a1 /sys/devices/platform/ACPI0007:a2 /sys/devices/platform/ACPI0007:a3 /sys/devices/platform/ACPI0007:a4 /sys/devices/platform/ACPI0007:a5 /sys/devices/platform/ACPI0007:a6 /sys/devices/platform/ACPI0007:a7 /sys/devices/platform/ACPI0007:a8 /sys/devices/platform/ACPI0007:a9 /sys/devices/platform/ACPI0007:aa /sys/devices/platform/ACPI0007:ab /sys/devices/platform/ACPI0007:ac /sys/devices/platform/ACPI0007:ad /sys/devices/platform/ACPI0007:ae /sys/devices/platform/ACPI0007:af /sys/devices/platform/ACPI0007:b0 /sys/devices/platform/ACPI0007:b1 /sys/devices/platform/ACPI0007:b2 /sys/devices/platform/ACPI0007:b3 /sys/devices/platform/ACPI0007:b4 /sys/devices/platform/ACPI0007:b5 /sys/devices/platform/ACPI0007:b6 /sys/devices/platform/ACPI0007:b7 /sys/devices/platform/ACPI0007:b8 /sys/devices/platform/ACPI0007:b9 /sys/devices/platform/ACPI0007:ba /sys/devices/platform/ACPI0007:bb /sys/devices/platform/ACPI0007:bc /sys/devices/platform/ACPI0007:bd /sys/devices/platform/ACPI0007:be /sys/devices/platform/ACPI0007:bf /sys/devices/platform/ACPI0007:c0 /sys/devices/platform/ACPI0007:c1 /sys/devices/platform/ACPI0007:c2 /sys/devices/platform/ACPI0007:c3 /sys/devices/platform/ACPI0007:c4 /sys/devices/platform/ACPI0007:c5 /sys/devices/platform/ACPI0007:c6 /sys/devices/platform/ACPI0007:c7 /sys/devices/platform/ACPI0007:c8 /sys/devices/platform/ACPI0007:c9 /sys/devices/platform/ACPI0007:ca /sys/devices/platform/ACPI0007:cb /sys/devices/platform/ACPI0007:cc /sys/devices/platform/ACPI0007:cd /sys/devices/platform/ACPI0007:ce /sys/devices/platform/ACPI0007:cf /sys/devices/platform/ACPI0007:d0 /sys/devices/platform/ACPI0007:d1 /sys/devices/platform/ACPI0007:d2 /sys/devices/platform/ACPI0007:d3 /sys/devices/platform/ACPI0007:d4 /sys/devices/platform/ACPI0007:d5 /sys/devices/platform/ACPI0007:d6 /sys/devices/platform/ACPI0007:d7 /sys/devices/platform/ACPI0007:d8 /sys/devices/platform/ACPI0007:d9 /sys/devices/platform/ACPI0007:da /sys/devices/platform/ACPI0007:db /sys/devices/platform/ACPI0007:dc /sys/devices/platform/ACPI0007:dd /sys/devices/platform/ACPI0007:de /sys/devices/platform/ACPI0007:df /sys/devices/platform/ACPI0007:e0 /sys/devices/platform/ACPI0007:e1 /sys/devices/platform/ACPI0007:e2 /sys/devices/platform/ACPI0007:e3 /sys/devices/platform/ACPI0007:e4 /sys/devices/platform/ACPI0007:e5 /sys/devices/platform/ACPI0007:e6 /sys/devices/platform/ACPI0007:e7 /sys/devices/platform/ACPI0007:e8 /sys/devices/platform/ACPI0007:e9 /sys/devices/platform/ACPI0007:ea /sys/devices/platform/ACPI0007:eb /sys/devices/platform/ACPI0007:ec /sys/devices/platform/ACPI0007:ed /sys/devices/platform/ACPI0007:ee /sys/devices/platform/ACPI0007:ef /sys/devices/platform/ACPI0007:f0 /sys/devices/platform/ACPI0007:f1 /sys/devices/platform/ACPI0007:f2 /sys/devices/platform/ACPI0007:f3 /sys/devices/platform/ACPI0007:f4 /sys/devices/platform/ACPI0007:f5 /sys/devices/platform/ACPI0007:f6 /sys/devices/platform/ACPI0007:f7 /sys/devices/platform/ACPI0007:f8 /sys/devices/platform/ACPI0007:f9 /sys/devices/platform/ACPI0007:fa /sys/devices/platform/ACPI0007:fb /sys/devices/platform/ACPI0007:fc /sys/devices/platform/ACPI0007:fd /sys/devices/platform/ACPI0007:fe /sys/devices/platform/ACPI0007:ff /sys/devices/platform/ACPI0013:00 /sys/devices/platform/ARMH0011:00 /sys/devices/platform/ARMH0011:00/tty/ttyAMA0 /sys/devices/platform/Fixed MDIO bus.0 /sys/devices/platform/Fixed MDIO bus.0/mdio_bus/fixed-0 /sys/devices/platform/GHES.0 /sys/devices/platform/GHES.1 /sys/devices/platform/GHES.10 /sys/devices/platform/GHES.11 /sys/devices/platform/GHES.12 /sys/devices/platform/GHES.13 /sys/devices/platform/GHES.14 /sys/devices/platform/GHES.2 /sys/devices/platform/GHES.3 /sys/devices/platform/GHES.4 /sys/devices/platform/GHES.5 /sys/devices/platform/GHES.6 /sys/devices/platform/GHES.7 /sys/devices/platform/GHES.8 /sys/devices/platform/GHES.9 /sys/devices/platform/PCCT /sys/devices/platform/PNP0C33:00 /sys/devices/platform/alarmtimer /sys/devices/platform/arm,spe-v1 /sys/devices/platform/rtc-efi /sys/devices/platform/rtc-efi/rtc/rtc0 /sys/devices/platform/sbsa-gwdt.0 /sys/devices/platform/serial8250 /sys/devices/pnp0/00:00 /sys/devices/software /sys/devices/system/clockevents/broadcast /sys/devices/system/clockevents/clockevent0 /sys/devices/system/clockevents/clockevent1 /sys/devices/system/clockevents/clockevent10 /sys/devices/system/clockevents/clockevent11 /sys/devices/system/clockevents/clockevent12 /sys/devices/system/clockevents/clockevent13 /sys/devices/system/clockevents/clockevent14 /sys/devices/system/clockevents/clockevent15 /sys/devices/system/clockevents/clockevent16 /sys/devices/system/clockevents/clockevent17 /sys/devices/system/clockevents/clockevent18 /sys/devices/system/clockevents/clockevent19 /sys/devices/system/clockevents/clockevent2 /sys/devices/system/clockevents/clockevent20 /sys/devices/system/clockevents/clockevent21 /sys/devices/system/clockevents/clockevent22 /sys/devices/system/clockevents/clockevent23 /sys/devices/system/clockevents/clockevent3 /sys/devices/system/clockevents/clockevent4 /sys/devices/system/clockevents/clockevent5 /sys/devices/system/clockevents/clockevent6 /sys/devices/system/clockevents/clockevent7 /sys/devices/system/clockevents/clockevent8 /sys/devices/system/clockevents/clockevent9 /sys/devices/system/clocksource/clocksource0 /sys/devices/system/cpu/cpu0 /sys/devices/system/cpu/cpu1 /sys/devices/system/cpu/cpu10 /sys/devices/system/cpu/cpu11 /sys/devices/system/cpu/cpu12 /sys/devices/system/cpu/cpu13 /sys/devices/system/cpu/cpu14 /sys/devices/system/cpu/cpu15 /sys/devices/system/cpu/cpu16 /sys/devices/system/cpu/cpu17 /sys/devices/system/cpu/cpu18 /sys/devices/system/cpu/cpu19 /sys/devices/system/cpu/cpu2 /sys/devices/system/cpu/cpu20 /sys/devices/system/cpu/cpu21 /sys/devices/system/cpu/cpu22 /sys/devices/system/cpu/cpu23 /sys/devices/system/cpu/cpu3 /sys/devices/system/cpu/cpu4 /sys/devices/system/cpu/cpu5 /sys/devices/system/cpu/cpu6 /sys/devices/system/cpu/cpu7 /sys/devices/system/cpu/cpu8 /sys/devices/system/cpu/cpu9 /sys/devices/system/edac/mc /sys/devices/system/edac/mc/mc0 /sys/devices/system/edac/mc/mc0/csrow0 /sys/devices/system/edac/mc/mc0/csrow1 /sys/devices/system/edac/mc/mc0/csrow2 /sys/devices/system/edac/mc/mc0/csrow3 /sys/devices/system/edac/mc/mc0/dimm0 /sys/devices/system/edac/mc/mc0/dimm1 /sys/devices/system/edac/mc/mc0/dimm2 /sys/devices/system/edac/mc/mc0/dimm3 /sys/devices/system/memory/memory0 /sys/devices/system/memory/memory1 /sys/devices/system/memory/memory10 /sys/devices/system/memory/memory1040 /sys/devices/system/memory/memory1041 /sys/devices/system/memory/memory1042 /sys/devices/system/memory/memory1043 /sys/devices/system/memory/memory1044 /sys/devices/system/memory/memory1045 /sys/devices/system/memory/memory1046 /sys/devices/system/memory/memory1047 /sys/devices/system/memory/memory1048 /sys/devices/system/memory/memory1049 /sys/devices/system/memory/memory1050 /sys/devices/system/memory/memory1051 /sys/devices/system/memory/memory1052 /sys/devices/system/memory/memory1053 /sys/devices/system/memory/memory1054 /sys/devices/system/memory/memory1055 /sys/devices/system/memory/memory1056 /sys/devices/system/memory/memory1057 /sys/devices/system/memory/memory1058 /sys/devices/system/memory/memory1059 /sys/devices/system/memory/memory1060 /sys/devices/system/memory/memory1061 /sys/devices/system/memory/memory1062 /sys/devices/system/memory/memory1063 /sys/devices/system/memory/memory1064 /sys/devices/system/memory/memory1065 /sys/devices/system/memory/memory1066 /sys/devices/system/memory/memory1067 /sys/devices/system/memory/memory1068 /sys/devices/system/memory/memory1069 /sys/devices/system/memory/memory1070 /sys/devices/system/memory/memory1071 /sys/devices/system/memory/memory1072 /sys/devices/system/memory/memory1073 /sys/devices/system/memory/memory1074 /sys/devices/system/memory/memory1075 /sys/devices/system/memory/memory1076 /sys/devices/system/memory/memory1077 /sys/devices/system/memory/memory1078 /sys/devices/system/memory/memory1079 /sys/devices/system/memory/memory1080 /sys/devices/system/memory/memory1081 /sys/devices/system/memory/memory1082 /sys/devices/system/memory/memory1083 /sys/devices/system/memory/memory1084 /sys/devices/system/memory/memory1085 /sys/devices/system/memory/memory1086 /sys/devices/system/memory/memory1087 /sys/devices/system/memory/memory1088 /sys/devices/system/memory/memory1089 /sys/devices/system/memory/memory1090 /sys/devices/system/memory/memory1091 /sys/devices/system/memory/memory1092 /sys/devices/system/memory/memory1093 /sys/devices/system/memory/memory1094 /sys/devices/system/memory/memory1095 /sys/devices/system/memory/memory1096 /sys/devices/system/memory/memory1097 /sys/devices/system/memory/memory1098 /sys/devices/system/memory/memory1099 /sys/devices/system/memory/memory11 /sys/devices/system/memory/memory1100 /sys/devices/system/memory/memory1101 /sys/devices/system/memory/memory1102 /sys/devices/system/memory/memory1103 /sys/devices/system/memory/memory1104 /sys/devices/system/memory/memory1105 /sys/devices/system/memory/memory1106 /sys/devices/system/memory/memory1107 /sys/devices/system/memory/memory1108 /sys/devices/system/memory/memory1109 /sys/devices/system/memory/memory1110 /sys/devices/system/memory/memory1111 /sys/devices/system/memory/memory1112 /sys/devices/system/memory/memory1113 /sys/devices/system/memory/memory1114 /sys/devices/system/memory/memory1115 /sys/devices/system/memory/memory1116 /sys/devices/system/memory/memory1117 /sys/devices/system/memory/memory1118 /sys/devices/system/memory/memory1119 /sys/devices/system/memory/memory1120 /sys/devices/system/memory/memory1121 /sys/devices/system/memory/memory1122 /sys/devices/system/memory/memory1123 /sys/devices/system/memory/memory1124 /sys/devices/system/memory/memory1125 /sys/devices/system/memory/memory1126 /sys/devices/system/memory/memory1127 /sys/devices/system/memory/memory1128 /sys/devices/system/memory/memory1129 /sys/devices/system/memory/memory1130 /sys/devices/system/memory/memory1131 /sys/devices/system/memory/memory1132 /sys/devices/system/memory/memory1133 /sys/devices/system/memory/memory1134 /sys/devices/system/memory/memory1135 /sys/devices/system/memory/memory1136 /sys/devices/system/memory/memory1137 /sys/devices/system/memory/memory1138 /sys/devices/system/memory/memory1139 /sys/devices/system/memory/memory1140 /sys/devices/system/memory/memory1141 /sys/devices/system/memory/memory1142 /sys/devices/system/memory/memory1143 /sys/devices/system/memory/memory1144 /sys/devices/system/memory/memory1145 /sys/devices/system/memory/memory1146 /sys/devices/system/memory/memory1147 /sys/devices/system/memory/memory1148 /sys/devices/system/memory/memory1149 /sys/devices/system/memory/memory1150 /sys/devices/system/memory/memory1151 /sys/devices/system/memory/memory1152 /sys/devices/system/memory/memory1153 /sys/devices/system/memory/memory1154 /sys/devices/system/memory/memory1155 /sys/devices/system/memory/memory1156 /sys/devices/system/memory/memory1157 /sys/devices/system/memory/memory1158 /sys/devices/system/memory/memory1159 /sys/devices/system/memory/memory1160 /sys/devices/system/memory/memory1161 /sys/devices/system/memory/memory1162 /sys/devices/system/memory/memory1163 /sys/devices/system/memory/memory1164 /sys/devices/system/memory/memory1165 /sys/devices/system/memory/memory1166 /sys/devices/system/memory/memory1167 /sys/devices/system/memory/memory1168 /sys/devices/system/memory/memory1169 /sys/devices/system/memory/memory1170 /sys/devices/system/memory/memory1171 /sys/devices/system/memory/memory1172 /sys/devices/system/memory/memory1173 /sys/devices/system/memory/memory1174 /sys/devices/system/memory/memory1175 /sys/devices/system/memory/memory1176 /sys/devices/system/memory/memory1177 /sys/devices/system/memory/memory1178 /sys/devices/system/memory/memory1179 /sys/devices/system/memory/memory1180 /sys/devices/system/memory/memory1181 /sys/devices/system/memory/memory1182 /sys/devices/system/memory/memory1183 /sys/devices/system/memory/memory1184 /sys/devices/system/memory/memory1185 /sys/devices/system/memory/memory1186 /sys/devices/system/memory/memory1187 /sys/devices/system/memory/memory1188 /sys/devices/system/memory/memory1189 /sys/devices/system/memory/memory1190 /sys/devices/system/memory/memory1191 /sys/devices/system/memory/memory1192 /sys/devices/system/memory/memory1193 /sys/devices/system/memory/memory1194 /sys/devices/system/memory/memory1195 /sys/devices/system/memory/memory1196 /sys/devices/system/memory/memory1197 /sys/devices/system/memory/memory1198 /sys/devices/system/memory/memory1199 /sys/devices/system/memory/memory12 /sys/devices/system/memory/memory1200 /sys/devices/system/memory/memory1201 /sys/devices/system/memory/memory1202 /sys/devices/system/memory/memory1203 /sys/devices/system/memory/memory1204 /sys/devices/system/memory/memory1205 /sys/devices/system/memory/memory1206 /sys/devices/system/memory/memory1207 /sys/devices/system/memory/memory1208 /sys/devices/system/memory/memory1209 /sys/devices/system/memory/memory1210 /sys/devices/system/memory/memory1211 /sys/devices/system/memory/memory1212 /sys/devices/system/memory/memory1213 /sys/devices/system/memory/memory1214 /sys/devices/system/memory/memory1215 /sys/devices/system/memory/memory1216 /sys/devices/system/memory/memory1217 /sys/devices/system/memory/memory1218 /sys/devices/system/memory/memory1219 /sys/devices/system/memory/memory1220 /sys/devices/system/memory/memory1221 /sys/devices/system/memory/memory1222 /sys/devices/system/memory/memory1223 /sys/devices/system/memory/memory1224 /sys/devices/system/memory/memory1225 /sys/devices/system/memory/memory1226 /sys/devices/system/memory/memory1227 /sys/devices/system/memory/memory1228 /sys/devices/system/memory/memory1229 /sys/devices/system/memory/memory1230 /sys/devices/system/memory/memory1231 /sys/devices/system/memory/memory1232 /sys/devices/system/memory/memory1233 /sys/devices/system/memory/memory1234 /sys/devices/system/memory/memory1235 /sys/devices/system/memory/memory1236 /sys/devices/system/memory/memory1237 /sys/devices/system/memory/memory1238 /sys/devices/system/memory/memory1239 /sys/devices/system/memory/memory1240 /sys/devices/system/memory/memory1241 /sys/devices/system/memory/memory1242 /sys/devices/system/memory/memory1243 /sys/devices/system/memory/memory1244 /sys/devices/system/memory/memory1245 /sys/devices/system/memory/memory1246 /sys/devices/system/memory/memory1247 /sys/devices/system/memory/memory1248 /sys/devices/system/memory/memory1249 /sys/devices/system/memory/memory1250 /sys/devices/system/memory/memory1251 /sys/devices/system/memory/memory1252 /sys/devices/system/memory/memory1253 /sys/devices/system/memory/memory1254 /sys/devices/system/memory/memory1255 /sys/devices/system/memory/memory1256 /sys/devices/system/memory/memory1257 /sys/devices/system/memory/memory1258 /sys/devices/system/memory/memory1259 /sys/devices/system/memory/memory1260 /sys/devices/system/memory/memory1261 /sys/devices/system/memory/memory1262 /sys/devices/system/memory/memory1263 /sys/devices/system/memory/memory1264 /sys/devices/system/memory/memory1265 /sys/devices/system/memory/memory1266 /sys/devices/system/memory/memory1267 /sys/devices/system/memory/memory1268 /sys/devices/system/memory/memory1269 /sys/devices/system/memory/memory1270 /sys/devices/system/memory/memory1271 /sys/devices/system/memory/memory1272 /sys/devices/system/memory/memory1273 /sys/devices/system/memory/memory1274 /sys/devices/system/memory/memory1275 /sys/devices/system/memory/memory1276 /sys/devices/system/memory/memory1277 /sys/devices/system/memory/memory1278 /sys/devices/system/memory/memory1279 /sys/devices/system/memory/memory13 /sys/devices/system/memory/memory14 /sys/devices/system/memory/memory15 /sys/devices/system/memory/memory2 /sys/devices/system/memory/memory3 /sys/devices/system/memory/memory4 /sys/devices/system/memory/memory5 /sys/devices/system/memory/memory6 /sys/devices/system/memory/memory7 /sys/devices/system/memory/memory8 /sys/devices/system/node/node0 /sys/devices/tracepoint /sys/devices/uprobe /sys/devices/virtual/bdi/253:0 /sys/devices/virtual/bdi/253:1 /sys/devices/virtual/bdi/253:2 /sys/devices/virtual/bdi/253:3 /sys/devices/virtual/bdi/253:4 /sys/devices/virtual/bdi/253:5 /sys/devices/virtual/bdi/8:0 /sys/devices/virtual/bdi/8:16 /sys/devices/virtual/bdi/9:1 /sys/devices/virtual/bdi/9:2 /sys/devices/virtual/bdi/9:3 /sys/devices/virtual/bdi/mtd-0 /sys/devices/virtual/cpld/cpld /sys/devices/virtual/dbgtool_class/dbgtool_chr_dev /sys/devices/virtual/dmi/id /sys/devices/virtual/drm/ttm /sys/devices/virtual/graphics/fbcon /sys/devices/virtual/input/mice /sys/devices/virtual/kbox/kbox /sys/devices/virtual/mem/full /sys/devices/virtual/mem/kmsg /sys/devices/virtual/mem/mem /sys/devices/virtual/mem/null /sys/devices/virtual/mem/random /sys/devices/virtual/mem/urandom /sys/devices/virtual/mem/zero /sys/devices/virtual/misc/autofs /sys/devices/virtual/misc/cpu_dma_latency /sys/devices/virtual/misc/device-mapper /sys/devices/virtual/misc/hw_random /sys/devices/virtual/misc/kvm /sys/devices/virtual/misc/memory_bandwidth /sys/devices/virtual/misc/network_latency /sys/devices/virtual/misc/network_throughput /sys/devices/virtual/misc/pcie_reg_dev /sys/devices/virtual/misc/rdma_cm /sys/devices/virtual/misc/sdi_ep_framework /sys/devices/virtual/misc/sdi_epc /sys/devices/virtual/misc/sdi_vsock /sys/devices/virtual/misc/snapshot /sys/devices/virtual/misc/tun /sys/devices/virtual/misc/vga_arbiter /sys/devices/virtual/misc/vhost-net /sys/devices/virtual/misc/vsock /sys/devices/virtual/misc/zero_udma /sys/devices/virtual/mtd/mtd0 /sys/devices/virtual/mtd/mtd0ro /sys/devices/virtual/net/lo /sys/devices/virtual/nictool_class/nictool_dev /sys/devices/virtual/patch_check/patch_check /sys/devices/virtual/raw/rawctl /sys/devices/virtual/sysctl_dfx/sysctl_dfx /sys/devices/virtual/tty/console /sys/devices/virtual/tty/ptmx /sys/devices/virtual/tty/tty /sys/devices/virtual/tty/tty0 /sys/devices/virtual/tty/tty1 /sys/devices/virtual/tty/tty10 /sys/devices/virtual/tty/tty11 /sys/devices/virtual/tty/tty12 /sys/devices/virtual/tty/tty13 /sys/devices/virtual/tty/tty14 /sys/devices/virtual/tty/tty15 /sys/devices/virtual/tty/tty16 /sys/devices/virtual/tty/tty17 /sys/devices/virtual/tty/tty18 /sys/devices/virtual/tty/tty19 /sys/devices/virtual/tty/tty2 /sys/devices/virtual/tty/tty20 /sys/devices/virtual/tty/tty21 /sys/devices/virtual/tty/tty22 /sys/devices/virtual/tty/tty23 /sys/devices/virtual/tty/tty24 /sys/devices/virtual/tty/tty25 /sys/devices/virtual/tty/tty26 /sys/devices/virtual/tty/tty27 /sys/devices/virtual/tty/tty28 /sys/devices/virtual/tty/tty29 /sys/devices/virtual/tty/tty3 /sys/devices/virtual/tty/tty30 /sys/devices/virtual/tty/tty31 /sys/devices/virtual/tty/tty32 /sys/devices/virtual/tty/tty33 /sys/devices/virtual/tty/tty34 /sys/devices/virtual/tty/tty35 /sys/devices/virtual/tty/tty36 /sys/devices/virtual/tty/tty37 /sys/devices/virtual/tty/tty38 /sys/devices/virtual/tty/tty39 /sys/devices/virtual/tty/tty4 /sys/devices/virtual/tty/tty40 /sys/devices/virtual/tty/tty41 /sys/devices/virtual/tty/tty42 /sys/devices/virtual/tty/tty43 /sys/devices/virtual/tty/tty44 /sys/devices/virtual/tty/tty45 /sys/devices/virtual/tty/tty46 /sys/devices/virtual/tty/tty47 /sys/devices/virtual/tty/tty48 /sys/devices/virtual/tty/tty49 /sys/devices/virtual/tty/tty5 /sys/devices/virtual/tty/tty50 /sys/devices/virtual/tty/tty51 /sys/devices/virtual/tty/tty52 /sys/devices/virtual/tty/tty53 /sys/devices/virtual/tty/tty54 /sys/devices/virtual/tty/tty55 /sys/devices/virtual/tty/tty56 /sys/devices/virtual/tty/tty57 /sys/devices/virtual/tty/tty58 /sys/devices/virtual/tty/tty59 /sys/devices/virtual/tty/tty6 /sys/devices/virtual/tty/tty60 /sys/devices/virtual/tty/tty61 /sys/devices/virtual/tty/tty62 /sys/devices/virtual/tty/tty63 /sys/devices/virtual/tty/tty7 /sys/devices/virtual/tty/tty8 /sys/devices/virtual/tty/tty9 /sys/devices/virtual/usbmon/usbmon0 /sys/devices/virtual/vc/vcs /sys/devices/virtual/vc/vcs1 /sys/devices/virtual/vc/vcs2 /sys/devices/virtual/vc/vcs3 /sys/devices/virtual/vc/vcs4 /sys/devices/virtual/vc/vcs5 /sys/devices/virtual/vc/vcs6 /sys/devices/virtual/vc/vcsa /sys/devices/virtual/vc/vcsa1 /sys/devices/virtual/vc/vcsa2 /sys/devices/virtual/vc/vcsa3 /sys/devices/virtual/vc/vcsa4 /sys/devices/virtual/vc/vcsa5 /sys/devices/virtual/vc/vcsa6 /sys/devices/virtual/vc/vcsu /sys/devices/virtual/vc/vcsu1 /sys/devices/virtual/vc/vcsu2 /sys/devices/virtual/vc/vcsu3 /sys/devices/virtual/vc/vcsu4 /sys/devices/virtual/vc/vcsu5 /sys/devices/virtual/vc/vcsu6 /sys/devices/virtual/vtconsole/vtcon0 /sys/devices/virtual/workqueue/ib-comp-unb-wq /sys/devices/virtual/workqueue/ib-comp-wq /sys/devices/virtual/workqueue/nvme-delete-wq /sys/devices/virtual/workqueue/nvme-reset-wq /sys/devices/virtual/workqueue/nvme-wq /sys/devices/virtual/workqueue/writeback /sys/devices/virtual/block/dm-0 /sys/devices/virtual/block/dm-1 /sys/devices/virtual/block/dm-2 /sys/devices/virtual/block/dm-3 /sys/devices/virtual/block/dm-4 /sys/devices/virtual/block/dm-5 /sys/devices/virtual/block/md1 /sys/devices/virtual/block/md2 /sys/devices/virtual/block/md3

Jsfastsa commented 2 years ago

I wonder if parent device event SEQNUM larger than child device event SEQNUM is abnormal when system starts?

yuwata commented 2 years ago

The above list still shows the parent earlier. So, the events in the first message are triggered by the kernel on boot when the device is detected by the kernel, instead of by systemd-udev-trigger.service.

I wonder if parent device event SEQNUM larger than child device event SEQNUM is abnormal when system starts?

I am not sure if it is abnormal or not, but at least I did not know such situation can occurs.

hexiaowen commented 2 years ago

@yuwata I had a similar problem:

The NIC driver is loaded first, and all other events are triggered again.

image-20220216172722150

The eth2 (SEQNUM=3824) wants to rename to eth1。

But eth1(SEQNUM=51111) blocked by pci 0000:00:00:0 (SEQNUM=4197), and pci 0000:00:00:0 (SEQNUM=4197) blocked by eth2 (SEQNUM=3824) , So The eth1 name cannot be released.

Finally, the renaming of eth2 fails and changes to the renameX.

I don't understand why the parent device should blocked by the child device. I think this scenario should be more common in everyday use. Is it possible to break this restriction?

               /* parent device event found */
                if (devpath[common] == '/' && )
                        goto set_delaying_seqnum;

                /* child device event found */
                if (loop_devpath[common] == '/')
                        goto set_delaying_seqnum;
yuwata commented 2 years ago

The eth2 (SEQNUM=3824) wants to rename to eth1

This is not supported, as it cannot be done without race. To make it work fine, first eth1 has to be renamed, then eth2 has to be renamed before other eth interfaces detected. Please do not rename network interfaces to names used by kernel (ethX, wlanX, wanX, and so on).

Back to the original issue, I have no idea about safely reordering uevents. As udevd processes not only 'add' uevents. E.g. when a device (e.g. USB ethernet device) is plugged and unplugged frequently, then udevd needs to process events in the following order.

These uevents cannot be reordered, and each uevent must block later uevents, that is, these must be operated sequentially. And the sequence is only guaranteed by SEQNUM. If kernel sends random SEQNUM, then we have no way to construct such dependency.

The quoted code by @hexiaowen makes udevd process completely independent uevents (e.g. eth1 vs sda1) in parallel, but not for reconstructing broken dependencies.

Please contact to kernel team. Unfortunately, we have no way to 'fix' your issue.

@poettering, @keszybz, and @bluca do you have any comments or follow-ups?

yuwata commented 2 years ago

@gregkh Could you comment on this issue?

gregkh commented 2 years ago

Comment how? If this is a kernel issue, please submit the problem to the kernel developers in email like any other kernel bug request. We don't deal with github for kernel stuff, sorry :)

yuwata commented 2 years ago

@gregkh Thanks.

@Jsfastsa and @hexiaowen Please report this issue to some kernel developers.

hexiaowen commented 2 years ago

@gregkh @yuwata Thank you for your reply

In my scenario, I'm sure it's not a bug in the kernel, may not be the same as @Jsfastsa ’s. In the preceding figure, the first two lines of eth1 and eth2 events are from driver loading, and the subsequent events are from udevadm trigger.

In the example you give, there is no usbx, usby, ethx and ethy, and there is no parent-child relationship， so there is no blockage between each other.

My idea is that the parent doesn't have to blocked by the child,

yuwata commented 2 years ago

In the preceding figure, the first two lines of eth1 and eth2 events are from driver loading, and the subsequent events are from udevadm trigger.

If so, there should be no problem. Or do you observe any issue caused by the 'mis-ordering'?

In the example you give, there is no usbx, usby, ethx and ethy, and there is no parent-child relationship， so there is no blockage between each other.

In the above example, the device is assumed a usb ethernet interface, hence ethX is a child of usbY.

My idea is that the parent doesn't have to blocked by the child,

No. On remove, the parent device must be processed after child removal. And when the device is re-plugged, then the 'add' uevents must be processed after all previous 'remove' uevents.

hexiaowen commented 2 years ago

@yuwata Thank U，got it

How about adding a parent-child relationship based on the action.

For example, add action event, parent can block by child remove actopm event, child can block by parent

yuwata commented 2 years ago

@yuwata Thank U，got it

How about adding a parent-child relationship based on the action.

For example, add action event, parent can block by child remove actopm event, child can block by parent

Unfortunately, no. The same device can be frequently added and removed.

yuwata commented 2 years ago

BTW, about the original report, there is nothing strange. Such situation can happen e.g. udevadm trigger is called at the same time the kernel sends uevents. And even if such superficially strange ordering happens, all devices should be processed as expected. Closing.

If you have any real issues caused by the ordering, then feel free to request to reopen this page.