rockstor / rockstor-core

Linux/BTRFS based Network Attached Storage(NAS)
http://rockstor.com/docs/contribute_section.html
GNU General Public License v3.0
548 stars 137 forks source link

team and bonding drivers are doing Richard :) #1502

Closed tomtom13 closed 8 months ago

tomtom13 commented 7 years ago

Sorry I could not resist to put this title up :)

There are multitude of issues behind those drivers (I'll point them out here), but lets concentrate on most serious one.

So, it's virtually imposible to setup an teaming driver in LACP mode when cables are not connected to anything, you get an error and that's it ... not even settings are punched in correctly :/

When seting up bonding in 802.3ad or teming in LACP both don't allow you to setup a MAC address that you will "fake" (at least for DHCP server).

MOST IMPORTANTLY: when setting up both drivers, when everything is connected and switch has a LAG setup properly then everything works wonderfully, until you reboot. After reboot, both configurations seem to experience same problem, link will be initialized and set's it own IP address (dhcp / static) but beyond that nothing else get's plugged to it. From the console you can see that services are running, but samba is not connected to interface, GUI isn't ... not even a blody SSH is accessible.

Only bail out of this scenario is to actually connect an ethernet to spare port (even an hour after bootup). Then everything just springs up to life, you can access GUI from what ever address you want, you can go to samba via any address ... ssh work just perfect.

And here is what will really blow your mind guys, even thou samba connects via IP of team interface it pumps trafic through orther IP ... GUI works as one would expect ...

MFlyer commented 7 years ago

Hi @tomtom13 , I haven't had any kind of test/check over Rockstor nic teaming/bonding, so I can't provide any help on this.

Can you provide some logs? Probably that will help us / @schakrava to check it M.

tomtom13 commented 7 years ago

which logs you would like specifically ? I think dumping whole lot might be a bit unwanted :)

MFlyer commented 7 years ago

Hi @tomtom13 , probably we can start with dmesg, /var/log/messages and ifconfigs of nics

EDIT: I agree about investigating teaming/bonding issues, but can you please change issue title??? Yep, I had fun reading it xD, but I think we can have a "better" title

tomtom13 commented 7 years ago

Technically dick in English is an assertion, not a swear word. Of course mercins (sic) tend to skew anything they touch even language :/ ....

tomtom13 commented 7 years ago

State after plugging in a secondary lan connection (eno1)

docker0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 172.17.0.1 netmask 255.255.0.0 broadcast 0.0.0.0 inet6 fe80::42:acff:fe03:256f prefixlen 64 scopeid 0x20 ether 02:42:ac:03:25:6f txqueuelen 0 (Ethernet) RX packets 70417 bytes 25661305 (24.4 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 64157 bytes 21834996 (20.8 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

eno1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 192.168.123.200 netmask 255.255.255.0 broadcast 192.168.123.255 inet6 fe80::76d0:2bff:fe9a:6f7f prefixlen 64 scopeid 0x20 ether 74:d0:2b:9a:6f:7f txqueuelen 1000 (Ethernet) RX packets 967075 bytes 1352363357 (1.2 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 185722 bytes 35569117 (33.9 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 device interrupt 18 memory 0xfb600000-fb620000

enp11s0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500 ether 74:d0:2b:9a:27:55 txqueuelen 1000 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 device interrupt 19 memory 0xfb100000-fb120000

enp3s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 ether 00:10:18:aa:7a:d0 txqueuelen 1000 (Ethernet) RX packets 5345 bytes 481364 (470.0 KiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 4243 bytes 420704 (410.8 KiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

enp3s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 ether 00:10:18:aa:7a:d0 txqueuelen 1000 (Ethernet) RX packets 28311 bytes 2044847 (1.9 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 18164 bytes 1780114 (1.6 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

enp4s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 ether 00:10:18:aa:7a:d0 txqueuelen 1000 (Ethernet) RX packets 58137 bytes 6010185 (5.7 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 2820 bytes 320572 (313.0 KiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

enp4s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 ether 00:10:18:aa:7a:d0 txqueuelen 1000 (Ethernet) RX packets 54615 bytes 4005192 (3.8 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 3509 bytes 908502 (887.2 KiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6 ::1 prefixlen 128 scopeid 0x10 loop txqueuelen 1 (Local Loopback) RX packets 43112 bytes 24189856 (23.0 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 43112 bytes 24189856 (23.0 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

team0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 192.168.123.201 netmask 255.255.255.255 broadcast 192.168.123.201 inet6 fe80::210:18ff:feaa:7ad0 prefixlen 64 scopeid 0x20 ether 00:10:18:aa:7a:d0 txqueuelen 1000 (Ethernet) RX packets 146403 bytes 9905770 (9.4 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 20252 bytes 2222064 (2.1 MiB) TX errors 0 dropped 4 overruns 0 carrier 0 collisions 0

veth0337b14: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet6 fe80::f489:b6ff:feed:9d4f prefixlen 64 scopeid 0x20 ether f6:89:b6:ed:9d:4f txqueuelen 0 (Ethernet) RX packets 8 bytes 648 (648.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 4713 bytes 590658 (576.8 KiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

veth50c611b: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet6 fe80::a8a8:feff:fe08:6d1a prefixlen 64 scopeid 0x20 ether aa:a8:fe:08:6d:1a txqueuelen 0 (Ethernet) RX packets 21348 bytes 2251788 (2.1 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 17628 bytes 2188740 (2.0 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

vetha2e6f60: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet6 fe80::8439:f1ff:fe4a:6b93 prefixlen 64 scopeid 0x20 ether 86:39:f1:4a:6b:93 txqueuelen 0 (Ethernet) RX packets 20956 bytes 14699982 (14.0 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 27216 bytes 4867567 (4.6 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

vethafb0d52: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet6 fe80::48e7:9fff:fea9:1d8b prefixlen 64 scopeid 0x20 ether 4a:e7:9f:a9:1d:8b txqueuelen 0 (Ethernet) RX packets 28105 bytes 9694725 (9.2 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 28764 bytes 15961777 (15.2 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

tomtom13 commented 7 years ago

route


[root@tevva-server /]# cat route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.123.254 0.0.0.0         UG    350    0        0 team0
192.168.123.201 0.0.0.0         255.255.255.255 UH    350    0        0 team0
192.168.123.254 0.0.0.0         255.255.255.255 UH    350    0        0 team0
[root@tevva-server /]# cat route2
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.123.254 0.0.0.0         UG    100    0        0 eno1
0.0.0.0         192.168.123.254 0.0.0.0         UG    350    0        0 team0
172.17.0.0      0.0.0.0         255.255.0.0     U     0      0        0 docker0
192.168.123.0   0.0.0.0         255.255.255.0   U     100    0        0 eno1
192.168.123.201 0.0.0.0         255.255.255.255 UH    350    0        0 team0
192.168.123.254 0.0.0.0         255.255.255.255 UH    350    0        0 team0
tomtom13 commented 7 years ago

ifconfig

[root@tevva-server /]# cat ifconfig.out
eno1: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 74:d0:2b:9a:6f:7f  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 18  memory 0xfb600000-fb620000

enp11s0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 74:d0:2b:9a:27:55  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 19  memory 0xfb100000-fb120000

enp3s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 72  bytes 5312 (5.1 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 18  bytes 1440 (1.4 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp3s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 11  bytes 1152 (1.1 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 4  bytes 478 (478.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp4s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 16  bytes 1892 (1.8 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 26  bytes 2340 (2.2 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp4s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 12  bytes 1216 (1.1 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 11  bytes 1794 (1.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1  (Local Loopback)
        RX packets 145  bytes 60156 (58.7 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 145  bytes 60156 (58.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

team0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.123.201  netmask 255.255.255.255  broadcast 192.168.123.201
        inet6 fe80::210:18ff:feaa:7ad0  prefixlen 64  scopeid 0x20<link>
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 107  bytes 7134 (6.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 47  bytes 4202 (4.1 KiB)
        TX errors 0  dropped 4 overruns 0  carrier 0  collisions 0

[root@tevva-server /]# cat ifconfig2.out
docker0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 172.17.0.1  netmask 255.255.0.0  broadcast 0.0.0.0
        inet6 fe80::42:a2ff:fef1:ca16  prefixlen 64  scopeid 0x20<link>
        ether 02:42:a2:f1:ca:16  txqueuelen 0  (Ethernet)
        RX packets 6836  bytes 2830756 (2.6 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 6447  bytes 2503099 (2.3 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eno1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.123.200  netmask 255.255.255.0  broadcast 192.168.123.255
        inet6 fe80::76d0:2bff:fe9a:6f7f  prefixlen 64  scopeid 0x20<link>
        ether 74:d0:2b:9a:6f:7f  txqueuelen 1000  (Ethernet)
        RX packets 1410  bytes 187327 (182.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1297  bytes 654929 (639.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 18  memory 0xfb600000-fb620000

enp11s0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 74:d0:2b:9a:27:55  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 19  memory 0xfb100000-fb120000

enp3s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 205  bytes 15287 (14.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 185  bytes 16458 (16.0 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp3s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 272  bytes 19136 (18.6 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 104  bytes 11092 (10.8 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp4s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 1444  bytes 202275 (197.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 496  bytes 43737 (42.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp4s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 368  bytes 25672 (25.0 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 141  bytes 13080 (12.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1  (Local Loopback)
        RX packets 2603  bytes 843270 (823.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2603  bytes 843270 (823.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

team0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.123.201  netmask 255.255.255.255  broadcast 192.168.123.201
        inet6 fe80::210:18ff:feaa:7ad0  prefixlen 64  scopeid 0x20<link>
        ether 00:10:18:aa:7a:d0  txqueuelen 1000  (Ethernet)
        RX packets 2282  bytes 220572 (215.4 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 834  bytes 68249 (66.6 KiB)
        TX errors 0  dropped 4 overruns 0  carrier 0  collisions 0

veth8582648: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::4869:1bff:fe45:4995  prefixlen 64  scopeid 0x20<link>
        ether 4a:69:1b:45:49:95  txqueuelen 0  (Ethernet)
        RX packets 703  bytes 69181 (67.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 604  bytes 122804 (119.9 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

veth9a89e0f: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::f8ef:85ff:fe11:a587  prefixlen 64  scopeid 0x20<link>
        ether fa:ef:85:11:a5:87  txqueuelen 0  (Ethernet)
        RX packets 3511  bytes 1087924 (1.0 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 3212  bytes 1875665 (1.7 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

vethda0c913: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::ec13:d8ff:fe1a:120e  prefixlen 64  scopeid 0x20<link>
        ether ee:13:d8:1a:12:0e  txqueuelen 0  (Ethernet)
        RX packets 2614  bytes 1768707 (1.6 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2905  bytes 536642 (524.0 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

vethf9d25fa: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::804d:69ff:fe87:9227  prefixlen 64  scopeid 0x20<link>
        ether 82:4d:69:87:92:27  txqueuelen 0  (Ethernet)
        RX packets 8  bytes 648 (648.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 139  bytes 16896 (16.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
tomtom13 commented 7 years ago

ping goes through nicelly, with only team0 interface and with both interfaces in the loop.

[root@tevva-server /]# cat ping
PING 192.168.123.254 (192.168.123.254) 56(84) bytes of data.
64 bytes from 192.168.123.254: icmp_seq=1 ttl=64 time=0.281 ms
64 bytes from 192.168.123.254: icmp_seq=2 ttl=64 time=0.293 ms
64 bytes from 192.168.123.254: icmp_seq=3 ttl=64 time=0.265 ms
64 bytes from 192.168.123.254: icmp_seq=4 ttl=64 time=0.298 ms
64 bytes from 192.168.123.254: icmp_seq=5 ttl=64 time=0.361 ms

--- 192.168.123.254 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 3999ms
rtt min/avg/max/mdev = 0.265/0.299/0.361/0.037 ms
tomtom13 commented 7 years ago

dmesg - sorry for that but I only have one that I've captured after eno1 was plugged in.

[root@tevva-server /]# cat dmesg
[    0.000000] Linux version 4.6.0-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-4) (GCC) ) #1 SMP Mon May 16 10:54:52 EDT 2016
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-4.6.0-1.el7.elrepo.x86_64 root=UUID=1348a9ac-a247-432a-8307-84b5d03c9e62 ro rootflags=subvol=root crashkernel=auto rhgb quiet LANG=en_US.UTF-8
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] x86/fpu: Using 'eager' FPU context switches.
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009e7ff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009e800-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bc153fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bc154000-0x00000000bc439fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bc43a000-0x00000000bc547fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bc548000-0x00000000bc76bfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bc76c000-0x00000000bd730fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bd731000-0x00000000bd731fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bd732000-0x00000000bd7b7fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bd7b8000-0x00000000bdbf8fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bdbf9000-0x00000000bdff3fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdff4000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000043fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: System manufacturer System Product Name/P9X79 WS, BIOS 4404 10/04/2013
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x440000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-CFFFF write-protect
[    0.000000]   D0000-E7FFF uncachable
[    0.000000]   E8000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000000 mask 3FFC00000000 write-back
[    0.000000]   1 base 000400000000 mask 3FFFC0000000 write-back
[    0.000000]   2 base 0000BF000000 mask 3FFFFF000000 uncachable
[    0.000000]   3 base 0000C0000000 mask 3FFFC0000000 uncachable
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT
[    0.000000] total RAM covered: 16368M
[    0.000000] Found optimal setting for mtrr clean up
[    0.000000]  gran_size: 64K  chunk_size: 32M         num_reg: 6      lose cover RAM: 0G
[    0.000000] e820: update [mem 0xbf000000-0xffffffff] usable ==> reserved
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fd940-0x000fd94f] mapped at [ffff8800000fd940]
[    0.000000] Base memory trampoline at [ffff880000098000] 98000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x021d3000, 0x021d3fff] PGTABLE
[    0.000000] BRK [0x021d4000, 0x021d4fff] PGTABLE
[    0.000000] BRK [0x021d5000, 0x021d5fff] PGTABLE
[    0.000000] BRK [0x021d6000, 0x021d6fff] PGTABLE
[    0.000000] BRK [0x021d7000, 0x021d7fff] PGTABLE
[    0.000000] BRK [0x021d8000, 0x021d8fff] PGTABLE
[    0.000000] RAMDISK: [mem 0x35c1f000-0x36e07fff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F0490 000024 (v02 ALASKA)
[    0.000000] ACPI: XSDT 0x00000000BC470070 00005C (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FACP 0x00000000BC47A7A8 00010C (v05 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: DSDT 0x00000000BC470168 00A640 (v02 ALASKA A M I    00000016 INTL 20051117)
[    0.000000] ACPI: FACS 0x00000000BC763080 000040
[    0.000000] ACPI: APIC 0x00000000BC47A8B8 000100 (v03 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FPDT 0x00000000BC47A9B8 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: MCFG 0x00000000BC47AA00 00003C (v01 ALASKA OEMMCFG. 01072009 MSFT 00000097)
[    0.000000] ACPI: HPET 0x00000000BC47AA40 000038 (v01 ALASKA A M I    01072009 AMI. 00000005)
[    0.000000] ACPI: BGRT 0x00000000BC547BF8 000038 (v00 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x00000000BC47AAD0 0CD128 (v02 INTEL  CpuPm    00004000 INTL 20051117)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000043fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffdc000-0x43fffdfff]
[    0.000000] kexec_core: crashkernel: memory value expected
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000043fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009dfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000bc153fff]
[    0.000000]   node   0: [mem 0x00000000bd731000-0x00000000bd731fff]
[    0.000000]   node   0: [mem 0x00000000bd7b8000-0x00000000bdbf8fff]
[    0.000000]   node   0: [mem 0x00000000bdff4000-0x00000000bdffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000043fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000043fffffff]
[    0.000000] On node 0 totalpages: 4179263
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3997 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 11991 pages used for memmap
[    0.000000]   DMA32 zone: 767394 pages, LIFO batch:31
[    0.000000]   Normal zone: 53248 pages used for memmap
[    0.000000]   Normal zone: 3407872 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 12 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009efff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc154000-0xbc439fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc43a000-0xbc547fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc548000-0xbc76bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc76c000-0xbd730fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbd732000-0xbd7b7fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdbf9000-0xbdff3fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xdfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.000000] e820: [mem 0xbe000000-0xdfffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:12 nr_cpu_ids:12 nr_node_ids:1
[    0.000000] percpu: Embedded 34 pages/cpu @ffff88042f200000 s98904 r8192 d32168 u262144
[    0.000000] pcpu-alloc: s98904 r8192 d32168 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 -- -- -- --
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 4113939
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-4.6.0-1.el7.elrepo.x86_64 root=UUID=1348a9ac-a247-432a-8307-84b5d03c9e62 ro rootflags=subvol=root crashkernel=auto rhgb quiet LANG=en_US.UTF-8
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Memory: 16350128K/16717052K available (7276K kernel code, 1444K rwdata, 3204K rodata, 1804K init, 2672K bss, 366924K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=12, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  Build-time adjustment of leaf fanout to 64.
[    0.000000]  RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=12.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=12
[    0.000000] NR_IRQS:524544 nr_irqs:928 16
[    0.000000]  Offload RCU callbacks from all CPUs
[    0.000000]  Offload RCU callbacks from CPUs: 0-11.
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2001.297 MHz processor
[    0.000043] Calibrating delay loop (skipped), value calculated using timer frequency.. 4002.59 BogoMIPS (lpj=2001297)
[    0.000046] pid_max: default: 32768 minimum: 301
[    0.000054] ACPI: Core revision 20160108
[    0.061468] ACPI: 2 ACPI AML tables successfully acquired and loaded

[    0.061499] Security Framework initialized
[    0.061501] SELinux:  Initializing.
[    0.061509] SELinux:  Starting in permissive mode
[    0.062962] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.066949] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.068609] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.068634] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.068971] CPU: Physical Processor ID: 0
[    0.068973] CPU: Processor Core ID: 0
[    0.068979] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    0.068980] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.068982] mce: CPU supports 18 MCE banks
[    0.069013] CPU0: Thermal monitoring enabled (TM1)
[    0.069037] process: using mwait in idle threads
[    0.069041] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    0.069042] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[    0.069529] Freeing SMP alternatives memory: 28K (ffffffff81f2e000 - ffffffff81f35000)
[    0.077667] ftrace: allocating 28897 entries in 113 pages
[    0.095052] smpboot: Max logical packages: 2
[    0.095055] smpboot: APIC(0) Converting physical 0 to logical package 0
[    0.095155] x2apic: IRQ remapping doesn't support X2APIC mode
[    0.095202] Switched APIC routing to physical flat.
[    0.095688] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.105693] TSC deadline timer enabled
[    0.105696] smpboot: CPU0: Genuine Intel(R) CPU  @ 2.00GHz (family: 0x6, model: 0x2d, stepping: 0x5)
[    0.105714] Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
[    0.105738] core: PEBS disabled due to CPU errata, please upgrade microcode
[    0.105741] ... version:                3
[    0.105742] ... bit width:              48
[    0.105743] ... generic registers:      4
[    0.105744] ... value mask:             0000ffffffffffff
[    0.105746] ... max period:             0000ffffffffffff
[    0.105747] ... fixed-purpose events:   3
[    0.105748] ... event mask:             000000070000000f
[    0.106759] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.106882] x86: Booting SMP configuration:
[    0.106884] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7  #8  #9 #10 #11
[    0.793742] x86: Booted up 1 node, 12 CPUs
[    0.793747] smpboot: Total of 12 processors activated (48078.96 BogoMIPS)
[    0.814504] devtmpfs: initialized
[    0.814573] x86/mm: Memory block size: 128MB
[    0.818664] evm: security.selinux
[    0.818666] evm: security.ima
[    0.818667] evm: security.capability
[    0.818762] PM: Registering ACPI NVS region [mem 0xbc548000-0xbc76bfff] (2244608 bytes)
[    0.818805] PM: Registering ACPI NVS region [mem 0xbd732000-0xbd7b7fff] (548864 bytes)
[    0.818916] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.819018] atomic64_test: passed for x86-64 platform with CX8 and with SSE
[    0.819021] pinctrl core: initialized pinctrl subsystem
[    0.820064] NET: Registered protocol family 16
[    0.822812] cpuidle: using governor menu
[    0.822920] ACPI: bus type PCI registered
[    0.822922] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.823006] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000)
[    0.823009] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820
[    0.823025] PCI: Using configuration type 1 for base access
[    0.823079] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    0.827986] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    0.827989] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.828315] ACPI: Added _OSI(Module Device)
[    0.828317] ACPI: Added _OSI(Processor Device)
[    0.828319] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.828320] ACPI: Added _OSI(Processor Aggregator Device)
[    0.828534] ACPI: Executed 1 blocks of module-level executable AML code
[    0.974528] ACPI : EC: EC started
[    0.974551] ACPI: Interpreter enabled
[    0.974569] ACPI: (supports S0 S3 S4 S5)
[    0.974570] ACPI: Using IOAPIC for interrupt routing
[    0.974602] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.991465] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe])
[    0.991472] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.991647] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug PME AER]
[    0.991806] acpi PNP0A08:00: _OSC: OS now controls [PCIeCapability]
[    0.992175] PCI host bridge to bus 0000:00
[    0.992178] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    0.992180] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    0.992182] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    0.992189] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.992191] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.992193] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000dffff window]
[    0.992196] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfbffffff window]
[    0.992198] pci_bus 0000:00: root bus resource [mem 0x440000000-0x380fffffffff window]
[    0.992200] pci_bus 0000:00: root bus resource [bus 00-fe]
[    0.992213] pci 0000:00:00.0: [8086:3c00] type 00 class 0x060000
[    0.992284] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    0.992384] pci 0000:00:01.0: [8086:3c02] type 01 class 0x060400
[    0.992460] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.992527] pci 0000:00:01.0: System wakeup disabled by ACPI
[    0.992572] pci 0000:00:01.1: [8086:3c03] type 01 class 0x060400
[    0.992647] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    0.992711] pci 0000:00:01.1: System wakeup disabled by ACPI
[    0.992759] pci 0000:00:02.0: [8086:3c04] type 01 class 0x060400
[    0.992834] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[    0.992897] pci 0000:00:02.0: System wakeup disabled by ACPI
[    0.992944] pci 0000:00:03.0: [8086:3c08] type 01 class 0x060400
[    0.993019] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    0.993083] pci 0000:00:03.0: System wakeup disabled by ACPI
[    0.993129] pci 0000:00:05.0: [8086:3c28] type 00 class 0x088000
[    0.993269] pci 0000:00:05.2: [8086:3c2a] type 00 class 0x088000
[    0.993401] pci 0000:00:05.4: [8086:3c2c] type 00 class 0x080020
[    0.993414] pci 0000:00:05.4: reg 0x10: [mem 0xfb625000-0xfb625fff]
[    0.993556] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
[    0.993647] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
[    0.993753] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
[    0.993775] pci 0000:00:16.0: reg 0x10: [mem 0xfb624000-0xfb62400f 64bit]
[    0.993853] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    0.993947] pci 0000:00:19.0: [8086:1503] type 00 class 0x020000
[    0.993963] pci 0000:00:19.0: reg 0x10: [mem 0xfb600000-0xfb61ffff]
[    0.993972] pci 0000:00:19.0: reg 0x14: [mem 0xfb623000-0xfb623fff]
[    0.993981] pci 0000:00:19.0: reg 0x18: [io  0xf040-0xf05f]
[    0.994044] pci 0000:00:19.0: PME# supported from D0 D3hot D3cold
[    0.994095] pci 0000:00:19.0: System wakeup disabled by ACPI
[    0.994138] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
[    0.994157] pci 0000:00:1a.0: reg 0x10: [mem 0xfb622000-0xfb6223ff]
[    0.994249] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    0.994301] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    0.994345] pci 0000:00:1b.0: [8086:1d20] type 00 class 0x040300
[    0.994362] pci 0000:00:1b.0: reg 0x10: [mem 0x380ffff00000-0x380ffff03fff 64bit]
[    0.994438] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    0.994526] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400
[    0.994606] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.994660] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    0.994703] pci 0000:00:1c.1: [8086:1d12] type 01 class 0x060400
[    0.994783] pci 0000:00:1c.1: PME# supported from D0 D3hot D3cold
[    0.994838] pci 0000:00:1c.1: System wakeup disabled by ACPI
[    0.994880] pci 0000:00:1c.2: [8086:1d14] type 01 class 0x060400
[    0.994960] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold
[    0.995015] pci 0000:00:1c.2: System wakeup disabled by ACPI
[    0.995058] pci 0000:00:1c.4: [8086:1d18] type 01 class 0x060400
[    0.995137] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    0.995191] pci 0000:00:1c.4: System wakeup disabled by ACPI
[    0.995242] pci 0000:00:1c.5: [8086:1d1a] type 01 class 0x060400
[    0.995322] pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold
[    0.995377] pci 0000:00:1c.5: System wakeup disabled by ACPI
[    0.995419] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400
[    0.995499] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[    0.995553] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    0.995596] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
[    0.995614] pci 0000:00:1d.0: reg 0x10: [mem 0xfb621000-0xfb6213ff]
[    0.995702] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    0.995753] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    0.995792] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    0.995888] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    0.995929] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
[    0.996114] pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601
[    0.996131] pci 0000:00:1f.2: reg 0x10: [io  0xf090-0xf097]
[    0.996139] pci 0000:00:1f.2: reg 0x14: [io  0xf080-0xf083]
[    0.996147] pci 0000:00:1f.2: reg 0x18: [io  0xf070-0xf077]
[    0.996155] pci 0000:00:1f.2: reg 0x1c: [io  0xf060-0xf063]
[    0.996163] pci 0000:00:1f.2: reg 0x20: [io  0xf020-0xf03f]
[    0.996172] pci 0000:00:1f.2: reg 0x24: [mem 0xfb620000-0xfb6207ff]
[    0.996218] pci 0000:00:1f.2: PME# supported from D3hot
[    0.996304] pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500
[    0.996320] pci 0000:00:1f.3: reg 0x10: [mem 0x380ffff04000-0x380ffff040ff 64bit]
[    0.996342] pci 0000:00:1f.3: reg 0x20: [io  0xf000-0xf01f]
[    0.996490] pci 0000:03:00.0: [14e4:1639] type 00 class 0x020000
[    0.996507] pci 0000:03:00.0: reg 0x10: [mem 0xf8000000-0xf9ffffff 64bit]
[    0.996599] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[    0.996666] pci 0000:03:00.1: [14e4:1639] type 00 class 0x020000
[    0.996683] pci 0000:03:00.1: reg 0x10: [mem 0xf6000000-0xf7ffffff 64bit]
[    0.996774] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold
[    0.998231] pci 0000:00:01.0: PCI bridge to [bus 03]
[    0.998250] pci 0000:00:01.0:   bridge window [mem 0xf6000000-0xf9ffffff]
[    0.998309] pci 0000:04:00.0: [14e4:1639] type 00 class 0x020000
[    0.998325] pci 0000:04:00.0: reg 0x10: [mem 0xf4000000-0xf5ffffff 64bit]
[    0.998412] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
[    0.998477] pci 0000:04:00.1: [14e4:1639] type 00 class 0x020000
[    0.998493] pci 0000:04:00.1: reg 0x10: [mem 0xf2000000-0xf3ffffff 64bit]
[    0.998579] pci 0000:04:00.1: PME# supported from D0 D3hot D3cold
[    1.000229] pci 0000:00:01.1: PCI bridge to [bus 04]
[    1.000238] pci 0000:00:01.1:   bridge window [mem 0xf2000000-0xf5ffffff]
[    1.000308] pci 0000:01:00.0: [10de:0a65] type 00 class 0x030000
[    1.000318] pci 0000:01:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff]
[    1.000328] pci 0000:01:00.0: reg 0x14: [mem 0xc0000000-0xcfffffff 64bit pref]
[    1.000337] pci 0000:01:00.0: reg 0x1c: [mem 0xd0000000-0xd1ffffff 64bit pref]
[    1.000344] pci 0000:01:00.0: reg 0x24: [io  0xe000-0xe07f]
[    1.000351] pci 0000:01:00.0: reg 0x30: [mem 0xfb000000-0xfb07ffff pref]
[    1.000436] pci 0000:01:00.1: [10de:0be3] type 00 class 0x040300
[    1.000446] pci 0000:01:00.1: reg 0x10: [mem 0xfb080000-0xfb083fff]
[    1.002236] pci 0000:00:02.0: PCI bridge to [bus 01]
[    1.002242] pci 0000:00:02.0:   bridge window [io  0xe000-0xefff]
[    1.002259] pci 0000:00:02.0:   bridge window [mem 0xfa000000-0xfb0fffff]
[    1.002265] pci 0000:00:02.0:   bridge window [mem 0xc0000000-0xd1ffffff 64bit pref]
[    1.002310] pci 0000:00:03.0: PCI bridge to [bus 02]
[    1.002365] pci 0000:00:11.0: PCI bridge to [bus 05]
[    1.002420] pci 0000:00:1c.0: PCI bridge to [bus 06]
[    1.002492] pci 0000:07:00.0: [1106:3403] type 00 class 0x0c0010
[    1.002523] pci 0000:07:00.0: reg 0x10: [mem 0xfb500000-0xfb5007ff 64bit]
[    1.002539] pci 0000:07:00.0: reg 0x18: [io  0xd000-0xd0ff]
[    1.002669] pci 0000:07:00.0: supports D2
[    1.002671] pci 0000:07:00.0: PME# supported from D2 D3hot D3cold
[    1.004245] pci 0000:00:1c.1: PCI bridge to [bus 07]
[    1.004251] pci 0000:00:1c.1:   bridge window [io  0xd000-0xdfff]
[    1.004268] pci 0000:00:1c.1:   bridge window [mem 0xfb500000-0xfb5fffff]
[    1.004338] pci 0000:08:00.0: [1b4b:9130] type 00 class 0x010601
[    1.004360] pci 0000:08:00.0: reg 0x10: [io  0xc040-0xc047]
[    1.004373] pci 0000:08:00.0: reg 0x14: [io  0xc030-0xc033]
[    1.004386] pci 0000:08:00.0: reg 0x18: [io  0xc020-0xc027]
[    1.004399] pci 0000:08:00.0: reg 0x1c: [io  0xc010-0xc013]
[    1.004413] pci 0000:08:00.0: reg 0x20: [io  0xc000-0xc00f]
[    1.004426] pci 0000:08:00.0: reg 0x24: [mem 0xfb410000-0xfb4107ff]
[    1.004439] pci 0000:08:00.0: reg 0x30: [mem 0xfb400000-0xfb40ffff pref]
[    1.004505] pci 0000:08:00.0: PME# supported from D3hot
[    1.006246] pci 0000:00:1c.2: PCI bridge to [bus 08]
[    1.006252] pci 0000:00:1c.2:   bridge window [io  0xc000-0xcfff]
[    1.006270] pci 0000:00:1c.2:   bridge window [mem 0xfb400000-0xfb4fffff]
[    1.006343] pci 0000:09:00.0: [1b21:1042] type 00 class 0x0c0330
[    1.006377] pci 0000:09:00.0: reg 0x10: [mem 0xfb300000-0xfb307fff 64bit]
[    1.006540] pci 0000:09:00.0: PME# supported from D3hot D3cold
[    1.008252] pci 0000:00:1c.4: PCI bridge to [bus 09]
[    1.008261] pci 0000:00:1c.4:   bridge window [mem 0xfb300000-0xfb3fffff]
[    1.008347] pci 0000:0a:00.0: [1b21:1042] type 00 class 0x0c0330
[    1.008381] pci 0000:0a:00.0: reg 0x10: [mem 0xfb200000-0xfb207fff 64bit]
[    1.008544] pci 0000:0a:00.0: PME# supported from D3hot D3cold
[    1.010257] pci 0000:00:1c.5: PCI bridge to [bus 0a]
[    1.010265] pci 0000:00:1c.5:   bridge window [mem 0xfb200000-0xfb2fffff]
[    1.010357] pci 0000:0b:00.0: [8086:10d3] type 00 class 0x020000
[    1.010391] pci 0000:0b:00.0: reg 0x10: [mem 0xfb100000-0xfb11ffff]
[    1.010429] pci 0000:0b:00.0: reg 0x18: [io  0xb000-0xb01f]
[    1.010449] pci 0000:0b:00.0: reg 0x1c: [mem 0xfb120000-0xfb123fff]
[    1.010624] pci 0000:0b:00.0: PME# supported from D0 D3hot D3cold
[    1.012264] pci 0000:00:1c.7: PCI bridge to [bus 0b]
[    1.012270] pci 0000:00:1c.7:   bridge window [io  0xb000-0xbfff]
[    1.012287] pci 0000:00:1c.7:   bridge window [mem 0xfb100000-0xfb1fffff]
[    1.012362] pci 0000:00:1e.0: PCI bridge to [bus 0c] (subtractive decode)
[    1.012372] pci 0000:00:1e.0:   bridge window [io  0x0000-0x03af window] (subtractive decode)
[    1.012374] pci 0000:00:1e.0:   bridge window [io  0x03e0-0x0cf7 window] (subtractive decode)
[    1.012376] pci 0000:00:1e.0:   bridge window [io  0x03b0-0x03df window] (subtractive decode)
[    1.012378] pci 0000:00:1e.0:   bridge window [io  0x0d00-0xffff window] (subtractive decode)
[    1.012380] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    1.012382] pci 0000:00:1e.0:   bridge window [mem 0x000c0000-0x000dffff window] (subtractive decode)
[    1.012384] pci 0000:00:1e.0:   bridge window [mem 0xc0000000-0xfbffffff window] (subtractive decode)
[    1.012386] pci 0000:00:1e.0:   bridge window [mem 0x440000000-0x380fffffffff window] (subtractive decode)
[    1.012933] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff])
[    1.012938] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.012966] acpi PNP0A03:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    1.013029] PCI host bridge to bus 0000:ff
[    1.013032] pci_bus 0000:ff: root bus resource [bus ff]
[    1.013042] pci 0000:ff:08.0: [8086:3c80] type 00 class 0x088000
[    1.013108] pci 0000:ff:08.3: [8086:3c83] type 00 class 0x088000
[    1.013180] pci 0000:ff:08.4: [8086:3c84] type 00 class 0x088000
[    1.013266] pci 0000:ff:09.0: [8086:3c90] type 00 class 0x088000
[    1.013329] pci 0000:ff:09.3: [8086:3c93] type 00 class 0x088000
[    1.013399] pci 0000:ff:09.4: [8086:3c94] type 00 class 0x088000
[    1.013476] pci 0000:ff:0a.0: [8086:3cc0] type 00 class 0x088000
[    1.013530] pci 0000:ff:0a.1: [8086:3cc1] type 00 class 0x088000
[    1.013583] pci 0000:ff:0a.2: [8086:3cc2] type 00 class 0x088000
[    1.013637] pci 0000:ff:0a.3: [8086:3cd0] type 00 class 0x088000
[    1.013693] pci 0000:ff:0b.0: [8086:3ce0] type 00 class 0x088000
[    1.013747] pci 0000:ff:0b.3: [8086:3ce3] type 00 class 0x088000
[    1.013802] pci 0000:ff:0c.0: [8086:3ce8] type 00 class 0x088000
[    1.013853] pci 0000:ff:0c.1: [8086:3ce8] type 00 class 0x088000
[    1.013905] pci 0000:ff:0c.2: [8086:3ce8] type 00 class 0x088000
[    1.013960] pci 0000:ff:0c.6: [8086:3cf4] type 00 class 0x088000
[    1.014012] pci 0000:ff:0c.7: [8086:3cf6] type 00 class 0x088000
[    1.014065] pci 0000:ff:0d.0: [8086:3ce8] type 00 class 0x088000
[    1.014117] pci 0000:ff:0d.1: [8086:3ce8] type 00 class 0x088000
[    1.014171] pci 0000:ff:0d.2: [8086:3ce8] type 00 class 0x088000
[    1.014225] pci 0000:ff:0d.6: [8086:3cf5] type 00 class 0x088000
[    1.014284] pci 0000:ff:0e.0: [8086:3ca0] type 00 class 0x088000
[    1.014339] pci 0000:ff:0e.1: [8086:3c46] type 00 class 0x110100
[    1.014402] pci 0000:ff:0f.0: [8086:3ca8] type 00 class 0x088000
[    1.014469] pci 0000:ff:0f.1: [8086:3c71] type 00 class 0x088000
[    1.014535] pci 0000:ff:0f.2: [8086:3caa] type 00 class 0x088000
[    1.014601] pci 0000:ff:0f.3: [8086:3cab] type 00 class 0x088000
[    1.014668] pci 0000:ff:0f.4: [8086:3cac] type 00 class 0x088000
[    1.014734] pci 0000:ff:0f.5: [8086:3cad] type 00 class 0x088000
[    1.014797] pci 0000:ff:0f.6: [8086:3cae] type 00 class 0x088000
[    1.014854] pci 0000:ff:10.0: [8086:3cb0] type 00 class 0x088000
[    1.014920] pci 0000:ff:10.1: [8086:3cb1] type 00 class 0x088000
[    1.014987] pci 0000:ff:10.2: [8086:3cb2] type 00 class 0x088000
[    1.015056] pci 0000:ff:10.3: [8086:3cb3] type 00 class 0x088000
[    1.015124] pci 0000:ff:10.4: [8086:3cb4] type 00 class 0x088000
[    1.015191] pci 0000:ff:10.5: [8086:3cb5] type 00 class 0x088000
[    1.015263] pci 0000:ff:10.6: [8086:3cb6] type 00 class 0x088000
[    1.015331] pci 0000:ff:10.7: [8086:3cb7] type 00 class 0x088000
[    1.015395] pci 0000:ff:11.0: [8086:3cb8] type 00 class 0x088000
[    1.015456] pci 0000:ff:13.0: [8086:3ce4] type 00 class 0x088000
[    1.015509] pci 0000:ff:13.1: [8086:3c43] type 00 class 0x110100
[    1.015564] pci 0000:ff:13.4: [8086:3ce6] type 00 class 0x110100
[    1.015617] pci 0000:ff:13.5: [8086:3c44] type 00 class 0x110100
[    1.015671] pci 0000:ff:13.6: [8086:3c45] type 00 class 0x088000
[    1.015844] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    1.015903] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15)
[    1.015960] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 10 11 12 14 *15)
[    1.016016] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 11 12 *14 15)
[    1.016071] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 *7 10 11 12 14 15)
[    1.016127] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
[    1.016183] ACPI: PCI Interrupt Link [LNKG] (IRQs *3 4 5 6 7 10 11 12 14 15)
[    1.016239] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 *5 6 7 10 11 12 14 15)
[    1.020205] ACPI: Enabled 2 GPEs in block 00 to 3F
[    1.020231] ACPI : EC: GPE = 0x1e, I/O: command/status = 0x66, data = 0x62
[    1.020380] vgaarb: setting as boot device: PCI:0000:01:00.0
[    1.020383] vgaarb: device added: PCI:0000:01:00.0,decodes=io+mem,owns=io+mem,locks=none
[    1.020391] vgaarb: loaded
[    1.020393] vgaarb: bridge control possible 0000:01:00.0
[    1.020498] SCSI subsystem initialized
[    1.020529] ACPI: bus type USB registered
[    1.020547] usbcore: registered new interface driver usbfs
[    1.020557] usbcore: registered new interface driver hub
[    1.020598] usbcore: registered new device driver usb
[    1.020751] PCI: Using ACPI for IRQ routing
[    1.027258] PCI: pci_cache_line_size set to 64 bytes
[    1.027403] e820: reserve RAM buffer [mem 0x0009e800-0x0009ffff]
[    1.027405] e820: reserve RAM buffer [mem 0xbc154000-0xbfffffff]
[    1.027407] e820: reserve RAM buffer [mem 0xbd732000-0xbfffffff]
[    1.027409] e820: reserve RAM buffer [mem 0xbdbf9000-0xbfffffff]
[    1.027410] e820: reserve RAM buffer [mem 0xbe000000-0xbfffffff]
[    1.027546] NetLabel: Initializing
[    1.027548] NetLabel:  domain hash size = 128
[    1.027548] NetLabel:  protocols = UNLABELED CIPSOv4
[    1.027565] NetLabel:  unlabeled traffic allowed by default
[    1.027663] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    1.027669] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    1.029719] clocksource: Switched to clocksource hpet
[    1.036996] VFS: Disk quotas dquot_6.6.0
[    1.037019] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.037180] pnp: PnP ACPI init
[    1.037304] system 00:00: [mem 0xfc000000-0xfcffffff] has been reserved
[    1.037307] system 00:00: [mem 0xfd000000-0xfdffffff] has been reserved
[    1.037310] system 00:00: [mem 0xfe000000-0xfeafffff] has been reserved
[    1.037312] system 00:00: [mem 0xfeb00000-0xfebfffff] has been reserved
[    1.037314] system 00:00: [mem 0xfed00400-0xfed3ffff] could not be reserved
[    1.037317] system 00:00: [mem 0xfed45000-0xfedfffff] has been reserved
[    1.037319] system 00:00: [mem 0xfee00000-0xfeefffff] has been reserved
[    1.037323] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    1.037474] system 00:01: [io  0x0290-0x029f] has been reserved
[    1.037478] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.037511] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    1.037602] system 00:03: [io  0x04d0-0x04d1] has been reserved
[    1.037605] system 00:03: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.037821] pnp 00:04: [dma 0 disabled]
[    1.037878] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active)
[    1.038106] system 00:05: [io  0x0400-0x0453] could not be reserved
[    1.038108] system 00:05: [io  0x0458-0x047f] has been reserved
[    1.038111] system 00:05: [io  0x1180-0x119f] has been reserved
[    1.038113] system 00:05: [io  0x0500-0x057f] has been reserved
[    1.038115] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    1.038118] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    1.038120] system 00:05: [mem 0xff000000-0xffffffff] has been reserved
[    1.038124] system 00:05: Plug and Play ACPI device, IDs PNP0c01 (active)
[    1.038216] system 00:06: [io  0x0454-0x0457] has been reserved
[    1.038220] system 00:06: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[    1.038537] pnp: PnP ACPI: found 7 devices
[    1.045288] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    1.045382] pci 0000:00:01.0: PCI bridge to [bus 03]
[    1.045388] pci 0000:00:01.0:   bridge window [mem 0xf6000000-0xf9ffffff]
[    1.045396] pci 0000:00:01.1: PCI bridge to [bus 04]
[    1.045401] pci 0000:00:01.1:   bridge window [mem 0xf2000000-0xf5ffffff]
[    1.045410] pci 0000:00:02.0: PCI bridge to [bus 01]
[    1.045412] pci 0000:00:02.0:   bridge window [io  0xe000-0xefff]
[    1.045417] pci 0000:00:02.0:   bridge window [mem 0xfa000000-0xfb0fffff]
[    1.045421] pci 0000:00:02.0:   bridge window [mem 0xc0000000-0xd1ffffff 64bit pref]
[    1.045426] pci 0000:00:03.0: PCI bridge to [bus 02]
[    1.045436] pci 0000:00:11.0: PCI bridge to [bus 05]
[    1.045450] pci 0000:00:1c.0: PCI bridge to [bus 06]
[    1.045461] pci 0000:00:1c.1: PCI bridge to [bus 07]
[    1.045464] pci 0000:00:1c.1:   bridge window [io  0xd000-0xdfff]
[    1.045469] pci 0000:00:1c.1:   bridge window [mem 0xfb500000-0xfb5fffff]
[    1.045478] pci 0000:00:1c.2: PCI bridge to [bus 08]
[    1.045481] pci 0000:00:1c.2:   bridge window [io  0xc000-0xcfff]
[    1.045486] pci 0000:00:1c.2:   bridge window [mem 0xfb400000-0xfb4fffff]
[    1.045495] pci 0000:00:1c.4: PCI bridge to [bus 09]
[    1.045500] pci 0000:00:1c.4:   bridge window [mem 0xfb300000-0xfb3fffff]
[    1.045508] pci 0000:00:1c.5: PCI bridge to [bus 0a]
[    1.045513] pci 0000:00:1c.5:   bridge window [mem 0xfb200000-0xfb2fffff]
[    1.045521] pci 0000:00:1c.7: PCI bridge to [bus 0b]
[    1.045524] pci 0000:00:1c.7:   bridge window [io  0xb000-0xbfff]
[    1.045529] pci 0000:00:1c.7:   bridge window [mem 0xfb100000-0xfb1fffff]
[    1.045538] pci 0000:00:1e.0: PCI bridge to [bus 0c]
[    1.045550] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    1.045552] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    1.045554] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    1.045556] pci_bus 0000:00: resource 7 [io  0x0d00-0xffff window]
[    1.045558] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window]
[    1.045560] pci_bus 0000:00: resource 9 [mem 0x000c0000-0x000dffff window]
[    1.045562] pci_bus 0000:00: resource 10 [mem 0xc0000000-0xfbffffff window]
[    1.045564] pci_bus 0000:00: resource 11 [mem 0x440000000-0x380fffffffff window]
[    1.045566] pci_bus 0000:03: resource 1 [mem 0xf6000000-0xf9ffffff]
[    1.045568] pci_bus 0000:04: resource 1 [mem 0xf2000000-0xf5ffffff]
[    1.045570] pci_bus 0000:01: resource 0 [io  0xe000-0xefff]
[    1.045572] pci_bus 0000:01: resource 1 [mem 0xfa000000-0xfb0fffff]
[    1.045574] pci_bus 0000:01: resource 2 [mem 0xc0000000-0xd1ffffff 64bit pref]
[    1.045576] pci_bus 0000:07: resource 0 [io  0xd000-0xdfff]
[    1.045578] pci_bus 0000:07: resource 1 [mem 0xfb500000-0xfb5fffff]
[    1.045580] pci_bus 0000:08: resource 0 [io  0xc000-0xcfff]
[    1.045582] pci_bus 0000:08: resource 1 [mem 0xfb400000-0xfb4fffff]
[    1.045584] pci_bus 0000:09: resource 1 [mem 0xfb300000-0xfb3fffff]
[    1.045586] pci_bus 0000:0a: resource 1 [mem 0xfb200000-0xfb2fffff]
[    1.045588] pci_bus 0000:0b: resource 0 [io  0xb000-0xbfff]
[    1.045590] pci_bus 0000:0b: resource 1 [mem 0xfb100000-0xfb1fffff]
[    1.045592] pci_bus 0000:0c: resource 4 [io  0x0000-0x03af window]
[    1.045594] pci_bus 0000:0c: resource 5 [io  0x03e0-0x0cf7 window]
[    1.045596] pci_bus 0000:0c: resource 6 [io  0x03b0-0x03df window]
[    1.045598] pci_bus 0000:0c: resource 7 [io  0x0d00-0xffff window]
[    1.045600] pci_bus 0000:0c: resource 8 [mem 0x000a0000-0x000bffff window]
[    1.045602] pci_bus 0000:0c: resource 9 [mem 0x000c0000-0x000dffff window]
[    1.045604] pci_bus 0000:0c: resource 10 [mem 0xc0000000-0xfbffffff window]
[    1.045606] pci_bus 0000:0c: resource 11 [mem 0x440000000-0x380fffffffff window]
[    1.045647] NET: Registered protocol family 2
[    1.045906] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    1.046195] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    1.046351] TCP: Hash tables configured (established 131072 bind 65536)
[    1.046396] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[    1.046466] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[    1.046580] NET: Registered protocol family 1
[    1.076855] pci 0000:01:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    1.077233] PCI: CLS 64 bytes, default 64
[    1.077293] Unpacking initramfs...
[    1.419095] Freeing initrd memory: 18340K (ffff880035c1f000 - ffff880036e08000)
[    1.419105] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    1.419108] software IO TLB [mem 0xb8154000-0xbc154000] (64MB) mapped at [ffff8800b8154000-ffff8800bc153fff]
[    1.419199] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    1.419201] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    1.419202] RAPL PMU: hw unit of domain package 2^-16 Joules
[    1.419203] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    1.420714] futex hash table entries: 4096 (order: 6, 262144 bytes)
[    1.420773] audit: initializing netlink subsys (disabled)
[    1.420792] audit: type=2000 audit(1477654719.376:1): initialized
[    1.421494] Initialise system trusted keyring
[    1.421634] workingset: timestamp_bits=34 max_order=22 bucket_order=0
[    1.423637] zbud: loaded
[    1.423951] Key type big_key registered
[    1.423954] SELinux:  Registering netfilter hooks
[    1.494848] NET: Registered protocol family 38
[    1.494858] Key type asymmetric registered
[    1.494862] Asymmetric key parser 'x509' registered
[    1.494921] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    1.494977] io scheduler noop registered
[    1.494981] io scheduler deadline registered (default)
[    1.495021] io scheduler cfq registered
[    1.496423] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    1.496432] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    1.496472] intel_idle: MWAIT substates: 0x21120
[    1.496473] intel_idle: v0.4.1 model 0x2D
[    1.496984] intel_idle: lapic_timer_reliable_states 0xffffffff
[    1.497074] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    1.497078] ACPI: Power Button [PWRB]
[    1.497127] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    1.497130] ACPI: Power Button [PWRF]
[    1.511617] GHES: HEST is not enabled!
[    1.511730] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.532321] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.533429] Non-volatile memory driver v1.3
[    1.533545] Linux agpgart interface v0.103
[    1.534739] rdac: device handler registered
[    1.534849] hp_sw: device handler registered
[    1.534852] emc: device handler registered
[    1.535029] alua: device handler registered
[    1.535074] libphy: Fixed MDIO Bus: probed
[    1.535151] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.535156] ehci-pci: EHCI PCI platform driver
[    1.535294] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    1.535359] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    1.535371] ehci-pci 0000:00:1a.0: debug port 2
[    1.539272] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    1.539287] ehci-pci 0000:00:1a.0: irq 23, io mem 0xfb622000
[    1.544693] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    1.544752] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    1.544754] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.544756] usb usb1: Product: EHCI Host Controller
[    1.544758] usb usb1: Manufacturer: Linux 4.6.0-1.el7.elrepo.x86_64 ehci_hcd
[    1.544760] usb usb1: SerialNumber: 0000:00:1a.0
[    1.544923] hub 1-0:1.0: USB hub found
[    1.544930] hub 1-0:1.0: 2 ports detected
[    1.545171] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    1.545254] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    1.545265] ehci-pci 0000:00:1d.0: debug port 2
[    1.549159] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    1.549165] ehci-pci 0000:00:1d.0: irq 23, io mem 0xfb621000
[    1.554690] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    1.554741] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    1.554743] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.554745] usb usb2: Product: EHCI Host Controller
[    1.554747] usb usb2: Manufacturer: Linux 4.6.0-1.el7.elrepo.x86_64 ehci_hcd
[    1.554749] usb usb2: SerialNumber: 0000:00:1d.0
[    1.554902] hub 2-0:1.0: USB hub found
[    1.554908] hub 2-0:1.0: 2 ports detected
[    1.555027] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.555034] ohci-pci: OHCI PCI platform driver
[    1.555050] uhci_hcd: USB Universal Host Controller Interface driver
[    1.555140] xhci_hcd 0000:09:00.0: xHCI Host Controller
[    1.555220] xhci_hcd 0000:09:00.0: new USB bus registered, assigned bus number 3
[    1.614607] xhci_hcd 0000:09:00.0: hcc params 0x0200f180 hci version 0x96 quirks 0x00080000
[    1.614819] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[    1.614821] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.614823] usb usb3: Product: xHCI Host Controller
[    1.614825] usb usb3: Manufacturer: Linux 4.6.0-1.el7.elrepo.x86_64 xhci-hcd
[    1.614827] usb usb3: SerialNumber: 0000:09:00.0
[    1.615025] hub 3-0:1.0: USB hub found
[    1.615035] hub 3-0:1.0: 2 ports detected
[    1.615126] xhci_hcd 0000:09:00.0: xHCI Host Controller
[    1.615236] xhci_hcd 0000:09:00.0: new USB bus registered, assigned bus number 4
[    1.615268] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.615289] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[    1.615291] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.615293] usb usb4: Product: xHCI Host Controller
[    1.615295] usb usb4: Manufacturer: Linux 4.6.0-1.el7.elrepo.x86_64 xhci-hcd
[    1.615297] usb usb4: SerialNumber: 0000:09:00.0
[    1.615505] hub 4-0:1.0: USB hub found
[    1.615517] hub 4-0:1.0: 2 ports detected
[    1.615681] xhci_hcd 0000:0a:00.0: xHCI Host Controller
[    1.615775] xhci_hcd 0000:0a:00.0: new USB bus registered, assigned bus number 5
[    1.675185] xhci_hcd 0000:0a:00.0: hcc params 0x0200f180 hci version 0x96 quirks 0x00080000
[    1.675395] usb usb5: New USB device found, idVendor=1d6b, idProduct=0002
[    1.675398] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.675400] usb usb5: Product: xHCI Host Controller
[    1.675401] usb usb5: Manufacturer: Linux 4.6.0-1.el7.elrepo.x86_64 xhci-hcd
[    1.675403] usb usb5: SerialNumber: 0000:0a:00.0
[    1.675596] hub 5-0:1.0: USB hub found
[    1.675606] hub 5-0:1.0: 2 ports detected
[    1.675729] xhci_hcd 0000:0a:00.0: xHCI Host Controller
[    1.675857] xhci_hcd 0000:0a:00.0: new USB bus registered, assigned bus number 6
[    1.675890] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.675911] usb usb6: New USB device found, idVendor=1d6b, idProduct=0003
[    1.675913] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.675915] usb usb6: Product: xHCI Host Controller
[    1.675917] usb usb6: Manufacturer: Linux 4.6.0-1.el7.elrepo.x86_64 xhci-hcd
[    1.675919] usb usb6: SerialNumber: 0000:0a:00.0
[    1.676120] hub 6-0:1.0: USB hub found
[    1.676132] hub 6-0:1.0: 2 ports detected
[    1.676273] usbcore: registered new interface driver usbserial
[    1.676281] usbcore: registered new interface driver usbserial_generic
[    1.676288] usbserial: USB Serial support registered for generic
[    1.676298] usbcore: registered new interface driver wishbone_serial
[    1.676304] usbserial: USB Serial support registered for wishbone_serial
[    1.676336] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    1.678996] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.679005] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.679133] mousedev: PS/2 mouse device common for all mice
[    1.679530] rtc_cmos 00:02: RTC can wake from S4
[    1.679748] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[    1.679779] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    1.679805] Intel P-state driver initializing.
[    1.719860] ledtrig-cpu: registered to indicate activity on CPUs
[    1.720680] hidraw: raw HID events driver (C) Jiri Kosina
[    1.720869] usbcore: registered new interface driver usbhid
[    1.720871] usbhid: USB HID core driver
[    1.720969] drop_monitor: Initializing network drop monitor service
[    1.721090] Initializing XFRM netlink socket
[    1.721315] NET: Registered protocol family 10
[    1.721811] NET: Registered protocol family 17
[    1.721833] bridge: automatic filtering via arp/ip/ip6tables has been deprecated. Update your scripts to load br_netfilter if you need this.
[    1.721848] Bridge firewalling registered
[    1.722584] microcode: CPU0 sig=0x206d5, pf=0x1, revision=0x513
[    1.722625] microcode: CPU1 sig=0x206d5, pf=0x1, revision=0x513
[    1.722666] microcode: CPU2 sig=0x206d5, pf=0x1, revision=0x513
[    1.722708] microcode: CPU3 sig=0x206d5, pf=0x1, revision=0x513
[    1.722718] microcode: CPU4 sig=0x206d5, pf=0x1, revision=0x513
[    1.722760] microcode: CPU5 sig=0x206d5, pf=0x1, revision=0x513
[    1.722807] microcode: CPU6 sig=0x206d5, pf=0x1, revision=0x513
[    1.722847] microcode: CPU7 sig=0x206d5, pf=0x1, revision=0x513
[    1.722887] microcode: CPU8 sig=0x206d5, pf=0x1, revision=0x513
[    1.722931] microcode: CPU9 sig=0x206d5, pf=0x1, revision=0x513
[    1.722946] microcode: CPU10 sig=0x206d5, pf=0x1, revision=0x513
[    1.722989] microcode: CPU11 sig=0x206d5, pf=0x1, revision=0x513
[    1.723143] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    1.723871] registered taskstats version 1
[    1.723888] Loading compiled-in X.509 certificates
[    1.723934] zswap: loaded using pool lzo/zbud
[    1.727369] Key type trusted registered
[    1.731155] Key type encrypted registered
[    1.731178] ima: No TPM chip found, activating TPM-bypass!
[    1.731232] evm: HMAC attrs: 0x1
[    1.732390] rtc_cmos 00:02: setting system clock to 2016-10-28 11:38:40 UTC (1477654720)
[    1.734388] Freeing unused kernel memory: 1804K (ffffffff81d6b000 - ffffffff81f2e000)
[    1.734392] Write protecting the kernel read-only data: 12288k
[    1.735075] Freeing unused kernel memory: 900K (ffff88000171f000 - ffff880001800000)
[    1.738791] Freeing unused kernel memory: 892K (ffff880001b21000 - ffff880001c00000)
[    1.741890] random: systemd urandom read with 3 bits of entropy available
[    1.759742] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    1.760107] systemd[1]: Detected architecture x86-64.
[    1.760112] systemd[1]: Running in initial RAM disk.
[    1.760145] systemd[1]: Set hostname to <tevva-server>.
[    1.800889] systemd[1]: Created slice -.slice.
[    1.800909] systemd[1]: Starting -.slice.
[    1.801003] systemd[1]: Listening on Journal Socket.
[    1.801021] systemd[1]: Starting Journal Socket.
[    1.801079] systemd[1]: Listening on udev Control Socket.
[    1.801093] systemd[1]: Starting udev Control Socket.
[    1.801113] systemd[1]: Reached target Swap.
[    1.801125] systemd[1]: Starting Swap.
[    1.801143] systemd[1]: Reached target Local File Systems.
[    1.801154] systemd[1]: Starting Local File Systems.
[    1.801261] systemd[1]: Created slice System Slice.
[    1.801277] systemd[1]: Starting System Slice.
[    1.812119] systemd[1]: Starting Setup Virtual Console...
[    1.812200] systemd[1]: Started dracut ask for additional cmdline parameters.
[    1.812962] systemd[1]: Starting dracut cmdline hook...
[    1.813590] systemd[1]: Starting Journal Service...
[    1.813622] systemd[1]: Reached target Slices.
[    1.813638] systemd[1]: Starting Slices.
[    1.813677] systemd[1]: Reached target Timers.
[    1.813689] systemd[1]: Starting Timers.
[    1.813874] systemd[1]: Started Load Kernel Modules.
[    1.814527] systemd[1]: Starting Apply Kernel Variables...
[    1.814586] systemd[1]: Listening on udev Kernel Socket.
[    1.814605] systemd[1]: Starting udev Kernel Socket.
[    1.814634] systemd[1]: Reached target Sockets.
[    1.814645] systemd[1]: Starting Sockets.
[    1.815309] systemd[1]: Starting Create list of required static device nodes for the current kernel...
[    1.817151] systemd[1]: Started Apply Kernel Variables.
[    1.817828] systemd[1]: Started Create list of required static device nodes for the current kernel.
[    1.821273] systemd[1]: Starting Create Static Device Nodes in /dev...
[    1.824543] systemd[1]: Started Create Static Device Nodes in /dev.
[    1.854700] systemd[1]: Started Journal Service.
[    1.876672] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    1.876691] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    1.992060] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    1.992067] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.992194] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    1.992198] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.993243] hub 2-1:1.0: USB hub found
[    1.993359] hub 1-1:1.0: USB hub found
[    1.993372] hub 2-1:1.0: 8 ports detected
[    1.993427] hub 1-1:1.0: 6 ports detected
[    2.046149] FUJITSU Extended Socket Network Device Driver - version 1.0 - Copyright (c) 2015 FUJITSU LIMITED
[    2.047430] wmi: Mapper loaded
[    2.060852] bnx2: QLogic bnx2 Gigabit Ethernet Driver v2.2.6 (January 29, 2014)
[    2.061610] bnx2 0000:03:00.0 eth0: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f8000000, IRQ 24, node addr 00:10:18:aa:7a:d0
[    2.062392] bnx2 0000:03:00.1 eth1: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f6000000, IRQ 43, node addr 00:10:18:aa:7a:d2
[    2.063349] bnx2 0000:04:00.0 eth2: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f4000000, IRQ 44, node addr 00:10:18:cd:94:48
[    2.064461] bnx2 0000:04:00.1 eth3: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f2000000, IRQ 45, node addr 00:10:18:cd:94:4a
[    2.064671] pps_core: LinuxPPS API ver. 1 registered
[    2.064675] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    2.065090] PTP clock support registered
[    2.067209] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
[    2.067213] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    2.067443] e1000e 0000:00:19.0: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode
[    2.069545] [drm] Initialized drm 1.1.0 20060810
[    2.075123] libata version 3.00 loaded.
[    2.084077] MXM: GUID detected in BIOS
[    2.084246] nouveau 0000:01:00.0: NVIDIA GT218 (0a8280b1)
[    2.123714] firewire_ohci 0000:07:00.0: added OHCI v1.10 device as card 0, 4 IR + 8 IT contexts, quirks 0x10
[    2.153888] bnx2 0000:03:00.0 enp3s0f0: renamed from eth0
[    2.206794] nouveau 0000:01:00.0: bios: version 70.18.5f.00.06
[    2.207495] nouveau 0000:01:00.0: fb: 1024 MiB DDR3
[    2.226176] bnx2 0000:03:00.1 enp3s0f1: renamed from eth1
[    2.258827] bnx2 0000:04:00.0 enp4s0f0: renamed from eth2
[    2.268630] usb 2-1.7: new full-speed USB device number 3 using ehci-pci
[    2.297841] bnx2 0000:04:00.1 enp4s0f1: renamed from eth3
[    2.322151] e1000e 0000:00:19.0 eth0: registered PHC clock
[    2.322155] e1000e 0000:00:19.0 eth0: (PCI Express:2.5GT/s:Width x1) 74:d0:2b:9a:6f:7f
[    2.322157] e1000e 0000:00:19.0 eth0: Intel(R) PRO/1000 Network Connection
[    2.322187] e1000e 0000:00:19.0 eth0: MAC: 10, PHY: 11, PBA No: FFFFFF-0FF
[    2.322246] ahci 0000:00:1f.2: version 3.0
[    2.322417] e1000e 0000:0b:00.0: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode
[    2.332621] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    2.332626] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst
[    2.343404] scsi host0: ahci
[    2.343683] scsi host1: ahci
[    2.343919] scsi host2: ahci
[    2.344163] scsi host3: ahci
[    2.344338] scsi host4: ahci
[    2.344451] scsi host5: ahci
[    2.344506] ata1: SATA max UDMA/133 abar m2048@0xfb620000 port 0xfb620100 irq 51
[    2.344509] ata2: SATA max UDMA/133 abar m2048@0xfb620000 port 0xfb620180 irq 51
[    2.344511] ata3: SATA max UDMA/133 abar m2048@0xfb620000 port 0xfb620200 irq 51
[    2.344513] ata4: SATA max UDMA/133 abar m2048@0xfb620000 port 0xfb620280 irq 51
[    2.344516] ata5: SATA max UDMA/133 abar m2048@0xfb620000 port 0xfb620300 irq 51
[    2.344518] ata6: SATA max UDMA/133 abar m2048@0xfb620000 port 0xfb620380 irq 51
[    2.354849] ahci 0000:08:00.0: AHCI 0001.0200 32 slots 8 ports 6 Gbps 0xff impl SATA mode
[    2.354853] ahci 0000:08:00.0: flags: 64bit ncq pio
[    2.355815] scsi host6: ahci
[    2.355955] scsi host7: ahci
[    2.356030] usb 2-1.7: New USB device found, idVendor=1532, idProduct=0103
[    2.356033] usb 2-1.7: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    2.356036] usb 2-1.7: Product: Razer Reclusa
[    2.356037] usb 2-1.7: Manufacturer: Chicony
[    2.356088] scsi host8: ahci
[    2.356241] scsi host9: ahci
[    2.356393] scsi host10: ahci
[    2.356643] scsi host11: ahci
[    2.356786] scsi host12: ahci
[    2.356920] scsi host13: ahci
[    2.356989] ata7: SATA max UDMA/133 abar m2048@0xfb410000 port 0xfb410100 irq 52
[    2.356993] ata8: SATA max UDMA/133 abar m2048@0xfb410000 port 0xfb410180 irq 52
[    2.356996] ata9: SATA max UDMA/133 abar m2048@0xfb410000 port 0xfb410200 irq 52
[    2.356999] ata10: SATA max UDMA/133 abar m2048@0xfb410000 port 0xfb410280 irq 52
[    2.357002] ata11: SATA max UDMA/133 abar m2048@0xfb410000 port 0xfb410300 irq 52
[    2.357005] ata12: SATA max UDMA/133 abar m2048@0xfb410000 port 0xfb410380 irq 52
[    2.357008] ata13: SATA max UDMA/133 abar m2048@0xfb410000 port 0xfb410400 irq 52
[    2.357011] ata14: SATA max UDMA/133 abar m2048@0xfb410000 port 0xfb410480 irq 52
[    2.357036] hub 2-1.7:1.0: USB hub found
[    2.357386] hub 2-1.7:1.0: 3 ports detected
[    2.420626] tsc: Refined TSC clocksource calibration: 2001.124 MHz
[    2.420630] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1cd85418fc7, max_idle_ns: 440795261733 ns
[    2.425042] e1000e 0000:0b:00.0 eth1: registered PHC clock
[    2.425046] e1000e 0000:0b:00.0 eth1: (PCI Express:2.5GT/s:Width x1) 74:d0:2b:9a:27:55
[    2.425048] e1000e 0000:0b:00.0 eth1: Intel(R) PRO/1000 Network Connection
[    2.425139] e1000e 0000:0b:00.0 eth1: MAC: 3, PHY: 8, PBA No: FFFFFF-0FF
[    2.426508] e1000e 0000:00:19.0 eno1: renamed from eth0
[    2.449809] e1000e 0000:0b:00.0 enp11s0: renamed from eth1
[    2.619603] usb 2-1.7.3: new full-speed USB device number 4 using ehci-pci
[    2.624747] firewire_core 0000:07:00.0: created device fw0: GUID 001e8c000066b2d2, S400
[    2.647997] ata4: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    2.648023] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    2.648042] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.648062] ata6: SATA link down (SStatus 0 SControl 300)
[    2.648087] ata5: SATA link down (SStatus 0 SControl 300)
[    2.648108] ata3: SATA link down (SStatus 0 SControl 300)
[    2.650592] ata4.00: ATA-8: WDC WD2003FYYS-05T8B0, 00.0NS01, max UDMA/133
[    2.650596] ata4.00: 3907029168 sectors, multi 16: LBA48 NCQ (depth 31/32), AA
[    2.652272] ata1.00: ATA-8: WDC WD2003FYYS-05T8B0, 00.0NS02, max UDMA/133
[    2.652275] ata1.00: 3907029168 sectors, multi 16: LBA48 NCQ (depth 31/32), AA
[    2.654092] ata4.00: configured for UDMA/133
[    2.655007] ata2.00: ATA-9: SanDisk SD8SBBU120G1122, Z3106000, max UDMA/133
[    2.655010] ata2.00: 234441648 sectors, multi 1: LBA48 NCQ (depth 31/32), AA
[    2.655773] ata1.00: configured for UDMA/133
[    2.656062] scsi 0:0:0:0: Direct-Access     ATA      WDC WD2003FYYS-0 NS02 PQ: 0 ANSI: 5
[    2.660952] ata10: SATA link down (SStatus 0 SControl 300)
[    2.660998] ata13: SATA link down (SStatus 0 SControl 300)
[    2.661035] ata8: SATA link down (SStatus 0 SControl 300)
[    2.661067] ata12: SATA link down (SStatus 0 SControl 300)
[    2.661098] ata9: SATA link down (SStatus 0 SControl 300)
[    2.661135] ata14: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    2.661168] ata7: SATA link down (SStatus 0 SControl 300)
[    2.661201] ata11: SATA link down (SStatus 0 SControl 300)
[    2.661261] ata14.00: ATAPI: MARVELL VIRTUALL, 1.09, max UDMA/66
[    2.661434] ata14.00: configured for UDMA/66
[    2.671780] ata2.00: configured for UDMA/133
[    2.674227] scsi 1:0:0:0: Direct-Access     ATA      SanDisk SD8SBBU1 6000 PQ: 0 ANSI: 5
[    2.696792] usb 2-1.7.3: New USB device found, idVendor=1532, idProduct=0200
[    2.696796] usb 2-1.7.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    2.696799] usb 2-1.7.3: Product: Reclusa Keyboard
[    2.696801] usb 2-1.7.3: Manufacturer: Razer
[    2.698688] input: Razer Reclusa Keyboard as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.7/2-1.7.3/2-1.7.3:1.0/0003:1532:0200.0001/input/input5
[    2.738231] scsi 3:0:0:0: Direct-Access     ATA      WDC WD2003FYYS-0 NS01 PQ: 0 ANSI: 5
[    2.749914] hid-generic 0003:1532:0200.0001: input,hidraw0: USB HID v1.10 Keyboard [Razer Reclusa Keyboard] on usb-0000:00:1d.0-1.7.3/input0
[    2.752180] input: Razer Reclusa Keyboard as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.7/2-1.7.3/2-1.7.3:1.1/0003:1532:0200.0002/input/input6
[    2.802494] scsi 13:0:0:0: Processor         Marvell  91xx Config      1.01 PQ: 0 ANSI: 5
[    2.802907] hid-generic 0003:1532:0200.0002: input,hidraw1: USB HID v1.10 Device [Razer Reclusa Keyboard] on usb-0000:00:1d.0-1.7.3/input1
[    2.816403] sd 1:0:0:0: [sdb] 234441648 512-byte logical blocks: (120 GB/112 GiB)
[    2.816404] sd 3:0:0:0: [sdc] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    2.816407] sd 0:0:0:0: [sda] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    2.816478] sd 3:0:0:0: [sdc] Write Protect is off
[    2.816484] sd 3:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[    2.816511] sd 1:0:0:0: [sdb] Write Protect is off
[    2.816515] sd 0:0:0:0: [sda] Write Protect is off
[    2.816516] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    2.816517] sd 3:0:0:0: [sdc] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[    2.816526] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    2.816550] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.816560] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[    2.817502]  sdb: sdb1 sdb2 sdb3
[    2.818027] sd 1:0:0:0: [sdb] Attached SCSI disk
[    2.820527] sd 3:0:0:0: [sdc] Attached SCSI disk
[    2.823051] sd 0:0:0:0: [sda] Attached SCSI disk
[    2.868850] [TTM] Zone  kernel: Available graphics memory: 8186046 kiB
[    2.868853] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    2.868855] [TTM] Initializing pool allocator
[    2.868861] [TTM] Initializing DMA pool allocator
[    2.868876] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB
[    2.868878] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB
[    2.868883] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
[    2.868885] nouveau 0000:01:00.0: DRM: DCB version 4.0
[    2.868887] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000302 00020030
[    2.868890] nouveau 0000:01:00.0: DRM: DCB outp 01: 02000300 00000000
[    2.868892] nouveau 0000:01:00.0: DRM: DCB outp 02: 02011362 00020010
[    2.868894] nouveau 0000:01:00.0: DRM: DCB outp 03: 01022310 00000000
[    2.868896] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001030
[    2.868898] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161
[    2.868900] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200
[    2.881892] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[    2.881894] [drm] Driver supports precise vblank timestamp query.
[    2.906345] nouveau 0000:01:00.0: DRM: MM: using COPY for buffer copies
[    2.969227] nouveau 0000:01:00.0: DRM: allocated 1280x1024 fb: 0x70000, bo ffff8804292b9000
[    2.969340] fbcon: nouveaufb (fb0) is primary device
[    3.039822] Console: switching to colour frame buffer device 160x64
[    3.041850] nouveau 0000:01:00.0: fb0: nouveaufb frame buffer device
[    3.047603] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0
[    3.156545] raid6: sse2x1   gen()  5375 MB/s
[    3.173537] raid6: sse2x1   xor()  4179 MB/s
[    3.190540] raid6: sse2x2   gen()  6675 MB/s
[    3.207532] raid6: sse2x2   xor()  4839 MB/s
[    3.224532] raid6: sse2x4   gen()  7757 MB/s
[    3.241531] raid6: sse2x4   xor()  5837 MB/s
[    3.241533] raid6: using algorithm sse2x4 gen() 7757 MB/s
[    3.241535] raid6: .... xor() 5837 MB/s, rmw enabled
[    3.241536] raid6: using ssse3x2 recovery algorithm
[    3.242011] xor: automatically using best checksumming function:
[    3.251528]    avx       : 14916.000 MB/sec
[    3.256685] Btrfs loaded
[    3.257125] BTRFS: device label rockstor_tevva-server devid 1 transid 109687 /dev/sdb3
[    3.258608] BTRFS info (device sdb3): disk space caching is enabled
[    3.279462] BTRFS: detected SSD devices, enabling SSD mode
[    3.420703] clocksource: Switched to clocksource tsc
[    3.615644] systemd-journald[197]: Received SIGTERM from PID 1 (systemd).
[    3.674005] SELinux:  Disabled at runtime.
[    3.674033] SELinux:  Unregistering netfilter hooks
[    3.683524] audit: type=1404 audit(1477654722.450:2): selinux=0 auid=4294967295 ses=4294967295
[    3.702325] ip_tables: (C) 2000-2006 Netfilter Core Team
[    3.702366] systemd[1]: Inserted module 'ip_tables'
[    3.814514] RPC: Registered named UNIX socket transport module.
[    3.814517] RPC: Registered udp transport module.
[    3.814518] RPC: Registered tcp transport module.
[    3.814520] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    3.824054] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[    3.825926] BTRFS info (device sdb3): disk space caching is enabled
[    3.840495] systemd-journald[1703]: Received request to flush runtime journal from PID 1
[    3.916139] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    4.024007] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    4.024085] sd 1:0:0:0: Attached scsi generic sg1 type 0
[    4.024145] sd 3:0:0:0: Attached scsi generic sg2 type 0
[    4.024224] scsi 13:0:0:0: Attached scsi generic sg3 type 3
[    4.061150] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[    4.062579] EDAC MC: Ver: 3.0.0
[    4.063296] input: PC Speaker as /devices/platform/pcspkr/input/input7
[    4.069811] EDAC sbridge: Seeking for: PCI ID 8086:3ca0
[    4.069823] EDAC sbridge: Seeking for: PCI ID 8086:3ca0
[    4.069826] EDAC sbridge: Seeking for: PCI ID 8086:3ca8
[    4.069832] EDAC sbridge: Seeking for: PCI ID 8086:3ca8
[    4.069834] EDAC sbridge: Seeking for: PCI ID 8086:3c71
[    4.069839] EDAC sbridge: Seeking for: PCI ID 8086:3c71
[    4.069841] EDAC sbridge: Seeking for: PCI ID 8086:3caa
[    4.069846] EDAC sbridge: Seeking for: PCI ID 8086:3caa
[    4.069848] EDAC sbridge: Seeking for: PCI ID 8086:3cab
[    4.069853] EDAC sbridge: Seeking for: PCI ID 8086:3cab
[    4.069855] EDAC sbridge: Seeking for: PCI ID 8086:3cac
[    4.069860] EDAC sbridge: Seeking for: PCI ID 8086:3cac
[    4.069862] EDAC sbridge: Seeking for: PCI ID 8086:3cad
[    4.069868] EDAC sbridge: Seeking for: PCI ID 8086:3cad
[    4.069869] EDAC sbridge: Seeking for: PCI ID 8086:3cb8
[    4.069875] EDAC sbridge: Seeking for: PCI ID 8086:3cb8
[    4.069877] EDAC sbridge: Seeking for: PCI ID 8086:3cf4
[    4.069881] EDAC sbridge: Seeking for: PCI ID 8086:3cf4
[    4.069884] EDAC sbridge: Seeking for: PCI ID 8086:3cf6
[    4.069888] EDAC sbridge: Seeking for: PCI ID 8086:3cf6
[    4.069890] EDAC sbridge: Seeking for: PCI ID 8086:3cf5
[    4.069895] EDAC sbridge: Seeking for: PCI ID 8086:3cf5
[    4.070044] EDAC MC0: Giving out device to module sbridge_edac.c controller Sandy Bridge Socket#0: DEV 0000:ff:0e.0 (POLLED)
[    4.070046] EDAC sbridge:  Ver: 1.1.1
[    4.070289] snd_hda_intel 0000:01:00.1: Disabling MSI
[    4.070303] snd_hda_intel 0000:01:00.1: Handle vga_switcheroo audio client
[    4.085614] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC898: line_outs=4 (0x14/0x15/0x16/0x17/0x0) type:line
[    4.085619] snd_hda_codec_realtek hdaudioC0D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    4.085621] snd_hda_codec_realtek hdaudioC0D0:    hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[    4.085623] snd_hda_codec_realtek hdaudioC0D0:    mono: mono_out=0x0
[    4.085625] snd_hda_codec_realtek hdaudioC0D0:    dig-out=0x11/0x1e
[    4.085627] snd_hda_codec_realtek hdaudioC0D0:    inputs:
[    4.085630] snd_hda_codec_realtek hdaudioC0D0:      Front Mic=0x19
[    4.085632] snd_hda_codec_realtek hdaudioC0D0:      Rear Mic=0x18
[    4.085634] snd_hda_codec_realtek hdaudioC0D0:      Line=0x1a
[    4.094310] random: nonblocking pool is initialized
[    4.098727] AVX version of gcm_enc/dec engaged.
[    4.098731] AES CTR mode by8 optimization enabled
[    4.101213] input: HDA Intel PCH Front Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input8
[    4.101318] input: HDA Intel PCH Rear Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input9
[    4.101422] input: HDA Intel PCH Line as /devices/pci0000:00/0000:00:1b.0/sound/card0/input10
[    4.101652] input: HDA Intel PCH Line Out Front as /devices/pci0000:00/0000:00:1b.0/sound/card0/input11
[    4.101765] input: HDA Intel PCH Line Out Surround as /devices/pci0000:00/0000:00:1b.0/sound/card0/input12
[    4.101851] input: HDA Intel PCH Line Out CLFE as /devices/pci0000:00/0000:00:1b.0/sound/card0/input13
[    4.101936] input: HDA Intel PCH Line Out Side as /devices/pci0000:00/0000:00:1b.0/sound/card0/input14
[    4.102007] input: HDA Intel PCH Front Headphone as /devices/pci0000:00/0000:00:1b.0/sound/card0/input15
[    4.135435] Adding 15624188k swap on /dev/sdb2.  Priority:-1 extents:1 across:15624188k SSFS
[    4.151461] iTCO_vendor_support: vendor-support=0
[    4.151979] asus_wmi: ASUS WMI generic driver loaded
[    4.159447] asus_wmi: Initialization: 0x0
[    4.159507] asus_wmi: BIOS WMI version: 0.9
[    4.159573] asus_wmi: SFUN value: 0x0
[    4.159974] input: Eee PC WMI hotkeys as /devices/platform/eeepc-wmi/input/input16
[    4.160108] asus_wmi: Number of fans: 1
[    4.160238] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[    4.160276] iTCO_wdt: Found a Patsburg TCO device (Version=2, TCOBASE=0x0460)
[    4.162571] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[    4.207105] EXT4-fs (sdb1): mounted filesystem with ordered data mode. Opts: (null)
[    4.283950] audit: type=1305 audit(1477654723.050:3): audit_pid=3137 old=0 auid=4294967295 ses=4294967295 res=1
[    4.382851] input: HDA NVidia HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:02.0/0000:01:00.1/sound/card1/input17
[    4.382914] input: HDA NVidia HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:02.0/0000:01:00.1/sound/card1/input18
[    4.382991] input: HDA NVidia HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:02.0/0000:01:00.1/sound/card1/input19
[    4.383059] input: HDA NVidia HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:02.0/0000:01:00.1/sound/card1/input20
[    4.437518] IPv6: ADDRCONF(NETDEV_UP): team0: link is not ready
[    4.437609] IPv6: ADDRCONF(NETDEV_UP): team0: link is not ready
[    4.462862] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready
[    4.515530] bnx2 0000:03:00.1 enp3s0f1: using MSIX
[    4.515729] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready
[    4.517171] IPv6: ADDRCONF(NETDEV_UP): enp4s0f1: link is not ready
[    4.557559] bnx2 0000:04:00.1 enp4s0f1: using MSIX
[    4.557716] IPv6: ADDRCONF(NETDEV_UP): enp4s0f1: link is not ready
[    4.559068] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready
[    4.812659] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready
[    4.815591] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready
[    4.859612] bnx2 0000:03:00.0 enp3s0f0: using MSIX
[    4.859729] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready
[    4.861851] IPv6: ADDRCONF(NETDEV_UP): enp4s0f0: link is not ready
[    4.905570] bnx2 0000:04:00.0 enp4s0f0: using MSIX
[    4.905672] IPv6: ADDRCONF(NETDEV_UP): enp4s0f0: link is not ready
[    4.907798] IPv6: ADDRCONF(NETDEV_UP): enp11s0: link is not ready
[    4.982755] IPv6: ADDRCONF(NETDEV_UP): enp11s0: link is not ready
[    4.992542] IPv6: ADDRCONF(NETDEV_UP): team0: link is not ready
[    5.002627] team0: Mode changed to "loadbalance"
[    8.150241] bnx2 0000:03:00.0 enp3s0f0: NIC Copper Link is Up, 1000 Mbps full duplex
[    8.150254] , receive & transmit flow control ON
[    8.150352] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f0: link becomes ready
[    8.224386] bnx2 0000:03:00.0 enp3s0f0: using MSIX
[    8.224504] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready
[    8.224672] team0: Port device enp3s0f0 added
[    8.242642] bnx2 0000:04:00.1 enp4s0f1: NIC Copper Link is Up, 1000 Mbps full duplex
[    8.242646] , receive & transmit flow control ON
[    8.242783] IPv6: ADDRCONF(NETDEV_CHANGE): enp4s0f1: link becomes ready
[    8.271237] bnx2 0000:03:00.1 enp3s0f1: NIC Copper Link is Up, 1000 Mbps full duplex
[    8.271246] , receive & transmit flow control ON
[    8.271797] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready
[    8.316336] bnx2 0000:04:00.1 enp4s0f1: using MSIX
[    8.316454] IPv6: ADDRCONF(NETDEV_UP): enp4s0f1: link is not ready
[    8.316618] team0: Port device enp4s0f1 added
[    8.394387] bnx2 0000:03:00.1 enp3s0f1: using MSIX
[    8.394505] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready
[    8.394702] team0: Port device enp3s0f1 added
[    8.578092] bnx2 0000:04:00.0 enp4s0f0: NIC Copper Link is Up, 1000 Mbps full duplex
[    8.578102] , receive & transmit flow control ON
[    8.578313] IPv6: ADDRCONF(NETDEV_CHANGE): enp4s0f0: link becomes ready
[    8.652382] bnx2 0000:04:00.0 enp4s0f0: using MSIX
[    8.652505] IPv6: ADDRCONF(NETDEV_UP): enp4s0f0: link is not ready
[    8.652708] team0: Port device enp4s0f0 added
[   11.476991] bnx2 0000:03:00.0 enp3s0f0: NIC Copper Link is Up, 1000 Mbps full duplex
[   11.477002] , receive & transmit flow control ON
[   11.477109] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f0: link becomes ready
[   11.477211] IPv6: ADDRCONF(NETDEV_CHANGE): team0: link becomes ready
[   11.547718] bnx2 0000:04:00.1 enp4s0f1: NIC Copper Link is Up, 1000 Mbps full duplex
[   11.547729] , receive & transmit flow control ON
[   11.547833] IPv6: ADDRCONF(NETDEV_CHANGE): enp4s0f1: link becomes ready
[   12.255141] bnx2 0000:03:00.1 enp3s0f1: NIC Copper Link is Up, 1000 Mbps full duplex
[   12.255152] , receive & transmit flow control ON
[   12.255264] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready
[   12.362289] bnx2 0000:04:00.0 enp4s0f0: NIC Copper Link is Up, 1000 Mbps full duplex
[   12.362300] , receive & transmit flow control ON
[   12.362398] IPv6: ADDRCONF(NETDEV_CHANGE): enp4s0f0: link becomes ready
[   16.857702] BTRFS info (device sdb3): disk space caching is enabled
[   16.862793] EXT4-fs (sdb1): re-mounted. Opts: (null)
[   16.878525] BTRFS info (device sdb3): disk space caching is enabled
[   49.123208] BTRFS: device label main_pool devid 2 transid 115269 /dev/sda
[   49.123313] BTRFS: device label main_pool devid 1 transid 115269 /dev/sdc
[   51.967446] BTRFS info (device sdc): enabling auto defrag
[   51.967455] BTRFS info (device sdc): use lzo compression
[   51.967459] BTRFS info (device sdc): disk space caching is enabled
[   51.967461] BTRFS: has skinny extents
[  134.829269] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
[  135.826310] IPv6: ADDRCONF(NETDEV_UP): docker0: link is not ready
[  136.255969] docker0: port 1(vethf9d25fa) entered blocking state
[  136.255977] docker0: port 1(vethf9d25fa) entered disabled state
[  136.256141] device vethf9d25fa entered promiscuous mode
[  136.256634] IPv6: ADDRCONF(NETDEV_UP): vethf9d25fa: link is not ready
[  136.256642] docker0: port 1(vethf9d25fa) entered blocking state
[  136.256647] docker0: port 1(vethf9d25fa) entered forwarding state
[  136.256815] docker0: port 1(vethf9d25fa) entered disabled state
[  136.344473] docker0: port 2(veth8582648) entered blocking state
[  136.344480] docker0: port 2(veth8582648) entered disabled state
[  136.344590] device veth8582648 entered promiscuous mode
[  136.344858] IPv6: ADDRCONF(NETDEV_UP): veth8582648: link is not ready
[  136.344863] docker0: port 2(veth8582648) entered blocking state
[  136.344867] docker0: port 2(veth8582648) entered forwarding state
[  136.344938] IPv6: ADDRCONF(NETDEV_CHANGE): docker0: link becomes ready
[  136.345033] docker0: port 2(veth8582648) entered disabled state
[  136.419913] docker0: port 3(veth9a89e0f) entered blocking state
[  136.419918] docker0: port 3(veth9a89e0f) entered disabled state
[  136.420017] device veth9a89e0f entered promiscuous mode
[  136.420298] IPv6: ADDRCONF(NETDEV_UP): veth9a89e0f: link is not ready
[  136.420303] docker0: port 3(veth9a89e0f) entered blocking state
[  136.420306] docker0: port 3(veth9a89e0f) entered forwarding state
[  136.486055] docker0: port 4(vethda0c913) entered blocking state
[  136.486061] docker0: port 4(vethda0c913) entered disabled state
[  136.486165] device vethda0c913 entered promiscuous mode
[  136.486411] IPv6: ADDRCONF(NETDEV_UP): vethda0c913: link is not ready
[  136.486416] docker0: port 4(vethda0c913) entered blocking state
[  136.486419] docker0: port 4(vethda0c913) entered forwarding state
[  136.778089] docker0: port 3(veth9a89e0f) entered disabled state
[  136.778146] docker0: port 4(vethda0c913) entered disabled state
[  137.222591] eth0: renamed from veth235c28c
[  137.236504] IPv6: ADDRCONF(NETDEV_CHANGE): vethf9d25fa: link becomes ready
[  137.236545] docker0: port 1(vethf9d25fa) entered blocking state
[  137.236550] docker0: port 1(vethf9d25fa) entered forwarding state
[  138.070544] eth0: renamed from vethc91b0b8
[  138.085358] IPv6: ADDRCONF(NETDEV_CHANGE): veth9a89e0f: link becomes ready
[  138.085390] docker0: port 3(veth9a89e0f) entered blocking state
[  138.085392] docker0: port 3(veth9a89e0f) entered forwarding state
[  138.269459] eth0: renamed from vethb0e5def
[  138.287290] IPv6: ADDRCONF(NETDEV_CHANGE): veth8582648: link becomes ready
[  138.287318] docker0: port 2(veth8582648) entered blocking state
[  138.287323] docker0: port 2(veth8582648) entered forwarding state
[  138.712431] eth0: renamed from vethb790f38
[  138.724313] IPv6: ADDRCONF(NETDEV_CHANGE): vethda0c913: link becomes ready
[  138.724344] docker0: port 4(vethda0c913) entered blocking state
[  138.724347] docker0: port 4(vethda0c913) entered forwarding state
[  181.967227] e1000e: eno1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[  181.967287] IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
tomtom13 commented 7 years ago

interfaces configurations:

[root@tevva-server network-scripts]# find . -type f -name 'ifcfg*' -print | while read filename; do echo ""; echo""; echo "$filename"; cat "$filename"; done

./ifcfg-enp3s0f1
TYPE=Ethernet
BOOTPROTO=dhcp
DEFROUTE=yes
PEERDNS=yes
PEERROUTES=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
IPV6_FAILURE_FATAL=no
NAME=enp3s0f1
UUID=e98ce2cb-ed1a-47d8-88ee-2f0ed019ec61
DEVICE=enp3s0f1
ONBOOT=no

./ifcfg-enp3s0f0
TYPE=Ethernet
BOOTPROTO=dhcp
DEFROUTE=yes
PEERDNS=yes
PEERROUTES=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
IPV6_FAILURE_FATAL=no
NAME=enp3s0f0
UUID=57d29442-c3c5-4423-afdd-d6e0df338d5a
DEVICE=enp3s0f0
ONBOOT=no

./ifcfg-enp4s0f1
TYPE=Ethernet
BOOTPROTO=dhcp
DEFROUTE=yes
PEERDNS=yes
PEERROUTES=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
IPV6_FAILURE_FATAL=no
NAME=enp4s0f1
UUID=fa3a9ecf-1265-4425-9f2d-08892675609d
DEVICE=enp4s0f1
ONBOOT=no

./ifcfg-enp4s0f0
TYPE=Ethernet
BOOTPROTO=dhcp
DEFROUTE=yes
PEERDNS=yes
PEERROUTES=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
IPV6_FAILURE_FATAL=no
NAME=enp4s0f0
UUID=b1362766-b028-4403-bfec-8ea0f6100a77
DEVICE=enp4s0f0
ONBOOT=no

./ifcfg-enp11s0
TYPE=Ethernet
BOOTPROTO=dhcp
DEFROUTE=yes
PEERDNS=yes
PEERROUTES=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
IPV6_FAILURE_FATAL=no
NAME=enp11s0
UUID=1541c629-04ab-4b5c-9a80-dc55dfd1b4f0
DEVICE=enp11s0
ONBOOT=no

./ifcfg-eno1
# Generated by dracut initrd
NAME="eno1"
DEVICE="eno1"
ONBOOT=yes
NETBOOT=yes
UUID="f09e985d-5650-4178-9846-95388e398db1"
IPV6INIT=yes
BOOTPROTO=dhcp
TYPE=Ethernet

./ifcfg-lo
DEVICE=lo
IPADDR=127.0.0.1
NETMASK=255.0.0.0
NETWORK=127.0.0.0
# If you're having problems with gated making 127.0.0.0/8 a martian,
# you can change this to something else (255.255.255.255, for example)
BROADCAST=127.255.255.255
ONBOOT=yes
NAME=loopback

./ifcfg-team0
DEVICE=team0
TEAM_CONFIG="{ \"runner\": {\"name\": \"lacp\"}}"
DEVICETYPE=Team
BOOTPROTO=none
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
NAME=team0
UUID=3e1669b3-af83-4ca3-9422-20b60f43f75c
ONBOOT=yes
IPADDR=192.168.123.201
PREFIX=32
GATEWAY=192.168.123.254
DNS1=192.168.123.254
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes

./ifcfg-team0-slave-0
NAME=team0-slave-0
UUID=657a92f0-74bd-48b1-948a-49def11fde0a
DEVICE=enp4s0f1
ONBOOT=yes
TEAM_MASTER=team0
DEVICETYPE=TeamPort

./ifcfg-team0-slave-1
NAME=team0-slave-1
UUID=40e7551b-e2b8-40b6-8fb6-326329984194
DEVICE=enp3s0f0
ONBOOT=yes
TEAM_MASTER=team0
DEVICETYPE=TeamPort

./ifcfg-team0-slave-2
NAME=team0-slave-2
UUID=653b014e-ae22-4985-9d0d-2320c34225ae
DEVICE=enp3s0f1
ONBOOT=yes
TEAM_MASTER=team0
DEVICETYPE=TeamPort

./ifcfg-team0-slave-3
NAME=team0-slave-3
UUID=0314c644-e166-4876-b171-d855802db52d
DEVICE=enp4s0f0
ONBOOT=yes
TEAM_MASTER=team0
DEVICETYPE=TeamPort
tomtom13 commented 7 years ago

FYI, I'm willing to get my hand dirty on that one - I have now few servers that will come online soon where it would be beneficial to team up SFP+ interfaces to a proper punch.

tomtom13 commented 7 years ago

fireshot screen capture 009 - rockstor - tevva-server_ network

MFlyer commented 7 years ago

Hi @tomtom13 , checking your ifconfig files it seems all ok

tomtom13 commented 7 years ago

Just FYI, first ifconfig is when team0 is only one connected - rockstore does not start main service, docker service ... not even docker virtual interface is brought up.

I think I found a problem where if no links are connected rockstor will not finish bootup properly.

MFlyer commented 7 years ago

I think I found a problem where if no links are connected rockstor will not finish bootup properly.

It seems like on Cisco devices eheh : while configuring you need all things plugged

tomtom13 commented 7 years ago

Damn, I missed the point again :/

Anyway, I actually stripped team down and unplugged eno1 from switch and rockstor still did not finish booting - rock ons were dead ... none of services were live.

MFlyer commented 7 years ago

Uhmm...test of the day: what happen having rock-ons off? M.

tomtom13 commented 7 years ago

with only eno1 setup and not plugget or with team0 setup and plugged ?

MFlyer commented 7 years ago

all ON and plugged except docker0

tomtom13 commented 7 years ago

everything passes in flying colours.

tomtom13 commented 7 years ago

Oh yeah, FYI I just cooked dell x1052p ... by simply upgrading firmware ....

$%@^#$%%U#$#%$!#$%&$@#!@$%%%%%#^@#!$@%&

Now I know why people chose cisco.

Hooverdan96 commented 8 months ago

@phillxnet this seems to be a resolved issue at this time. If you agree, let's close it.