search

yunionio / cloudpods

A cloud-native open-source unified multi-cloud and hybrid-cloud platform. 开源、云原生的多云管理及混合云融合平台
https://www.cloudpods.org
Apache License 2.0
2.57k stars 524 forks source link

[求助/Help]v3.10.11，新集群部署后宿主机状态未知，register failed #19171

Closed chenjacken closed 8 months ago

chenjacken commented 9 months ago

1，版本： v3.10.11 3台新服务器高可用新集群部署，参考：https://www.cloudpods.org/docs/getting-started/full/ha-ce

host.conf的网络配置

ovn_encap_ip: 10.0.1.211
networks:
- bond1/br0/172.16.1.211
- bond0/br1/10.0.1.211

看到所有pod都是Running

宿主机网络：

image

2，宿主机状态未知

看日志：

[root@master1 ~]# kubectl -n onecloud logs default-host-cl2sh  -c host --since 10m -f
[info 240104 23:31:34 procutils.WaitZombieLoop(zombie_others.go:36)] My pid is not 1 and no need to wait zombies
[info 240104 23:31:34 options.parseOptions(options.go:331)] Use configuration file: /etc/yunion/host.conf
[warning 240104 23:31:34 structarg.(*ArgumentParser).parseJSONKeyValue(structarg.go:1215)] Cannot find argument health-driver
[warning 240104 23:31:34 structarg.(*ArgumentParser).parseJSONKeyValue(structarg.go:1215)] Cannot find argument disk-is-ssd
[warning 240104 23:31:34 structarg.(*ArgumentParser).parseJSONKeyValue(structarg.go:1215)] Cannot find argument start-host-ignore-sys-error
[warning 240104 23:31:34 structarg.(*ArgumentParser).parseJSONKeyValue(structarg.go:1215)] Cannot find argument enable-rbac
[warning 240104 23:31:34 structarg.(*ArgumentParser).parseJSONKeyValue(structarg.go:1215)] Cannot find argument enable-health-checker
[warning 240104 23:31:34 structarg.(*ArgumentParser).parseJSONKeyValue(structarg.go:1215)] Cannot find argument enable-qmp-monitor
[info 240104 23:31:34 options.parseOptions(options.go:354)] Set log level to "info"
[info 2024-01-04 23:31:34 options.parseOptions(options.go:331)] Use configuration file: /etc/yunion/common/common.conf
[info 2024-01-04 23:31:34 options.parseOptions(options.go:354)] Set log level to "info"
[info 2024-01-04 23:31:34 hostman.(*SHostService).InitService(host_services.go:63)] exec socket path: /var/run/onecloud/exec.sock
[info 2024-01-04 23:31:34 app.InitApp(app.go:32)] RequestWorkerCount: 8
[info 2024-01-04 23:31:34 appsrv.NewApplication(appsrv.go:120)] App hostId: pp61GboVMzg1TOiUsFhiiQMOqCQ= (host,master1,172.16.1.211)
2024/01/04 23:31:34 Allow hosts []
[info 2024-01-04 23:31:34 appsrv.(*Application).SetDefaultTimeout(appsrv.go:136)] adjust application default timeout to 60.000000 seconds
[info 2024-01-04 23:31:34 hostinfo.DetectCpuInfo(hostinfohelper.go:77)] cpuinfo freq 2699
[info 2024-01-04 23:31:34 hostinfo.NewHostInfo(hostinfo.go:2339)] CPU Model Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz Microcode 0x2007006
[info 2024-01-04 23:31:34 hostinfo.NewHostInfo(hostinfo.go:2359)] Get kubelet container image Fs: /opt/docker, eviction config: {"evictionHard":{"imagefs.available":{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05}},"memory.available":{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0}},"nodefs.available":{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05}},"nodefs.inodesFree":{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05}}}}
[error 2024-01-04 23:31:38 fileutils2.GetAllBlkdevsIoSchedulers(fileutils.go:170)] no block device avaiable
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).prepareEnv(hostinfo.go:402)] I/O Scheduler switch to none
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).getKubeReservedMemMb(hostinfo.go:1523)] Kubelet memory threshold subtracted: 100MB
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).Init(hostinfo.go:196)] Start detectHostInfo
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).detectKVMMaxCpus(hostinfo.go:863)] KVM API VERSION 12
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).detectKVMMaxCpus(hostinfo.go:868)] KVM CAP MAX VCPUS: 384
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).detectKVMMaxCpus(hostinfo.go:876)] KVM CAP NR VCPUS: 384
[info 2024-01-04 23:31:38 sysutils.detectNestSupport(kvm.go:146)] Host is support kvm nest ...
[info 2024-01-04 23:31:38 sysutils.detectNestSupport(kvm.go:151)] Host kvm nest is enabled ...
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).detectOsDist(hostinfo.go:756)] DetectOsDist CentOS Linux 7.9.2009
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).detectQemuVersion(hostinfo.go:830)] Detect qemu version is 4.2.0
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).detectOvsVersion(hostinfo.go:971)] Detect OVS version is 2.12.4
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).detectOvsKOVersion(hostinfo.go:988)] kernel module openvswitch version:        2.10.5
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).Init(hostinfo.go:205)] Start parseConfig
[info 2024-01-04 23:31:38 hostinfo.NewNIC(hostinfohelper.go:233)] IP 172.16.1.211/br0/bond1
[info 2024-01-04 23:31:38 hostbridge.(*SBaseBridgeDriver).ConfirmToConfig(hostbridge.go:172)] bridge br0 already has ip 172.16.1.211
[info 2024-01-04 23:31:38 hostinfo.NewNIC(hostinfohelper.go:283)] Confirm to configuration!!
[info 2024-01-04 23:31:38 hostinfo.NewNIC(hostinfohelper.go:233)] IP 10.0.1.211/br1/bond0
[info 2024-01-04 23:31:38 hostbridge.(*SBaseBridgeDriver).ConfirmToConfig(hostbridge.go:172)] bridge br1 already has ip 10.0.1.211
[info 2024-01-04 23:31:38 hostinfo.NewNIC(hostinfohelper.go:283)] Confirm to configuration!!
[info 2024-01-04 23:31:38 hostinfo.(*SNIC).SetupDhcpRelay(hostinfohelper.go:202)] Not enable dhcp relay on nic: &hostinfo.SNIC{Inter:"bond1", Bridge:"br0", Ip:"172.16.1.211", Network:"", WireId:"", Mask:24, Bandwidth:1000, BridgeDev:(*hostbridge.SOVSBridgeDriver)(0xc0013fa060), dhcpServer:(*hostdhcp.SGuestDHCPServer)(0xc00157c240)}
[info 2024-01-04 23:31:38 hostinfo.(*SNIC).SetupDhcpRelay(hostinfohelper.go:202)] Not enable dhcp relay on nic: &hostinfo.SNIC{Inter:"bond0", Bridge:"br1", Ip:"10.0.1.211", Network:"", WireId:"", Mask:24, Bandwidth:1000, BridgeDev:(*hostbridge.SOVSBridgeDriver)(0xc00157dd40), dhcpServer:(*hostdhcp.SGuestDHCPServer)(0xc000725e30)}
[info 2024-01-04 23:31:38 hostinfo.(*SHostInfo).setupOvnChassis(hostinfo.go:223)] Start setting up ovn chassis
[info 2024-01-04 23:31:39 hostman.(*SHostService).RunService.func1(host_services.go:84)] Auth complete!!
[info 2024-01-04 23:31:39 policy.(*SPolicyManager).init(policy.go:136)] policy fetch worker count 1
[info 2024-01-04 23:31:39 consts.SetNonDefaultDomainProjects(consts.go:109)] set non_default_domain_projects to false
[info 2024-01-04 23:31:39 storageman.StartSnapshotRecycle(storage_base.go:491)] Snapshot recyle job started
[info 2024-01-04 23:31:39 watcher.(*SInformerSyncManager).startWatcher(watcher.go:83)]EndpointChangeManager: Start resource informer watcher for endpoint
[info 2024-01-04 23:31:39 guestman.NewGuestCpuSetCounter(guesthelper.go:198)] NewGuestCpuSetCounter from topo: {"architecture":"numa","nodes":[{"caches":[{"level":1,"logical_processors":[0,40],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[1,41],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[2,42],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[3,43],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[4,44],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[5,45],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[6,46],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[7,47],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[8,48],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[9,49],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[10,50],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[11,51],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[12,52],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[13,53],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[14,54],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[15,55],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[16,56],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[17,57],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[18,58],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[19,59],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[0,40],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[1,41],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[2,42],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[3,43],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[4,44],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[5,45],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[6,46],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[7,47],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[8,48],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[9,49],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[10,50],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[11,51],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[12,52],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[13,53],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[14,54],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[15,55],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[16,56],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[17,57],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[18,58],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[19,59],"size_bytes":32768,"type":"data"},{"level":2,"logical_processors":[0,40],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[1,41],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[2,42],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[3,43],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[4,44],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[5,45],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[6,46],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[7,47],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[8,48],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[9,49],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[10,50],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[11,51],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[12,52],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[13,53],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[14,54],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[15,55],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[16,56],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[17,57],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[18,58],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[19,59],"size_bytes":1048576,"type":"unified"},{"level":3,"logical_processors":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59],"size_bytes":28835840,"type":"unified"}],"cores":[{"id":0,"index":0,"logical_processors":[0,40],"total_threads":2},{"id":1,"index":1,"logical_processors":[1,41],"total_threads":2},{"id":16,"index":2,"logical_processors":[10,50],"total_threads":2},{"id":17,"index":3,"logical_processors":[11,51],"total_threads":2},{"id":18,"index":4,"logical_processors":[12,52],"total_threads":2},{"id":19,"index":5,"logical_processors":[13,53],"total_threads":2},{"id":20,"index":6,"logical_processors":[14,54],"total_threads":2},{"id":24,"index":7,"logical_processors":[15,55],"total_threads":2},{"id":25,"index":8,"logical_processors":[16,56],"total_threads":2},{"id":26,"index":9,"logical_processors":[17,57],"total_threads":2},{"id":27,"index":10,"logical_processors":[18,58],"total_threads":2},{"id":28,"index":11,"logical_processors":[19,59],"total_threads":2},{"id":2,"index":12,"logical_processors":[2,42],"total_threads":2},{"id":3,"index":13,"logical_processors":[3,43],"total_threads":2},{"id":4,"index":14,"logical_processors":[4,44],"total_threads":2},{"id":8,"index":15,"logical_processors":[45,5],"total_threads":2},{"id":9,"index":16,"logical_processors":[46,6],"total_threads":2},{"id":10,"index":17,"logical_processors":[47,7],"total_threads":2},{"id":11,"index":18,"logical_processors":[48,8],"total_threads":2},{"id":12,"index":19,"logical_processors":[49,9],"total_threads":2}],"distances":[10,21],"id":0,"memory":{"supported_page_sizes":[1073741824,2097152],"total_physical_bytes":34359738368,"total_usable_bytes":33216487424}},{"caches":[{"level":1,"logical_processors":[20,60],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[21,61],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[22,62],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[23,63],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[24,64],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[25,65],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[26,66],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[27,67],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[28,68],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[29,69],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[30,70],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[31,71],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[32,72],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[33,73],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[34,74],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[35,75],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[36,76],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[37,77],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[38,78],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[39,79],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[20,60],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[21,61],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[22,62],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[23,63],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[24,64],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[25,65],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[26,66],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[27,67],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[28,68],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[29,69],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[30,70],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[31,71],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[32,72],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[33,73],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[34,74],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[35,75],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[36,76],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[37,77],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[38,78],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[39,79],"size_bytes":32768,"type":"data"},{"level":2,"logical_processors":[20,60],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[21,61],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[22,62],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[23,63],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[24,64],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[25,65],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[26,66],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[27,67],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[28,68],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[29,69],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[30,70],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[31,71],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[32,72],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[33,73],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[34,74],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[35,75],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[36,76],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[37,77],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[38,78],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[39,79],"size_bytes":1048576,"type":"unified"},{"level":3,"logical_processors":[20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79],"size_bytes":28835840,"type":"unified"}],"cores":[{"id":0,"index":0,"logical_processors":[20,60],"total_threads":2},{"id":1,"index":1,"logical_processors":[21,61],"total_threads":2},{"id":2,"index":2,"logical_processors":[22,62],"total_threads":2},{"id":3,"index":3,"logical_processors":[23,63],"total_threads":2},{"id":4,"index":4,"logical_processors":[24,64],"total_threads":2},{"id":8,"index":5,"logical_processors":[25,65],"total_threads":2},{"id":9,"index":6,"logical_processors":[26,66],"total_threads":2},{"id":10,"index":7,"logical_processors":[27,67],"total_threads":2},{"id":11,"index":8,"logical_processors":[28,68],"total_threads":2},{"id":12,"index":9,"logical_processors":[29,69],"total_threads":2},{"id":16,"index":10,"logical_processors":[30,70],"total_threads":2},{"id":17,"index":11,"logical_processors":[31,71],"total_threads":2},{"id":18,"index":12,"logical_processors":[32,72],"total_threads":2},{"id":19,"index":13,"logical_processors":[33,73],"total_threads":2},{"id":20,"index":14,"logical_processors":[34,74],"total_threads":2},{"id":24,"index":15,"logical_processors":[35,75],"total_threads":2},{"id":25,"index":16,"logical_processors":[36,76],"total_threads":2},{"id":26,"index":17,"logical_processors":[37,77],"total_threads":2},{"id":27,"index":18,"logical_processors":[38,78],"total_threads":2},{"id":28,"index":19,"logical_processors":[39,79],"total_threads":2}],"distances":[21,10],"id":1,"memory":{"supported_page_sizes":[1073741824,2097152],"total_physical_bytes":34359738368,"total_usable_bytes":33798848512}}]}
[info 2024-01-04 23:31:39 hostdhcp.(*SGuestDHCPServer).Start(dhcpserver.go:72)] SGuestDHCPServer starting ...
[info 2024-01-04 23:31:39 hostdhcp.(*SGuestDHCPServer).Start(dhcpserver.go:72)] SGuestDHCPServer starting ...
[info 2024-01-04 23:31:39 guestman.(*SGuestManager).InitQemuMaxCpus(guestman.go:143)] KVM max cpus count: 384
[info 2024-01-04 23:31:39 guestman.(*SGuestManager).InitQemuMaxCpus(guestman.go:161)] Machine type pc max cpus: 240
[info 2024-01-04 23:31:39 guestman.(*SGuestManager).InitQemuMaxCpus(guestman.go:161)] Machine type q35 max cpus: 240
[info 2024-01-04 23:31:39 guestman.(*SGuestManager).InitPythonPath.func1(guestman.go:176)] Python path /usr/bin/python
[info 2024-01-04 23:31:39 informer.(*EtcdBackendForClient).StartClientWatch(etcd_client.go:84)] /onecloud/informer watched
[info 2024-01-04 23:31:39 informer.NewWatchManagerBySessionBg.func1(watcher.go:51)] callback with watchMan success.
[info 2024-01-04 23:31:41 hostinfo.(*SHostInfo).ensureMasterNetworks(hostinfo.go:1206)] Master ip 172.16.1.211 to fetch wire
[info 2024-01-04 23:31:41 hostinfo.(*SHostInfo).initZoneInfo(hostinfo.go:1248)] Start GetZoneInfo 7b6ae896-1b3d-40e5-879f-cfd00799200b
[info 2024-01-04 23:31:41 hostinfo.(*SHostInfo).getKubeReservedMemMb(hostinfo.go:1523)] Kubelet memory threshold subtracted: 100MB
[error 2024-01-04 23:31:41 hostinfo.(*SHostInfo).onFail(hostinfo.go:1114)] register failed: initHostRecords: ensureHostRecord: host create or update with {"__meta__":{"cpu_info":"{\"processors\":[{\"capabilities\":
chenjacken commented 9 months ago 
[error 2024-01-04 23:40:43 timeutils2.AddTimeout.func1.1(timeutils.go:31)] register failed, try 30 seconds later...
goroutine 931 [running]:
runtime/debug.Stack()
        /usr/lib/go/src/runtime/debug/stack.go:24 +0x65
runtime/debug.PrintStack()
        /usr/lib/go/src/runtime/debug/stack.go:16 +0x19
yunion.io/x/onecloud/pkg/util/timeutils2.AddTimeout.func1.1()
        /root/go/src/yunion.io/x/onecloud/pkg/util/timeutils2/timeutils.go:32 +0x59
panic({0x28665e0, 0x34ee2d0})
        /usr/lib/go/src/runtime/panic.go:838 +0x207
yunion.io/x/onecloud/pkg/hostman/hostinfo.(*SHostInfo).onFail(0xc000cb8180, {0x2b4f440?, 0xc0001b47c8?})
        /root/go/src/yunion.io/x/onecloud/pkg/hostman/hostinfo/hostinfo.go:1116 +0xeb
yunion.io/x/onecloud/pkg/hostman/hostinfo.(*SHostInfo).register(0xc000cb8180)
        /root/go/src/yunion.io/x/onecloud/pkg/hostman/hostinfo/hostinfo.go:1081 +0x6f
yunion.io/x/onecloud/pkg/util/timeutils2.AddTimeout.func1()
        /root/go/src/yunion.io/x/onecloud/pkg/util/timeutils2/timeutils.go:37 +0x5c
created by yunion.io/x/onecloud/pkg/util/timeutils2.AddTimeout
        /root/go/src/yunion.io/x/onecloud/pkg/util/timeutils2/timeutils.go:28 +0x65
chenjacken commented 9 months ago 
[info 2024-01-04 23:45:15 hostinfo.(*SHostInfo).ensureMasterNetworks(hostinfo.go:1206)] Master ip 172.16.1.211 to fetch wire
[info 2024-01-04 23:45:15 hostinfo.(*SHostInfo).initZoneInfo(hostinfo.go:1248)] Start GetZoneInfo 7b6ae896-1b3d-40e5-879f-cfd00799200b
[info 2024-01-04 23:45:15 hostinfo.(*SHostInfo).getKubeReservedMemMb(hostinfo.go:1523)] Kubelet memory threshold subtracted: 100MB
[error 2024-01-04 23:45:15 hostinfo.(*SHostInfo).onFail(hostinfo.go:1114)] register failed: initHostRecords: ensureHostRecord: host create or update with {"__meta__":{"cpu_info":"{\"processors\":[{\"capabilities\":[\"fpu\",\"vme\",\"de\",\"pse\",\"tsc\",\"msr\",\"pae\",\"mce\",\"cx8\",\"apic\",\"sep\",\"mtrr\",\"pge\",\"mca\",\"cmov\",\"pat\",\"pse36\",\"clflush\",\"dts\",\"acpi\",\"mmx\",\"fxsr\",\"sse\",\"sse2\",\"ss\",\"ht\",\"tm\",\"pbe\",\"syscall\",\"nx\",\"pdpe1gb\",\"rdtscp\",\"lm\",\"constant_tsc\",\"art\",\"arch_perfmon\",\"pebs\",\"bts\",\"rep_good\",\"nopl\",\"xtopology\",\"nonstop_tsc\",\"aperfmperf\",\"eagerfpu\",\"pni\",\"pclmulqdq\",\"dtes64\",\"monitor\",\"ds_cpl\",\"vmx\",\"smx\",\"est\",\"tm2\",\"ssse3\",\"sdbg\",\"fma\",\"cx16\",\"xtpr\",\"pdcm\",\"pcid\",\"dca\",\"sse4_1\",\"sse4_2\",\"x2apic\",\"movbe\",\"popcnt\",\"tsc_deadline_timer\",\"aes\",\"xsave\",\"avx\",\"f16c\",\"rdrand\",\"lahf_lm\",\"abm\",\"3dnowprefetch\",\"epb\",\"cat_l3\",\"cdp_l3\",\"invpcid_single\",\"intel_ppin\",\"ssbd\",\"mba\",\"rsb_ctxsw\",\"ibrs\",\"ibpb\",\"stibp\",\"tpr_shadow\",\"vnmi\",\"flexpriority\",\"ept\",\"vpid\",\"fsgsbase\",\"tsc_adjust\",\"bmi1\",\"hle\",\"avx2\",\"smep\",\"bmi2\",\"erms\",\"invpcid\",\"rtm\",\"cqm\",\"mpx\",\"rdt_a\",\"avx512f\",\"avx512dq\",\"rdseed\",\"adx\",\"smap\",\"clflushopt\",\"clwb\",\"intel_pt\",\"avx512cd\",\"avx512bw\",\"avx512vl\",\"xsaveopt\",\"xsavec\",\"xgetbv1\",\"cqm_llc\",\"cqm_occup_llc\",\"cqm_mbm_total\",\"cqm_mbm_local\",\"dtherm\",\"ida\",\"arat\",\"pln\",\"pts\",\"hwp\",\"hwp_act_window\",\"hwp_epp\",\"hwp_pkg_req\",\"pku\",\"ospke\",\"md_clear\",\"spec_ctrl\",\"intel_stibp\",\"flush_l1d\",\"arch_capabilities\"],\"cores\":[{\"id\":0,\"index\":0,\"logical_processors\":[0,40],\"total_threads\":2},{\"id\":0,\"index\":1,\"logical_processors\":[1,41],\"total_threads\":2},{\"id\":0,\"index\":16,\"logical_processors\":[10,50],\"total_threads\":2},{\"id\":0,\"index\":17,\"logical_processors\":[11,51],\"total_threads\":2},{\"id\":0,\"index\":18,\"logical_processors\":[12,52],\"total_threads\":2},{\"id\":0,\"index\":19,\"logical_processors\":[13,53],\"total_threads\":2},{\"id\":0,\"index\":20,\"logical_processors\":[14,54],\"total_threads\":2},{\"id\":0,\"index\":24,\"logical_processors\":[15,55],\"total_threads\":2},{\"id\":0,\"index\":25,\"logical_processors\":[16,56],\"total_threads\":2},{\"id\":0,\"index\":26,\"logical_processors\":[17,57],\"total_threads\":2},{\"id\":0,\"index\":27,\"logical_processors\":[18,58],\"total_threads\":2},{\"id\":0,\"index\":28,\"logical_processors\":[19,59],\"total_threads\":2},{\"id\":0,\"index\":2,\"logical_processors\":[2,42],\"total_threads\":2},{\"id\":0,\"index\":3,\"logical_processors\":[3,43],\"total_threads\":2},{\"id\":0,\"index\":4,\"logical_processors\":[4,44],\"total_threads\":2},{\"id\":0,\"index\":8,\"logical_processors\":[45,5],\"total_threads\":2},{\"id\":0,\"index\":9,\"logical_processors\":[46,6],\"total_threads\":2},{\"id\":0,\"index\":10,\"logical_processors\":[47,7],\"total_threads\":2},{\"id\":0,\"index\":11,\"logical_processors\":[48,8],\"total_threads\":2},{\"id\":0,\"index\":12,\"logical_processors\":[49,9],\"total_threads\":2}],\"id\":0,\"model\":\"Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz\",\"total_cores\":20,\"total_threads\":40,\"vendor\":\"GenuineIntel\"},{\"capabilities\":[\"fpu\",\"vme\",\"de\",\"pse\",\"tsc\",\"msr\",\"pae\",\"mce\",\"cx8\",\"apic\",\"sep\",\"mtrr\",\"pge\",\"mca\",\"cmov\",\"pat\",\"pse36\",\"clflush\",\"dts\",\"acpi\",\"mmx\",\"fxsr\",\"sse\",\"sse2\",\"ss\",\"ht\",\"tm\",\"pbe\",\"syscall\",\"nx\",\"pdpe1gb\",\"rdtscp\",\"lm\",\"constant_tsc\",\"art\",\"arch_perfmon\",\"pebs\",\"bts\",\"rep_good\",\"nopl\",\"xtopology\",\"nonstop_tsc\",\"aperfmperf\",\"eagerfpu\",\"pni\",\"pclmulqdq\",\"dtes64\",\"monitor\",\"ds_cpl\",\"vmx\",\"smx\",\"est\",\"tm2\",\"ssse3\",\"sdbg\",\"fma\",\"cx16\",\"xtpr\",\"pdcm\",\"pcid\",\"dca\",\"sse4_1\",\"sse4_2\",\"x2apic\",\"movbe\",\"popcnt\",\"tsc_deadline_timer\",\"aes\",\"xsave\",\"avx\",\"f16c\",\"rdrand\",\"lahf_lm\",\"abm\",\"3dnowprefetch\",\"epb\",\"cat_l3\",\"cdp_l3\",\"invpcid_single\",\"intel_ppin\",\"ssbd\",\"mba\",\"rsb_ctxsw\",\"ibrs\",\"ibpb\",\"stibp\",\"tpr_shadow\",\"vnmi\",\"flexpriority\",\"ept\",\"vpid\",\"fsgsbase\",\"tsc_adjust\",\"bmi1\",\"hle\",\"avx2\",\"smep\",\"bmi2\",\"erms\",\"invpcid\",\"rtm\",\"cqm\",\"mpx\",\"rdt_a\",\"avx512f\",\"avx512dq\",\"rdseed\",\"adx\",\"smap\",\"clflushopt\",\"clwb\",\"intel_pt\",\"avx512cd\",\"avx512bw\",\"avx512vl\",\"xsaveopt\",\"xsavec\",\"xgetbv1\",\"cqm_llc\",\"cqm_occup_llc\",\"cqm_mbm_total\",\"cqm_mbm_local\",\"dtherm\",\"ida\",\"arat\",\"pln\",\"pts\",\"hwp\",\"hwp_act_window\",\"hwp_epp\",\"hwp_pkg_req\",\"pku\",\"ospke\",\"md_clear\",\"spec_ctrl\",\"intel_stibp\",\"flush_l1d\",\"arch_capabilities\"],\"cores\":[{\"id\":0,\"index\":0,\"logical_processors\":[20,60],\"total_threads\":2},{\"id\":0,\"index\":1,\"logical_processors\":[21,61],\"total_threads\":2},{\"id\":0,\"index\":2,\"logical_processors\":[22,62],\"total_threads\":2},{\"id\":0,\"index\":3,\"logical_processors\":[23,63],\"total_threads\":2},{\"id\":0,\"index\":4,\"logical_processors\":[24,64],\"total_threads\":2},{\"id\":0,\"index\":8,\"logical_processors\":[25,65],\"total_threads\":2},{\"id\":0,\"index\":9,\"logical_processors\":[26,66],\"total_threads\":2},{\"id\":0,\"index\":10,\"logical_processors\":[27,67],\"total_threads\":2},{\"id\":0,\"index\":11,\"logical_processors\":[28,68],\"total_threads\":2},{\"id\":0,\"index\":12,\"logical_processors\":[29,69],\"total_threads\":2},{\"id\":0,\"index\":16,\"logical_processors\":[30,70],\"total_threads\":2},{\"id\":0,\"index\":17,\"logical_processors\":[31,71],\"total_threads\":2},{\"id\":0,\"index\":18,\"logical_processors\":[32,72],\"total_threads\":2},{\"id\":0,\"index\":19,\"logical_processors\":[33,73],\"total_threads\":2},{\"id\":0,\"index\":20,\"logical_processors\":[34,74],\"total_threads\":2},{\"id\":0,\"index\":24,\"logical_processors\":[35,75],\"total_threads\":2},{\"id\":0,\"index\":25,\"logical_processors\":[36,76],\"total_threads\":2},{\"id\":0,\"index\":26,\"logical_processors\":[37,77],\"total_threads\":2},{\"id\":0,\"index\":27,\"logical_processors\":[38,78],\"total_threads\":2},{\"id\":0,\"index\":28,\"logical_processors\":[39,79],\"total_threads\":2}],\"id\":1,\"model\":\"Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz\",\"total_cores\":20,\"total_threads\":40,\"vendor\":\"GenuineIntel\"}],\"total_cores\":40,\"total_threads\":80}","hugepage_size_kb":"0","hugepages_option":"transparent","kernel_version":"3.10.0-1160.105.1.el7.x86_64","kvm_module":"kvm-intel","manufacture":"ASUSTeK COMPUTER INC.","model":"RS540-E9-RS36-E","nest":"enabled","oem_name":"asustek computer inc.","os_distribution":"CentOS Linux","os_version":"7.9.2009","ovs_version":"2.12.4","qemu_version":"4.2.0","sn":"MAS0CG0000ZL","topology":"{\"architecture\":\"numa\",\"nodes\":[{\"caches\":[{\"level\":1,\"logical_processors\":[0,40],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[1,41],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[2,42],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[3,43],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[4,44],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[5,45],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[6,46],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[7,47],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[8,48],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[9,49],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[10,50],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[11,51],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[12,52],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[13,53],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[14,54],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[15,55],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[16,56],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[17,57],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[18,58],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[19,59],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[0,40],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[1,41],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[2,42],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[3,43],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[4,44],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[5,45],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[6,46],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[7,47],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[8,48],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[9,49],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[10,50],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[11,51],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[12,52],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[13,53],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[14,54],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[15,55],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[16,56],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[17,57],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[18,58],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[19,59],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":2,\"logical_processors\":[0,40],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[1,41],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[2,42],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[3,43],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[4,44],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[5,45],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[6,46],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[7,47],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[8,48],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[9,49],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[10,50],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[11,51],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[12,52],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[13,53],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[14,54],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[15,55],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[16,56],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[17,57],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[18,58],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[19,59],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":3,\"logical_processors\":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59],\"size_bytes\":28835840,\"type\":\"unified\"}],\"cores\":[{\"id\":0,\"index\":0,\"logical_processors\":[0,40],\"total_threads\":2},{\"id\":1,\"index\":1,\"logical_processors\":[1,41],\"total_threads\":2},{\"id\":16,\"index\":2,\"logical_processors\":[10,50],\"total_threads\":2},{\"id\":17,\"index\":3,\"logical_processors\":[11,51],\"total_threads\":2},{\"id\":18,\"index\":4,\"logical_processors\":[12,52],\"total_threads\":2},{\"id\":19,\"index\":5,\"logical_processors\":[13,53],\"total_threads\":2},{\"id\":20,\"index\":6,\"logical_processors\":[14,54],\"total_threads\":2},{\"id\":24,\"index\":7,\"logical_processors\":[15,55],\"total_threads\":2},{\"id\":25,\"index\":8,\"logical_processors\":[16,56],\"total_threads\":2},{\"id\":26,\"index\":9,\"logical_processors\":[17,57],\"total_threads\":2},{\"id\":27,\"index\":10,\"logical_processors\":[18,58],\"total_threads\":2},{\"id\":28,\"index\":11,\"logical_processors\":[19,59],\"total_threads\":2},{\"id\":2,\"index\":12,\"logical_processors\":[2,42],\"total_threads\":2},{\"id\":3,\"index\":13,\"logical_processors\":[3,43],\"total_threads\":2},{\"id\":4,\"index\":14,\"logical_processors\":[4,44],\"total_threads\":2},{\"id\":8,\"index\":15,\"logical_processors\":[45,5],\"total_threads\":2},{\"id\":9,\"index\":16,\"logical_processors\":[46,6],\"total_threads\":2},{\"id\":10,\"index\":17,\"logical_processors\":[47,7],\"total_threads\":2},{\"id\":11,\"index\":18,\"logical_processors\":[48,8],\"total_threads\":2},{\"id\":12,\"index\":19,\"logical_processors\":[49,9],\"total_threads\":2}],\"distances\":[10,21],\"id\":0,\"memory\":{\"supported_page_sizes\":[1073741824,2097152],\"total_physical_bytes\":34359738368,\"total_usable_bytes\":33216487424}},{\"caches\":[{\"level\":1,\"logical_processors\":[20,60],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[21,61],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[22,62],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[23,63],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[24,64],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[25,65],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[26,66],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[27,67],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[28,68],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[29,69],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[30,70],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[31,71],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[32,72],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[33,73],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[34,74],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[35,75],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[36,76],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[37,77],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[38,78],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[39,79],\"size_bytes\":32768,\"type\":\"instruction\"},{\"level\":1,\"logical_processors\":[20,60],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[21,61],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[22,62],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[23,63],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[24,64],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[25,65],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[26,66],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[27,67],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[28,68],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[29,69],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[30,70],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[31,71],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[32,72],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[33,73],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[34,74],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[35,75],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[36,76],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[37,77],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[38,78],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":1,\"logical_processors\":[39,79],\"size_bytes\":32768,\"type\":\"data\"},{\"level\":2,\"logical_processors\":[20,60],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[21,61],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[22,62],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[23,63],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[24,64],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[25,65],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[26,66],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[27,67],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[28,68],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[29,69],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[30,70],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[31,71],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[32,72],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[33,73],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[34,74],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[35,75],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[36,76],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[37,77],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[38,78],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":2,\"logical_processors\":[39,79],\"size_bytes\":1048576,\"type\":\"unified\"},{\"level\":3,\"logical_processors\":[20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79],\"size_bytes\":28835840,\"type\":\"unified\"}],\"cores\":[{\"id\":0,\"index\":0,\"logical_processors\":[20,60],\"total_threads\":2},{\"id\":1,\"index\":1,\"logical_processors\":[21,61],\"total_threads\":2},{\"id\":2,\"index\":2,\"logical_processors\":[22,62],\"total_threads\":2},{\"id\":3,\"index\":3,\"logical_processors\":[23,63],\"total_threads\":2},{\"id\":4,\"index\":4,\"logical_processors\":[24,64],\"total_threads\":2},{\"id\":8,\"index\":5,\"logical_processors\":[25,65],\"total_threads\":2},{\"id\":9,\"index\":6,\"logical_processors\":[26,66],\"total_threads\":2},{\"id\":10,\"index\":7,\"logical_processors\":[27,67],\"total_threads\":2},{\"id\":11,\"index\":8,\"logical_processors\":[28,68],\"total_threads\":2},{\"id\":12,\"index\":9,\"logical_processors\":[29,69],\"total_threads\":2},{\"id\":16,\"index\":10,\"logical_processors\":[30,70],\"total_threads\":2},{\"id\":17,\"index\":11,\"logical_processors\":[31,71],\"total_threads\":2},{\"id\":18,\"index\":12,\"logical_processors\":[32,72],\"total_threads\":2},{\"id\":19,\"index\":13,\"logical_processors\":[33,73],\"total_threads\":2},{\"id\":20,\"index\":14,\"logical_processors\":[34,74],\"total_threads\":2},{\"id\":24,\"index\":15,\"logical_processors\":[35,75],\"total_threads\":2},{\"id\":25,\"index\":16,\"logical_processors\":[36,76],\"total_threads\":2},{\"id\":26,\"index\":17,\"logical_processors\":[37,77],\"total_threads\":2},{\"id\":27,\"index\":18,\"logical_processors\":[38,78],\"total_threads\":2},{\"id\":28,\"index\":19,\"logical_processors\":[39,79],\"total_threads\":2}],\"distances\":[21,10],\"id\":1,\"memory\":{\"supported_page_sizes\":[1073741824,2097152],\"total_physical_bytes\":34359738368,\"total_usable_bytes\":33798848512}}]}","version":"Rev 1.xx"},"access_ip":"172.16.1.211","access_mac":"7c:10:c9:c1:f8:00","cpu_architecture":"x86_64","cpu_cache":"28160","cpu_count":80,"cpu_desc":"Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz","cpu_mhz":2562,"cpu_microcode":"0x2007006","dry_run":false,"generate_name":"master1-172-16-1-211","host_type":"hypervisor","manager_uri":"https://172.16.1.211:8885","mem_reserved":"6653","mem_size":"63910","no_bmc":false,"node_count":2,"ovn_version":"2.12.4-2","page_size_kb":4,"rack":"rack0","slots":"slot0","sn":"MAS0CG0000ZL","storage_driver":"Linux","storage_size":872847,"sys_info":{"cpu_info":{"processors":[{"capabilities":["fpu","vme","de","pse","tsc","msr","pae","mce","cx8","apic","sep","mtrr","pge","mca","cmov","pat","pse36","clflush","dts","acpi","mmx","fxsr","sse","sse2","ss","ht","tm","pbe","syscall","nx","pdpe1gb","rdtscp","lm","constant_tsc","art","arch_perfmon","pebs","bts","rep_good","nopl","xtopology","nonstop_tsc","aperfmperf","eagerfpu","pni","pclmulqdq","dtes64","monitor","ds_cpl","vmx","smx","est","tm2","ssse3","sdbg","fma","cx16","xtpr","pdcm","pcid","dca","sse4_1","sse4_2","x2apic","movbe","popcnt","tsc_deadline_timer","aes","xsave","avx","f16c","rdrand","lahf_lm","abm","3dnowprefetch","epb","cat_l3","cdp_l3","invpcid_single","intel_ppin","ssbd","mba","rsb_ctxsw","ibrs","ibpb","stibp","tpr_shadow","vnmi","flexpriority","ept","vpid","fsgsbase","tsc_adjust","bmi1","hle","avx2","smep","bmi2","erms","invpcid","rtm","cqm","mpx","rdt_a","avx512f","avx512dq","rdseed","adx","smap","clflushopt","clwb","intel_pt","avx512cd","avx512bw","avx512vl","xsaveopt","xsavec","xgetbv1","cqm_llc","cqm_occup_llc","cqm_mbm_total","cqm_mbm_local","dtherm","ida","arat","pln","pts","hwp","hwp_act_window","hwp_epp","hwp_pkg_req","pku","ospke","md_clear","spec_ctrl","intel_stibp","flush_l1d","arch_capabilities"],"cores":[{"id":0,"index":0,"logical_processors":[0,40],"total_threads":2},{"id":0,"index":1,"logical_processors":[1,41],"total_threads":2},{"id":0,"index":16,"logical_processors":[10,50],"total_threads":2},{"id":0,"index":17,"logical_processors":[11,51],"total_threads":2},{"id":0,"index":18,"logical_processors":[12,52],"total_threads":2},{"id":0,"index":19,"logical_processors":[13,53],"total_threads":2},{"id":0,"index":20,"logical_processors":[14,54],"total_threads":2},{"id":0,"index":24,"logical_processors":[15,55],"total_threads":2},{"id":0,"index":25,"logical_processors":[16,56],"total_threads":2},{"id":0,"index":26,"logical_processors":[17,57],"total_threads":2},{"id":0,"index":27,"logical_processors":[18,58],"total_threads":2},{"id":0,"index":28,"logical_processors":[19,59],"total_threads":2},{"id":0,"index":2,"logical_processors":[2,42],"total_threads":2},{"id":0,"index":3,"logical_processors":[3,43],"total_threads":2},{"id":0,"index":4,"logical_processors":[4,44],"total_threads":2},{"id":0,"index":8,"logical_processors":[45,5],"total_threads":2},{"id":0,"index":9,"logical_processors":[46,6],"total_threads":2},{"id":0,"index":10,"logical_processors":[47,7],"total_threads":2},{"id":0,"index":11,"logical_processors":[48,8],"total_threads":2},{"id":0,"index":12,"logical_processors":[49,9],"total_threads":2}],"id":0,"model":"Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz","total_cores":20,"total_threads":40,"vendor":"GenuineIntel"},{"capabilities":["fpu","vme","de","pse","tsc","msr","pae","mce","cx8","apic","sep","mtrr","pge","mca","cmov","pat","pse36","clflush","dts","acpi","mmx","fxsr","sse","sse2","ss","ht","tm","pbe","syscall","nx","pdpe1gb","rdtscp","lm","constant_tsc","art","arch_perfmon","pebs","bts","rep_good","nopl","xtopology","nonstop_tsc","aperfmperf","eagerfpu","pni","pclmulqdq","dtes64","monitor","ds_cpl","vmx","smx","est","tm2","ssse3","sdbg","fma","cx16","xtpr","pdcm","pcid","dca","sse4_1","sse4_2","x2apic","movbe","popcnt","tsc_deadline_timer","aes","xsave","avx","f16c","rdrand","lahf_lm","abm","3dnowprefetch","epb","cat_l3","cdp_l3","invpcid_single","intel_ppin","ssbd","mba","rsb_ctxsw","ibrs","ibpb","stibp","tpr_shadow","vnmi","flexpriority","ept","vpid","fsgsbase","tsc_adjust","bmi1","hle","avx2","smep","bmi2","erms","invpcid","rtm","cqm","mpx","rdt_a","avx512f","avx512dq","rdseed","adx","smap","clflushopt","clwb","intel_pt","avx512cd","avx512bw","avx512vl","xsaveopt","xsavec","xgetbv1","cqm_llc","cqm_occup_llc","cqm_mbm_total","cqm_mbm_local","dtherm","ida","arat","pln","pts","hwp","hwp_act_window","hwp_epp","hwp_pkg_req","pku","ospke","md_clear","spec_ctrl","intel_stibp","flush_l1d","arch_capabilities"],"cores":[{"id":0,"index":0,"logical_processors":[20,60],"total_threads":2},{"id":0,"index":1,"logical_processors":[21,61],"total_threads":2},{"id":0,"index":2,"logical_processors":[22,62],"total_threads":2},{"id":0,"index":3,"logical_processors":[23,63],"total_threads":2},{"id":0,"index":4,"logical_processors":[24,64],"total_threads":2},{"id":0,"index":8,"logical_processors":[25,65],"total_threads":2},{"id":0,"index":9,"logical_processors":[26,66],"total_threads":2},{"id":0,"index":10,"logical_processors":[27,67],"total_threads":2},{"id":0,"index":11,"logical_processors":[28,68],"total_threads":2},{"id":0,"index":12,"logical_processors":[29,69],"total_threads":2},{"id":0,"index":16,"logical_processors":[30,70],"total_threads":2},{"id":0,"index":17,"logical_processors":[31,71],"total_threads":2},{"id":0,"index":18,"logical_processors":[32,72],"total_threads":2},{"id":0,"index":19,"logical_processors":[33,73],"total_threads":2},{"id":0,"index":20,"logical_processors":[34,74],"total_threads":2},{"id":0,"index":24,"logical_processors":[35,75],"total_threads":2},{"id":0,"index":25,"logical_processors":[36,76],"total_threads":2},{"id":0,"index":26,"logical_processors":[37,77],"total_threads":2},{"id":0,"index":27,"logical_processors":[38,78],"total_threads":2},{"id":0,"index":28,"logical_processors":[39,79],"total_threads":2}],"id":1,"model":"Intel(R) Xeon(R) Gold 6138 CPU @ 2.00GHz","total_cores":20,"total_threads":40,"vendor":"GenuineIntel"}],"total_cores":40,"total_threads":80},"hugepage_size_kb":0,"hugepages_option":"transparent","kernel_version":"3.10.0-1160.105.1.el7.x86_64","kvm_module":"kvm-intel","manufacture":"ASUSTeK COMPUTER INC.","model":"RS540-E9-RS36-E","nest":"enabled","oem_name":"asustek computer inc.","os_distribution":"CentOS Linux","os_version":"7.9.2009","ovs_version":"2.12.4","qemu_version":"4.2.0","sn":"MAS0CG0000ZL","topology":{"architecture":"numa","nodes":[{"caches":[{"level":1,"logical_processors":[0,40],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[1,41],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[2,42],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[3,43],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[4,44],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[5,45],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[6,46],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[7,47],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[8,48],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[9,49],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[10,50],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[11,51],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[12,52],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[13,53],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[14,54],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[15,55],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[16,56],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[17,57],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[18,58],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[19,59],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[0,40],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[1,41],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[2,42],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[3,43],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[4,44],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[5,45],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[6,46],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[7,47],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[8,48],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[9,49],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[10,50],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[11,51],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[12,52],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[13,53],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[14,54],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[15,55],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[16,56],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[17,57],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[18,58],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[19,59],"size_bytes":32768,"type":"data"},{"level":2,"logical_processors":[0,40],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[1,41],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[2,42],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[3,43],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[4,44],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[5,45],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[6,46],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[7,47],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[8,48],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[9,49],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[10,50],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[11,51],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[12,52],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[13,53],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[14,54],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[15,55],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[16,56],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[17,57],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[18,58],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[19,59],"size_bytes":1048576,"type":"unified"},{"level":3,"logical_processors":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59],"size_bytes":28835840,"type":"unified"}],"cores":[{"id":0,"index":0,"logical_processors":[0,40],"total_threads":2},{"id":1,"index":1,"logical_processors":[1,41],"total_threads":2},{"id":16,"index":2,"logical_processors":[10,50],"total_threads":2},{"id":17,"index":3,"logical_processors":[11,51],"total_threads":2},{"id":18,"index":4,"logical_processors":[12,52],"total_threads":2},{"id":19,"index":5,"logical_processors":[13,53],"total_threads":2},{"id":20,"index":6,"logical_processors":[14,54],"total_threads":2},{"id":24,"index":7,"logical_processors":[15,55],"total_threads":2},{"id":25,"index":8,"logical_processors":[16,56],"total_threads":2},{"id":26,"index":9,"logical_processors":[17,57],"total_threads":2},{"id":27,"index":10,"logical_processors":[18,58],"total_threads":2},{"id":28,"index":11,"logical_processors":[19,59],"total_threads":2},{"id":2,"index":12,"logical_processors":[2,42],"total_threads":2},{"id":3,"index":13,"logical_processors":[3,43],"total_threads":2},{"id":4,"index":14,"logical_processors":[4,44],"total_threads":2},{"id":8,"index":15,"logical_processors":[45,5],"total_threads":2},{"id":9,"index":16,"logical_processors":[46,6],"total_threads":2},{"id":10,"index":17,"logical_processors":[47,7],"total_threads":2},{"id":11,"index":18,"logical_processors":[48,8],"total_threads":2},{"id":12,"index":19,"logical_processors":[49,9],"total_threads":2}],"distances":[10,21],"id":0,"memory":{"supported_page_sizes":[1073741824,2097152],"total_physical_bytes":34359738368,"total_usable_bytes":33216487424}},{"caches":[{"level":1,"logical_processors":[20,60],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[21,61],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[22,62],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[23,63],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[24,64],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[25,65],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[26,66],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[27,67],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[28,68],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[29,69],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[30,70],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[31,71],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[32,72],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[33,73],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[34,74],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[35,75],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[36,76],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[37,77],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[38,78],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[39,79],"size_bytes":32768,"type":"instruction"},{"level":1,"logical_processors":[20,60],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[21,61],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[22,62],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[23,63],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[24,64],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[25,65],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[26,66],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[27,67],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[28,68],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[29,69],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[30,70],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[31,71],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[32,72],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[33,73],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[34,74],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[35,75],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[36,76],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[37,77],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[38,78],"size_bytes":32768,"type":"data"},{"level":1,"logical_processors":[39,79],"size_bytes":32768,"type":"data"},{"level":2,"logical_processors":[20,60],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[21,61],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[22,62],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[23,63],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[24,64],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[25,65],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[26,66],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[27,67],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[28,68],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[29,69],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[30,70],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[31,71],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[32,72],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[33,73],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[34,74],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[35,75],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[36,76],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[37,77],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[38,78],"size_bytes":1048576,"type":"unified"},{"level":2,"logical_processors":[39,79],"size_bytes":1048576,"type":"unified"},{"level":3,"logical_processors":[20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79],"size_bytes":28835840,"type":"unified"}],"cores":[{"id":0,"index":0,"logical_processors":[20,60],"total_threads":2},{"id":1,"index":1,"logical_processors":[21,61],"total_threads":2},{"id":2,"index":2,"logical_processors":[22,62],"total_threads":2},{"id":3,"index":3,"logical_processors":[23,63],"total_threads":2},{"id":4,"index":4,"logical_processors":[24,64],"total_threads":2},{"id":8,"index":5,"logical_processors":[25,65],"total_threads":2},{"id":9,"index":6,"logical_processors":[26,66],"total_threads":2},{"id":10,"index":7,"logical_processors":[27,67],"total_threads":2},{"id":11,"index":8,"logical_processors":[28,68],"total_threads":2},{"id":12,"index":9,"logical_processors":[29,69],"total_threads":2},{"id":16,"index":10,"logical_processors":[30,70],"total_threads":2},{"id":17,"index":11,"logical_processors":[31,71],"total_threads":2},{"id":18,"index":12,"logical_processors":[32,72],"total_threads":2},{"id":19,"index":13,"logical_processors":[33,73],"total_threads":2},{"id":20,"index":14,"logical_processors":[34,74],"total_threads":2},{"id":24,"index":15,"logical_processors":[35,75],"total_threads":2},{"id":25,"index":16,"logical_processors":[36,76],"total_threads":2},{"id":26,"index":17,"logical_processors":[37,77],"total_threads":2},{"id":27,"index":18,"logical_processors":[38,78],"total_threads":2},{"id":28,"index":19,"logical_processors":[39,79],"total_threads":2}],"distances":[21,10],"id":1,"memory":{"supported_page_sizes":[1073741824,2097152],"total_physical_bytes":34359738368,"total_usable_bytes":33798848512}}]},"version":"Rev 1.xx"},"version":"release/3.10(e9d111f07323122909)"}: {"error":{"class":"ConflictError","code":409,"details":"manager.inputUniquenessCheck: {\"error\":{\"class\":\"ConflictError\",\"code\":409,\"data\":{\"fields\":[\"manager_uri\",\"https://172.16.1.211:8885\"],\"id\":\"duplicate %!s(MISSING) %!s(MISSING)\"},\"details\":\"duplicate manager_uri https://172.16.1.211:8885\"}}","request":{"body":"{\"host\":{\"__meta__\":{\"cpu_info\":\"{\\\"processors\\\":[{\\\"capabilities\\\":[\\\"fpu\\\",\\\"vme\\\",\\\"de\\\",\\\"pse\\\",...10(e9d111f07323122909)\"}}","headers":{"Content-Length":"40280","Content-Type":"application/json","User-Agent":"yunioncloud-go/201708","X-Auth-Token":"*","X-Yunion-Parent-Id":"","X-Yunion-Peer-Service-Name":"host","X-Yunion-Remote-Addr":"default-region:30888","X-Yunion-Span-Id":"0","X-Yunion-Span-Name":"","X-Yunion-Strace-Debug":"true","X-Yunion-Strace-Id":"8ad85158"},"method":"POST","url":"https://default-region:30888/zones/7b6ae896-1b3d-40e5-879f-cfd00799200b/hosts"}}}
[error 2024-01-04 23:45:15 timeutils2.AddTimeout.func1.1(timeutils.go:31)] register failed, try 30 seconds later...
goroutine 1036 [running]:
runtime/debug.Stack()
        /usr/lib/go/src/runtime/debug/stack.go:24 +0x65
runtime/debug.PrintStack()
        /usr/lib/go/src/runtime/debug/stack.go:16 +0x19
yunion.io/x/onecloud/pkg/util/timeutils2.AddTimeout.func1.1()
        /root/go/src/yunion.io/x/onecloud/pkg/util/timeutils2/timeutils.go:32 +0x59
panic({0x28665e0, 0x34ee2d0})
        /usr/lib/go/src/runtime/panic.go:838 +0x207
yunion.io/x/onecloud/pkg/hostman/hostinfo.(*SHostInfo).onFail(0xc000cb8180, {0x2b4f440?, 0xc000890738?})
        /root/go/src/yunion.io/x/onecloud/pkg/hostman/hostinfo/hostinfo.go:1116 +0xeb
yunion.io/x/onecloud/pkg/hostman/hostinfo.(*SHostInfo).register(0xc000cb8180)
        /root/go/src/yunion.io/x/onecloud/pkg/hostman/hostinfo/hostinfo.go:1081 +0x6f
yunion.io/x/onecloud/pkg/util/timeutils2.AddTimeout.func1()
        /root/go/src/yunion.io/x/onecloud/pkg/util/timeutils2/timeutils.go:37 +0x5c
created by yunion.io/x/onecloud/pkg/util/timeutils2.AddTimeout
        /root/go/src/yunion.io/x/onecloud/pkg/util/timeutils2/timeutils.go:28 +0x65
[info 2024-01-04 23:45:45 hostinfo.(*SHostInfo).ensureMasterNetworks(hostinfo.go:1206)] Master ip 172.16.1.211 to fetch wire
[info 2024-01-04 23:45:45 hostinfo.(*SHostInfo).initZoneInfo(hostinfo.go:1248)] Start GetZoneInfo 7b6ae896-1b3d-40e5-879f-cfd00799200b
[info 2024-01-04 23:45:45 hostinfo.(*SHostInfo).getKubeReservedMemMb(hostinfo.go:1523)] Kubelet memory threshold subtracted: 100MB
[error 2024-01-04 23:45:45 hostinfo.(*SHostInfo).onFail(hostinfo.go:1114)] register failed: initHostRecords: ensureHostRecord: host create or update
chenjacken commented 9 months ago 
[root@master1 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond1 state UP group default qlen 1000
    link/ether 7c:10:c9:c1:f8:00 brd ff:ff:ff:ff:ff:ff
3: enp175s0f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 68:a8:28:27:e3:fe brd ff:ff:ff:ff:ff:ff
4: eno2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond1 state UP group default qlen 1000
    link/ether 7c:10:c9:c1:f8:00 brd ff:ff:ff:ff:ff:ff
5: enp175s0f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 68:a8:28:27:e3:fe brd ff:ff:ff:ff:ff:ff
6: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc fq_codel master ovs-system state UP group default qlen 1000
    link/ether 68:a8:28:27:e3:fe brd ff:ff:ff:ff:ff:ff
    inet6 fe80::7802:53aa:c399:13e9/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
7: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc fq_codel master ovs-system state UP group default qlen 1000
    link/ether 7c:10:c9:c1:f8:00 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::ef2b:4103:3d32:4b3f/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
8: dummy0: <BROADCAST,NOARP> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 5e:90:3f:08:57:4e brd ff:ff:ff:ff:ff:ff
9: kube-ipvs0: <BROADCAST,NOARP> mtu 1500 qdisc noop state DOWN group default 
    link/ether ee:a6:92:54:8c:4c brd ff:ff:ff:ff:ff:ff
    inet 10.111.110.199/32 brd 10.111.110.199 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.104.7.188/32 brd 10.104.7.188 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.105.213.213/32 brd 10.105.213.213 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.101.197.115/32 brd 10.101.197.115 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.98.86.128/32 brd 10.98.86.128 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.105.23.168/32 brd 10.105.23.168 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.104.109.247/32 brd 10.104.109.247 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.100.21.170/32 brd 10.100.21.170 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.96.30.54/32 brd 10.96.30.54 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.103.50.187/32 brd 10.103.50.187 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.98.45.107/32 brd 10.98.45.107 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.107.68.159/32 brd 10.107.68.159 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.109.60.13/32 brd 10.109.60.13 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.105.106.19/32 brd 10.105.106.19 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.109.241.19/32 brd 10.109.241.19 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.102.105.159/32 brd 10.102.105.159 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.110.193.200/32 brd 10.110.193.200 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.96.0.1/32 brd 10.96.0.1 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.107.21.120/32 brd 10.107.21.120 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.96.0.10/32 brd 10.96.0.10 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.103.93.23/32 brd 10.103.93.23 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.109.132.106/32 brd 10.109.132.106 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.107.10.38/32 brd 10.107.10.38 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.111.155.36/32 brd 10.111.155.36 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.103.162.160/32 brd 10.103.162.160 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.98.84.161/32 brd 10.98.84.161 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.101.188.144/32 brd 10.101.188.144 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.106.26.5/32 brd 10.106.26.5 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.110.97.106/32 brd 10.110.97.106 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.98.134.21/32 brd 10.98.134.21 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.97.160.207/32 brd 10.97.160.207 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.101.22.231/32 brd 10.101.22.231 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.108.105.210/32 brd 10.108.105.210 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.110.172.88/32 brd 10.110.172.88 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
    inet 10.97.76.93/32 brd 10.97.76.93 scope global kube-ipvs0
       valid_lft forever preferred_lft forever
10: calif995d16c97b@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
11: calid22e44a3ce0@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 1
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
12: cali73aaeed353f@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 2
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
13: calib559ced3ffc@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 3
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
14: calib91452f3588@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 4
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
15: calia4f77105602@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 5
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
16: cali0ea1eb21795@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 6
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
17: cali0774b5795a7@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 7
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
18: calib64fedb40ab@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 8
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
19: cali4ffb3eb36b4@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 9
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
20: cali8e3c9802716@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 10
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
21: cali6d0b64a30aa@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 11
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
22: cali81bed86c5a4@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 12
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
23: cali78aad20c054@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 13
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
24: ovs-gretap0@NONE: <BROADCAST,MULTICAST> mtu 1462 qdisc noop state DOWN group default qlen 1000
    link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff
25: erspan0@NONE: <BROADCAST,MULTICAST> mtu 1450 qdisc noop state DOWN group default qlen 1000
    link/ether 66:d9:40:35:92:33 brd ff:ff:ff:ff:ff:ff
26: gre0@NONE: <NOARP> mtu 1476 qdisc noop state DOWN group default qlen 1000
    link/gre 0.0.0.0 brd 0.0.0.0
27: ovs-ip6gre0@NONE: <NOARP> mtu 1448 qdisc noop state DOWN group default qlen 1000
    link/gre6 00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00 brd 00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00
28: ovs-ip6tnl0@NONE: <NOARP> mtu 1452 qdisc noop state DOWN group default qlen 1000
    link/tunnel6 :: brd ::
30: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 2e:94:1b:e4:3d:ac brd ff:ff:ff:ff:ff:ff
31: br0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 7c:10:c9:c1:f8:00 brd ff:ff:ff:ff:ff:ff
    inet 172.16.1.211/24 brd 172.16.1.255 scope global br0
       valid_lft forever preferred_lft forever
    inet 172.16.1.200/32 scope global br0
       valid_lft forever preferred_lft forever
    inet 172.16.1.199/32 scope global br0
       valid_lft forever preferred_lft forever
    inet6 fe80::7e10:c9ff:fec1:f801/64 scope link 
       valid_lft forever preferred_lft forever
32: brtap: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 0e:54:56:44:3a:4e brd ff:ff:ff:ff:ff:ff
    inet6 fe80::c54:56ff:fe44:3a4e/64 scope link 
       valid_lft forever preferred_lft forever
33: br1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 68:a8:28:27:e3:fe brd ff:ff:ff:ff:ff:ff
    inet 10.0.1.211/24 brd 10.0.1.255 scope global br1
       valid_lft forever preferred_lft forever
    inet6 fe80::6aa8:28ff:fe27:e3fe/64 scope link 
       valid_lft forever preferred_lft forever
34: genev_sys_6081: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65485 qdisc noqueue master ovs-system state UNKNOWN group default qlen 1000
    link/ether c6:af:9a:e9:d8:a5 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::c4af:9aff:fee9:d8a5/64 scope link 
       valid_lft forever preferred_lft forever
35: brvpc: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 7e:45:65:48:8c:44 brd ff:ff:ff:ff:ff:ff
36: tunl0@NONE: <NOARP,UP,LOWER_UP> mtu 1440 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ipip 0.0.0.0 brd 0.0.0.0
    inet 10.40.137.64/32 brd 10.40.137.64 scope global tunl0
       valid_lft forever preferred_lft forever
37: calif45f983d1ad@if9: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 14
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
[root@master1 ~]#
chenjacken commented 9 months ago

kubectl -n onecloud logs default-region-689f894798-wwqrr --tail 100 -f的log:

[info 2024-01-05 01:19:43 appsrv.(*Application).ServeHTTP(appsrv.go:288)] KDm5G9vEttStIw7sU9mlCbpVegQ= 200 054374 GET /zones/7b6ae896-1b3d-40e5-879f-cfd00799200b?provider=OneCloud (10.40.137.64:48308:host) 38.07ms
[info 2024-01-05 01:19:43 appsrv.(*Application).ServeHTTP(appsrv.go:288)] KDm5G9vEttStIw7sU9mlCbpVegQ= 200 f2650a GET /hosts?any_mac=7c%3A10%3Ac9%3Ac1%3Af8%3A00&details=true&provider=OneCloud&scope=system (10.40.137.64:48308:host) 3.44ms
[error 2024-01-05 01:19:43 httperrors.HTTPError(httperrors.go:110)] Send error manager.inputUniquenessCheck: {"error":{"class":"ConflictError","code":409,"data":{"fields":["access_ip","172.16.1.211"],"id":"duplicate %!s(MISSING) %!s(MISSING)"},"details":"duplicate access_ip 172.16.1.211"}}
[info 2024-01-05 01:19:43 appsrv.(*Application).ServeHTTP(appsrv.go:288)] KDm5G9vEttStIw7sU9mlCbpVegQ= 409 3739c7 POST /zones/7b6ae896-1b3d-40e5-879f-cfd00799200b/hosts (10.40.137.64:48308:host) 17.78ms
[info 2024-01-05 01:19:49 appsrv.(*Application).ServeHTTP(appsrv.go:288)] KDm5G9vEttStIw7sU9mlCbpVegQ= 200 70b4b9 GET /networks?ip=172.16.1.212&is_classic=true&limit=0&provider=OneCloud&scope=system&vpc=default (10.40.180.0:59092:host) 30.95ms
[info 2024-01-05 01:19:49 appsrv.(*Application).ServeHTTP(appsrv.go:288)] KDm5G9vEttStIw7sU9mlCbpVegQ= 200 11b066 GET /wires/e4647959-d93a-44c8-80ec-9e5331a92f81 (10.40.180.0:59092:host) 23.57ms
[info 2024-01-05 01:19:49 appsrv.(*Application).ServeHTTP(appsrv.go:288)] KDm5G9vEttStIw7sU9mlCbpVegQ= 200 c0e875 GET /zones/7b6ae896-1b3d-40e5-879f-cfd00799200b?provider=OneCloud (10.40.180.0:59092:host) 38.61ms
[info 2024-01-05 01:19:49 appsrv.(*Application).ServeHTTP(appsrv.go:288)] KDm5G9vEttStIw7sU9mlCbpVegQ= 200 ce0a9a GET /hosts?any_mac=7c%3A10%3Ac9%3Ac1%3Af8%3A45&details=true&provider=OneCloud&scope=system (10.40.180.0:59092:host) 3.02ms
[error 2024-01-05 01:19:49 httperrors.HTTPError(httperrors.go:110)] Send error manager.inputUniquenessCheck: {"error":{"class":"ConflictError","code":409,"data":{"fields":["manager_uri","https://172.16.1.212:8885"],"id":"duplicate %!s(MISSING) %!s(MISSING)"},"details":"duplicate manager_uri https://172.16.1.212:8885"}}
[info 2024-01-05 01:19:49 appsrv.(*Application).ServeHTTP(appsrv.go:288)] KDm5G9vEttStIw7sU9mlCbpVegQ= 409 75f5ff POST /zones/7b6ae896-1b3d-40e5-879f-cfd00799200b/hosts (10.40.180.0:59092:host) 16.42ms
chenjacken commented 9 months ago

看问题，应该是bond网络的mac地址变动了的问题： bond1: 7c:10:c9:c1:f8:00 平台上绑定的mac：7c:10:c9:c1:f8:01

我在测试下。

hoganlxj commented 9 months ago

@chenjacken 参考宿主机更换mac地址 https://www.cloudpods.org/docs/guides/onpremise/host/troubleshooting/#%E5%AE%BF%E4%B8%BB%E6%9C%BAmac%E6%94%B9%E5%8F%98%E4%BC%9A%E5%AF%BC%E8%87%B4host%E6%9C%8D%E5%8A%A1%E7%A6%BB%E7%BA%BF%E9%9C%80%E8%A6%81%E6%9B%B4%E6%94%B9%E5%AE%BF%E4%B8%BB%E6%9C%BA%E5%9C%A8%E5%B9%B3%E5%8F%B0%E6%B3%A8%E5%86%8C%E7%9A%84mac%E5%9C%B0%E5%9D%80%E5%85%B7%E4%BD%93%E6%AD%A5%E9%AA%A4%E5%A6%82%E4%B8%8B

chenjacken commented 8 months ago

@chenjacken 参考宿主机更换mac地址 https://www.cloudpods.org/docs/guides/onpremise/host/troubleshooting/#%E5%AE%BF%E4%B8%BB%E6%9C%BAmac%E6%94%B9%E5%8F%98%E4%BC%9A%E5%AF%BC%E8%87%B4host%E6%9C%8D%E5%8A%A1%E7%A6%BB%E7%BA%BF%E9%9C%80%E8%A6%81%E6%9B%B4%E6%94%B9%E5%AE%BF%E4%B8%BB%E6%9C%BA%E5%9C%A8%E5%B9%B3%E5%8F%B0%E6%B3%A8%E5%86%8C%E7%9A%84mac%E5%9C%B0%E5%9D%80%E5%85%B7%E4%BD%93%E6%AD%A5%E9%AA%A4%E5%A6%82%E4%B8%8B

谢谢，问题已解决，固定好bond的mac地址即可。