openvswitch / ovs-issues

Issue tracker repo for Open vSwitch
10 stars 3 forks source link

[windows] Port cannot be opened (File exists) in containerd environment #262

Closed XinShuYang closed 1 year ago

XinShuYang commented 2 years ago

On Windows platform, we created two null type ports, then ran two containerd pods on host to create vNIC, and set ports type to internal to support the connections between ovs and pods. We found ovs error log of the second port during the test. The second port cannot be opened due to file exists and the first pod worked fine.

We got log like this: 2022-08-25T04:02:11.359Z|00085|bridge|WARN|could not open network device iis-7dc4-d21f05 (No such device) 2022-08-25T04:02:11.558Z|00086|bridge|WARN|could not open network device iis-7dc4-bd57ac (No such device) 2022-08-25T04:02:11.558Z|00087|bridge|WARN|could not open network device iis-7dc4-d21f05 (No such device) 2022-08-25T04:02:11.732Z|00088|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2022-08-25T04:02:11.936Z|00089|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2022-08-25T04:02:13.989Z|00090|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2022-08-25T04:02:13.994Z|00091|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2022-08-25T04:02:14.165Z|00092|ofproto|WARN|Dropped 7 log messages in last 73 seconds (most recently, 58 seconds ago) due to excessive rate 2022-08-25T04:02:14.166Z|00093|ofproto|WARN|br-int: ignoring port iis-7dc4-bd57ac (65535) because netdev iis-7dc4-bd57ac cannot be opened (File exists) 2022-08-25T04:02:14.166Z|00094|bridge|INFO|bridge br-int: added interface iis-7dc4-bd57ac on port 65535 2022-08-25T04:02:14.227Z|00095|wmi|WARN|Port with name: iis-7dc4-d21f05 already defined on the switch 2022-08-25T04:02:14.228Z|00096|bridge|INFO|bridge br-int: added interface iis-7dc4-d21f05 on port 5

twofish197 commented 1 year ago

Here the port iis-7dc4-2ace73 will be created with success,port iis-7dc4-a02d41will be created with failure.

The CMD operation chains is like that:

iis-7dc4-2ace73 and iis-7dc4-a02d41 is added very quickly. The port adding CMD operation Looks like the CMD list below(but the local executing will not meet issue)

ovs-vsctl --no-wait add-port br-int test-port8 Add-VMNetworkAdapter -SwitchName vsset -ManagementOS -Name test-port8 ovs-vsctl set interface test-port8 type=internal

2022-09-28T03:43:45.761Z|00176|bridge|WARN|bridge br-int: br-int added as bridge port 2022-09-28T03:43:45.761Z|00177|bridge|WARN|bridge br-int: antrea-tun0 added as bridge port 2022-09-28T03:43:45.761Z|00178|bridge|WARN|bridge br-int: antrea-gw0 added as bridge port 2022-09-28T03:43:45.761Z|00179|bridge|WARN|bridge br-int: iis-7dc4-a02d41 added as bridge port 2022-09-28T03:43:45.761Z|00180|bridge|WARN|bridge br-int: Ethernet0 2 added as bridge port 2022-09-28T03:43:45.761Z|00181|bridge|WARN|try dump port before del_ports 2022-09-28T03:43:45.761Z|00182|bridge|WARN|i 0 name Ethernet0 2 type nil 2022-09-28T03:43:45.761Z|00183|bridge|WARN|i 0 name antrea-tun0 type geneve 2022-09-28T03:43:45.761Z|00184|bridge|WARN|i 0 name iis-7dc4-a02d41 type nil 2022-09-28T03:43:45.761Z|00185|bridge|WARN|i 0 name antrea-gw0 type internal 2022-09-28T03:43:45.761Z|00186|bridge|WARN|i 0 name br-int type internal 2022-09-28T03:43:45.761Z|00187|bridge|WARN|iface_get_type interface name Ethernet0 2, type nil 2022-09-28T03:43:45.761Z|00188|bridge|WARN|iface_get_type interface name antrea-tun0, type geneve 2022-09-28T03:43:45.761Z|00189|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:45.761Z|00190|bridge|WARN|try dump port after del_ports 2022-09-28T03:43:45.761Z|00191|bridge|WARN|i 0 name Ethernet0 2 type nil 2022-09-28T03:43:45.761Z|00192|bridge|WARN|i 0 name antrea-tun0 type geneve 2022-09-28T03:43:45.761Z|00193|bridge|WARN|i 0 name iis-7dc4-a02d41 type nil 2022-09-28T03:43:45.761Z|00194|bridge|WARN|i 0 name antrea-gw0 type internal 2022-09-28T03:43:45.761Z|00195|bridge|WARN|i 0 name br-int type internal 2022-09-28T03:43:45.761Z|00196|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname Ethernet0 2 type system 2022-09-28T03:43:45.761Z|00197|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname antrea-gw0 type internal 2022-09-28T03:43:45.761Z|00198|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname br-int type internal 2022-09-28T03:43:45.761Z|00199|ofproto_dpif|INFO|Got devname antrea-tun0 type geneve to ofproto_port 2022-09-28T03:43:45.761Z|00200|bridge|WARN|before bridge_add_ports 2022-09-28T03:43:45.761Z|00201|bridge|WARN|Try iface_do_create for dev iis-7dc4-a02d41 2022-09-28T03:43:45.761Z|00202|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:45.761Z|00203|netdev|WARN|could not find netdev with name iis-7dc4-a02d41 of type system 2022-09-28T03:43:45.762Z|00204|netdev|WARN|netdev created failed iis-7dc4-a02d41 of type system 2022-09-28T03:43:45.762Z|00205|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:45.762Z|00206|bridge|WARN|Try open network device iis-7dc4-a02d41 with type system type1 system 2022-09-28T03:43:45.762Z|00207|bridge|WARN|1 could not open network device iis-7dc4-a02d41 (No such device) with type system 2022-09-28T03:43:45.785Z|00208|bridge|WARN|bridge br-int: br-int added as bridge port 2022-09-28T03:43:45.785Z|00209|bridge|WARN|bridge br-int: antrea-tun0 added as bridge port 2022-09-28T03:43:45.785Z|00210|bridge|WARN|bridge br-int: antrea-gw0 added as bridge port 2022-09-28T03:43:45.785Z|00211|bridge|WARN|bridge br-int: iis-7dc4-a02d41 added as bridge port 2022-09-28T03:43:45.785Z|00212|bridge|WARN|bridge br-int: Ethernet0 2 added as bridge port 2022-09-28T03:43:45.785Z|00213|bridge|WARN|bridge br-int: iis-7dc4-2ace73 added as bridge port 2022-09-28T03:43:45.785Z|00214|bridge|WARN|try dump port before del_ports 2022-09-28T03:43:45.785Z|00215|bridge|WARN|i 0 name Ethernet0 2 type nil 2022-09-28T03:43:45.785Z|00216|bridge|WARN|i 0 name antrea-tun0 type geneve 2022-09-28T03:43:45.785Z|00217|bridge|WARN|i 0 name iis-7dc4-2ace73 type nil 2022-09-28T03:43:45.785Z|00218|bridge|WARN|i 0 name iis-7dc4-a02d41 type nil 2022-09-28T03:43:45.785Z|00219|bridge|WARN|i 0 name antrea-gw0 type internal 2022-09-28T03:43:45.785Z|00220|bridge|WARN|i 0 name br-int type internal 2022-09-28T03:43:45.785Z|00221|bridge|WARN|iface_get_type interface name Ethernet0 2, type nil 2022-09-28T03:43:45.785Z|00222|bridge|WARN|iface_get_type interface name antrea-tun0, type geneve 2022-09-28T03:43:45.785Z|00223|bridge|WARN|iface_get_type interface name iis-7dc4-2ace73, type nil 2022-09-28T03:43:45.785Z|00224|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:45.785Z|00225|bridge|WARN|try dump port after del_ports 2022-09-28T03:43:45.785Z|00226|bridge|WARN|i 0 name Ethernet0 2 type nil 2022-09-28T03:43:45.785Z|00227|bridge|WARN|i 0 name antrea-tun0 type geneve 2022-09-28T03:43:45.785Z|00228|bridge|WARN|i 0 name iis-7dc4-2ace73 type nil 2022-09-28T03:43:45.785Z|00229|bridge|WARN|i 0 name iis-7dc4-a02d41 type nil 2022-09-28T03:43:45.785Z|00230|bridge|WARN|i 0 name antrea-gw0 type internal 2022-09-28T03:43:45.785Z|00231|bridge|WARN|i 0 name br-int type internal 2022-09-28T03:43:45.785Z|00232|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname Ethernet0 2 type system 2022-09-28T03:43:45.785Z|00233|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname antrea-gw0 type internal 2022-09-28T03:43:45.785Z|00234|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname br-int type internal 2022-09-28T03:43:45.785Z|00235|ofproto_dpif|INFO|Got devname antrea-tun0 type geneve to ofproto_port 2022-09-28T03:43:45.785Z|00236|bridge|WARN|before bridge_add_ports 2022-09-28T03:43:45.785Z|00237|bridge|WARN|Try iface_do_create for dev iis-7dc4-2ace73 2022-09-28T03:43:45.785Z|00238|bridge|WARN|iface_get_type interface name iis-7dc4-2ace73, type nil 2022-09-28T03:43:45.785Z|00239|netdev|WARN|could not find netdev with name iis-7dc4-2ace73 of type system 2022-09-28T03:43:45.785Z|00240|netdev|WARN|netdev created failed iis-7dc4-2ace73 of type system 2022-09-28T03:43:45.785Z|00241|bridge|WARN|iface_get_type interface name iis-7dc4-2ace73, type nil 2022-09-28T03:43:45.785Z|00242|bridge|WARN|Try open network device iis-7dc4-2ace73 with type system type1 system 2022-09-28T03:43:45.785Z|00243|bridge|WARN|1 could not open network device iis-7dc4-2ace73 (No such device) with type system 2022-09-28T03:43:45.785Z|00244|bridge|WARN|Try iface_do_create for dev iis-7dc4-a02d41 2022-09-28T03:43:45.785Z|00245|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:45.786Z|00246|netdev|WARN|could not find netdev with name iis-7dc4-a02d41 of type system 2022-09-28T03:43:45.786Z|00247|netdev|WARN|netdev created failed iis-7dc4-a02d41 of type system 2022-09-28T03:43:45.786Z|00248|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:45.786Z|00249|bridge|WARN|Try open network device iis-7dc4-a02d41 with type system type1 system 2022-09-28T03:43:45.786Z|00250|bridge|WARN|1 could not open network device iis-7dc4-a02d41 (No such device) with type system 2022-09-28T03:43:46.171Z|00251|dpif|WARN|Dropped 5 log messages in last 31 seconds (most recently, 31 seconds ago) due to excessive rate 2022-09-28T03:43:46.171Z|00252|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2022-09-28T03:43:46.260Z|00253|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2022-09-28T03:43:47.587Z|00254|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2022-09-28T03:43:47.592Z|00255|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2022-09-28T03:43:49.336Z|00256|bridge|WARN|bridge br-int: br-int added as bridge port 2022-09-28T03:43:49.336Z|00257|bridge|WARN|bridge br-int: antrea-tun0 added as bridge port 2022-09-28T03:43:49.336Z|00258|bridge|WARN|bridge br-int: antrea-gw0 added as bridge port 2022-09-28T03:43:49.336Z|00259|bridge|WARN|bridge br-int: iis-7dc4-a02d41 added as bridge port 2022-09-28T03:43:49.336Z|00260|bridge|WARN|bridge br-int: Ethernet0 2 added as bridge port 2022-09-28T03:43:49.336Z|00261|bridge|WARN|bridge br-int: iis-7dc4-2ace73 added as bridge port 2022-09-28T03:43:49.336Z|00262|bridge|WARN|try dump port before del_ports 2022-09-28T03:43:49.336Z|00263|bridge|WARN|i 0 name Ethernet0 2 type nil 2022-09-28T03:43:49.336Z|00264|bridge|WARN|i 0 name antrea-tun0 type geneve 2022-09-28T03:43:49.336Z|00265|bridge|WARN|i 0 name iis-7dc4-2ace73 type internal 2022-09-28T03:43:49.336Z|00266|bridge|WARN|i 0 name iis-7dc4-a02d41 type nil 2022-09-28T03:43:49.336Z|00267|bridge|WARN|i 0 name antrea-gw0 type internal 2022-09-28T03:43:49.336Z|00268|bridge|WARN|i 0 name br-int type internal 2022-09-28T03:43:49.336Z|00269|bridge|WARN|iface_get_type interface name Ethernet0 2, type nil 2022-09-28T03:43:49.336Z|00270|bridge|WARN|iface_get_type interface name antrea-tun0, type geneve 2022-09-28T03:43:49.336Z|00271|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:49.336Z|00272|bridge|WARN|try dump port after del_ports 2022-09-28T03:43:49.336Z|00273|bridge|WARN|i 0 name Ethernet0 2 type nil 2022-09-28T03:43:49.336Z|00274|bridge|WARN|i 0 name antrea-tun0 type geneve 2022-09-28T03:43:49.336Z|00275|bridge|WARN|i 0 name iis-7dc4-2ace73 type internal 2022-09-28T03:43:49.336Z|00276|bridge|WARN|i 0 name iis-7dc4-a02d41 type nil 2022-09-28T03:43:49.336Z|00277|bridge|WARN|i 0 name antrea-gw0 type internal 2022-09-28T03:43:49.336Z|00278|bridge|WARN|i 0 name br-int type internal 2022-09-28T03:43:49.336Z|00279|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname Ethernet0 2 type system 2022-09-28T03:43:49.336Z|00280|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname antrea-gw0 type internal 2022-09-28T03:43:49.336Z|00281|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname br-int type internal 2022-09-28T03:43:49.336Z|00282|ofproto_dpif|INFO|Got devname antrea-tun0 type geneve to ofproto_port 2022-09-28T03:43:49.336Z|00283|bridge|WARN|before bridge_add_ports 2022-09-28T03:43:49.336Z|00284|bridge|WARN|Try iface_do_create for dev iis-7dc4-2ace73 2022-09-28T03:43:49.336Z|00285|netdev|WARN|could not find netdev with name iis-7dc4-2ace73 of type internal 2022-09-28T03:43:49.336Z|00286|netdev|WARN|netdev created success iis-7dc4-2ace73 of type internal, netdev type internal netdev->auto_classified 0 2022-09-28T03:43:49.336Z|00287|bridge|WARN|Try open network device iis-7dc4-2ace73 with type internal type1 internal 2022-09-28T03:43:49.402Z|00288|wmi|WARN|Port with name: iis-7dc4-2ace73 already defined on the switch 2022-09-28T03:43:49.404Z|00289|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname iis-7dc4-2ace73 type internal 2022-09-28T03:43:49.404Z|00290|ofproto|WARN|ofproto_port->name iis-7dc4-2ace73 ofproto_port->type internal 2022-09-28T03:43:49.404Z|00291|netdev|WARN|netdev open after shash_find iis-7dc4-2ace73 of type internal, netdev type internal netdev->auto_classified 0 12:00 2022-09-28T03:43:49.404Z|00292|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname iis-7dc4-2ace73 type internal 2022-09-28T03:43:49.404Z|00293|bridge|INFO|bridge br-int: added interface iis-7dc4-2ace73 on port 4 2022-09-28T03:43:49.404Z|00294|bridge|WARN|Try iface_do_create for dev iis-7dc4-a02d41 2022-09-28T03:43:49.404Z|00295|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:49.404Z|00296|netdev|WARN|could not find netdev with name iis-7dc4-a02d41 of type system 2022-09-28T03:43:49.404Z|00297|netdev|WARN|netdev created success iis-7dc4-a02d41 of type system, netdev type system netdev->auto_classified 0 2022-09-28T03:43:49.404Z|00298|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:49.404Z|00299|bridge|WARN|Try open network device iis-7dc4-a02d41 with type system type1 system 2022-09-28T03:43:49.404Z|00300|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname iis-7dc4-a02d41 type internal 2022-09-28T03:43:49.404Z|00301|ofproto|WARN|ofproto_port->name iis-7dc4-a02d41 ofproto_port->type internal 2022-09-28T03:43:49.404Z|00302|netdev|WARN|netdev open after shash_find iis-7dc4-a02d41 of type internal, netdev type system netdev->auto_classified 0 2022-09-28T03:43:49.404Z|00303|netdev|WARN|netdev open return EEXIST error netdev iis-7dc4-a02d41 of type internal, netdev type system 2022-09-28T03:43:49.404Z|00304|ofproto|WARN|br-int: ignoring port iis-7dc4-a02d41 (65535) because netdev iis-7dc4-a02d41 cannot be opened (File exists) 2022-09-28T03:43:49.404Z|00305|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname iis-7dc4-a02d41 type internal 2022-09-28T03:43:49.404Z|00306|bridge|INFO|bridge br-int: added interface iis-7dc4-a02d41 on port 65535 2022-09-28T03:43:49.404Z|00307|bridge|WARN|iface_get_type interface name iis-7dc4-a02d41, type nil 2022-09-28T03:43:49.404Z|00308|ofproto|WARN|br-int: cannot configure bfd on nonexistent port 65535 2022-09-28T03:43:49.404Z|00309|ofproto|WARN|br-int: cannot configure LLDP on nonexistent port 65535 2022-09-28T03:43:49.404Z|00310|ofproto|WARN|br-int: cannot configure datapath on nonexistent port 65535 2022-09-28T03:43:49.405Z|00311|ofproto|WARN|br-int: cannot get STP status on nonexistent port 65535 2022-09-28T03:43:49.405Z|00312|ofproto|WARN|br-int: cannot get RSTP status on nonexistent port 65535 2022-09-28T03:43:49.405Z|00313|bridge|WARN|bridge br-int: br-int added as bridge port 2022-09-28T03:43:49.405Z|00314|bridge|WARN|bridge br-int: antrea-tun0 added as bridge port 2022-09-28T03:43:49.405Z|00315|bridge|WARN|bridge br-int: antrea-gw0 added as bridge port 2022-09-28T03:43:49.406Z|00316|bridge|WARN|bridge br-int: iis-7dc4-a02d41 added as bridge port 2022-09-28T03:43:49.406Z|00317|bridge|WARN|bridge br-int: Ethernet0 2 added as bridge port 2022-09-28T03:43:49.406Z|00318|bridge|WARN|bridge br-int: iis-7dc4-2ace73 added as bridge port 2022-09-28T03:43:49.406Z|00319|bridge|WARN|try dump port before del_ports 2022-09-28T03:43:49.406Z|00320|bridge|WARN|i 0 name Ethernet0 2 type nil 2022-09-28T03:43:49.406Z|00321|bridge|WARN|i 0 name antrea-tun0 type geneve 2022-09-28T03:43:49.406Z|00322|bridge|WARN|i 0 name iis-7dc4-2ace73 type internal 2022-09-28T03:43:49.406Z|00323|bridge|WARN|i 0 name iis-7dc4-a02d41 type internal 2022-09-28T03:43:49.406Z|00324|bridge|WARN|i 0 name antrea-gw0 type internal 2022-09-28T03:43:49.406Z|00325|bridge|WARN|i 0 name br-int type internal 2022-09-28T03:43:49.406Z|00326|bridge|WARN|iface_get_type interface name Ethernet0 2, type nil 2022-09-28T03:43:49.406Z|00327|bridge|WARN|iface_get_type interface name antrea-tun0, type geneve 2022-09-28T03:43:49.406Z|00328|bridge|WARN|try dump port after del_ports 2022-09-28T03:43:49.406Z|00329|bridge|WARN|i 0 name Ethernet0 2 type nil 2022-09-28T03:43:49.406Z|00330|bridge|WARN|i 0 name antrea-tun0 type geneve 2022-09-28T03:43:49.406Z|00331|bridge|WARN|i 0 name iis-7dc4-2ace73 type internal 2022-09-28T03:43:49.406Z|00332|bridge|WARN|i 0 name iis-7dc4-a02d41 type internal 2022-09-28T03:43:49.406Z|00333|bridge|WARN|i 0 name antrea-gw0 type internal 2022-09-28T03:43:49.406Z|00334|bridge|WARN|i 0 name br-int type internal 2022-09-28T03:43:49.406Z|00335|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname Ethernet0 2 type system 2022-09-28T03:43:49.406Z|00336|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname iis-7dc4-a02d41 type internal 2022-09-28T03:43:49.406Z|00337|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname iis-7dc4-2ace73 type internal 2022-09-28T03:43:49.406Z|00338|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname antrea-gw0 type internal 2022-09-28T03:43:49.406Z|00339|ofproto_dpif|INFO|After ofproto_port_from_dpif_port devname br-int type internal 2022-09-28T03:43:49.406Z|00340|ofproto_dpif|INFO|Got devname antrea-tun0 type geneve to ofproto_port 2022-09-28T03:43:49.406Z|00341|bridge|WARN|before bridge_add_ports 2022-09-28T03:43:49.406Z|00342|ofproto|WARN|br-int: cannot configure bfd on nonexistent port 65535 2022-09-28T03:43:49.406Z|00343|ofproto|WARN|br-int: cannot configure LLDP on nonexistent port 65535 2022-09-28T03:43:49.406Z|00344|ofproto|WARN|br-int: cannot configure datapath on nonexistent port 65535 2022-09-28T03:43:49.474Z|00345|ofproto|WARN|br-int: cannot get STP stats on nonexistent port 65535 2022-09-28T03:43:49.474Z|00346|ofproto|WARN|br-int: cannot get RSTP status on nonexistent port 65535 2022-09-28T03:43:49.827Z|00011|ofproto_dpif_upcall(handler3)|INFO|received packet on unassociated datapath port 6 2022-09-28T03:43:49.827Z|00012|ofproto_dpif_upcall(handler3)|INFO|received packet on unassociated datapath port 6 2022-09-28T03:43:50.823Z|00013|ofproto_dpif_upcall(handler3)|INFO|received packet on unassociated datapath port 6 2022-09-28T03:43:50.823Z|00014|ofproto_dpif_upcall(handler3)|INFO|received packet on unassociated datapath port 6 2022-09-28T03:43:50.826Z|00015|ofproto_dpif_upcall(handler3)|INFO|received packet on unassociated datapath port 6

twofish197 commented 1 year ago

port_allocating_failure_debug.diff.txt

twofish197 commented 1 year ago

Attach the debug diff and we could check the issues with the debug diff file.