FRRouting / frr

The FRRouting Protocol Suite
https://frrouting.org/
Other
3.33k stars 1.25k forks source link

fail to establish neighbors #5863

Closed magnate3 closed 4 years ago

magnate3 commented 4 years ago

In my test, the spine fail to establish neighbors with two leaves:

spine : 10.10.18.195/24 leaf1: 10.10.16.82/24 leaf2: 10.10.16.81/24 all of they can ping with each other

  1. my os is as following:

    [root@host-10-10-18-195 ~]# cat /etc/os-release NAME="CentOS Linux" VERSION="7 (AltArch)" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="7" PRETTY_NAME="CentOS Linux 7 (AltArch)" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:7" HOME_URL="https://www.centos.org/" BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7" CENTOS_MANTISBT_PROJECT_VERSION="7" REDHAT_SUPPORT_PRODUCT="centos" REDHAT_SUPPORT_PRODUCT_VERSION="7"

router bgp 195 bgp router-id 10.10.18.195 bgp bestpath as-path multipath-relax neighbor fabric peer-group neighbor fabric update-source 10.10.18.195 neighbor fabric remote-as external neighbor 10.10.16.81 peer-group fabric neighbor 10.10.16.82 peer-group fabric neighbor 10.10.16.81 ebgp-multihop neighbor 10.10.16.82 ebgp-multihop ! address-family ipv4 unicast neighbor fabric activate exit-address-family ! address-family l2vpn evpn neighbor fabric activate exit-address-family

  1. the leaf1's conf is :

router bgp 82 bgp router-id 10.10.16.82 bgp bestpath as-path multipath-relax neighbor fabric peer-group neighbor fabric remote-as external neighbor fabric update-source 10.10.16.82 neighbor 10.10.18.195 peer-group fabric neighbor 10.10.18.195 ebgp-multihop ! address-family ipv4 unicast neighbor fabric activate exit-address-family ! address-family l2vpn evpn neighbor fabric activate advertise-all-vni exit-address-family ! the leaf2's conf is : router bgp 81 bgp router-id 10.10.16.81 bgp bestpath as-path multipath-relax neighbor fabric peer-group neighbor fabric remote-as external neighbor fabric update-source 10.10.16.81 neighbor 10.10.18.195 peer-group fabric neighbor 10.10.18.195 ebgp-multihop ! address-family ipv4 unicast neighbor fabric activate exit-address-family ! address-family l2vpn evpn neighbor fabric activate advertise-all-vni exit-address-family

Spantik commented 4 years ago

Could you please enable logs below and share the logs file? debug bgp neighbor-events debug bgp keepalives debug bgp zebra debug bgp update-groups debug bgp updates

magnate3 commented 4 years ago

after enable logs and the log is : 2020/02/25 13:31:11 BGP: [EC 100663299] buffer_flush_available: write error on fd 2: Bad file descriptor 2020/02/25 13:31:11 ZEBRA: client 33 says hello and bids fair to announce only ospf routes vrf=0 2020/02/25 13:31:11 ZEBRA: client 38 says hello and bids fair to announce only static routes vrf=0 2020/02/25 13:31:13 BGP: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from 10.10.16.82 in vrf default 2020/02/25 13:31:13 BGP: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from 10.10.16.82 in vrf default 2020/02/25 13:33:42 BGP: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from 10.10.16.82 in vrf default 2020/02/25 13:33:42 BGP: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from 10.10.16.82 in vrf default 2020/02/25 13:33:51 STATIC: Terminating on signal 2020/02/25 13:33:51 OSPF: Terminating on signal 2020/02/25 13:33:51 BGP: Terminating on signal 2020/02/25 13:33:51 ZEBRA: Terminating on signal 2020/02/25 13:33:51 ZEBRA: [EC 4043309121] Client 'static' encountered an error and is shutting down. 2020/02/25 13:33:51 ZEBRA: [EC 4043309121] Client 'ospf' encountered an error and is shutting down. 2020/02/25 13:33:51 ZEBRA: release_daemon_table_chunks: Released 0 table chunks 2020/02/25 13:33:51 ZEBRA: zebra/zebra_ptm.c:1345 failed to find process pid registration 2020/02/25 13:33:51 ZEBRA: client 15 disconnected. 0 bgp routes removed from the rib 2020/02/25 13:33:51 ZEBRA: release_daemon_table_chunks: Released 0 table chunks 2020/02/25 13:33:51 ZEBRA: client 26 disconnected. 0 vnc routes removed from the rib 2020/02/25 13:33:51 ZEBRA: release_daemon_table_chunks: Released 0 table chunks 2020/02/25 13:33:51 ZEBRA: client 33 disconnected. 0 ospf routes removed from the rib 2020/02/25 13:33:51 ZEBRA: release_daemon_table_chunks: Released 0 table chunks 2020/02/25 13:33:51 ZEBRA: client 38 disconnected. 0 static routes removed from the rib 2020/02/25 13:33:51 ZEBRA: Zebra final shutdown 2020/02/25 13:33:52 ZEBRA: client 15 says hello and bids fair to announce only bgp routes vrf=0 2020/02/25 13:33:52 ZEBRA: client 28 says hello and bids fair to announce only vnc routes vrf=0 2020/02/25 13:33:52 BGP: [EC 100663299] buffer_flush_available: write error on fd 2: Bad file descriptor 2020/02/25 13:33:52 BGP: [EC 100663304] ERROR: Command returned Warning Config Failed on config line 21: neighbor fabric activate 2020/02/25 13:33:52 BGP: [EC 100663299] buffer_flush_available: write error on fd 2: Bad file descriptor 2020/02/25 13:33:52 ZEBRA: client 33 says hello and bids fair to announce only ospf routes vrf=0 2020/02/25 13:33:52 ZEBRA: client 38 says hello and bids fair to announce only static routes vrf=0 2020/02/25 13:33:54 BGP: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from 10.10.16.82 in vrf default 2020/02/25 13:33:54 BGP: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from 10.10.16.82 in vrf default 2020/02/25 15:44:53 BGP: 10.10.16.82 KEEPALIVE rcvd 2020/02/25 15:44:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire) 2020/02/25 15:44:53 BGP: 10.10.16.82 sending KEEPALIVE 2020/02/25 15:45:53 BGP: 10.10.16.82 KEEPALIVE rcvd 2020/02/25 15:45:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire) 2020/02/25 15:45:53 BGP: 10.10.16.82 sending KEEPALIVE 2020/02/25 15:46:53 BGP: 10.10.16.82 KEEPALIVE rcvd 2020/02/25 15:46:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire) 2020/02/25 15:46:53 BGP: 10.10.16.82 sending KEEPALIVE 2020/02/25 15:46:53 STATIC: Terminating on signal 2020/02/25 15:46:53 OSPF: Terminating on signal 2020/02/25 15:46:53 BGP: Terminating on signal 2020/02/25 15:46:53 BGP: %NOTIFICATION: sent to neighbor 10.10.16.82 6/3 (Cease/Peer Unconfigured) 0 bytes 2020/02/25 15:46:53 BGP: Deleting Default VRF 2020/02/25 15:46:53 BGP: %NOTIFICATION: sent to neighbor 10.10.16.82 6/2 (Cease/Administratively Shutdown) 0 bytes 2020/02/25 15:46:53 BGP: 10.10.16.82 remove from all update group 2020/02/25 15:46:53 BGP: peer 10.10.16.82 deleted from subgroup s1 peer cnt 0 2020/02/25 15:46:53 ZEBRA: [EC 4043309121] Client 'static' encountered an error and is shutting down. 2020/02/25 15:46:53 BGP: delete subgroup u1:s1 2020/02/25 15:46:53 BGP: delete update group 1 2020/02/25 15:46:53 BGP: peer 10.10.16.82 deleted from subgroup s2 peer cnt 0 2020/02/25 15:46:53 BGP: delete subgroup u2:s2 2020/02/25 15:46:53 BGP: delete update group 2 2020/02/25 15:46:53 BGP: bgp_fsm_change_status : vrf default(0), Status: Deleted established_peers 0 2020/02/25 15:46:53 BGP: 10.10.16.82 went from Established to Deleted 2020/02/25 15:46:53 BGP: sendmsg_zebra_rnh: sending cmd ZEBRA_NEXTHOP_UNREGISTER for 10.10.16.82/32 (vrf VRF default) 2020/02/25 15:46:53 BGP: bgp_fsm_change_status : vrf default(0), Status: Deleted established_peers 0 2020/02/25 15:46:53 BGP: Static announcement went from Idle to Deleted 2020/02/25 15:46:53 ZEBRA: release_daemon_table_chunks: Released 0 table chunks 2020/02/25 15:46:53 BGP: bgp_delete: deregistering this bgp (null) instance from zebra 2020/02/25 15:46:53 BGP: Deregistering VRF 0 2020/02/25 15:46:53 ZEBRA: client 38 disconnected. 0 static routes removed from the rib 2020/02/25 15:46:53 ZEBRA: Terminating on signal 2020/02/25 15:46:53 ZEBRA: [EC 4043309121] Client 'ospf' encountered an error and is shutting down. 2020/02/25 15:46:53 ZEBRA: release_daemon_table_chunks: Released 0 table chunks 2020/02/25 15:46:53 ZEBRA: zebra/zebra_ptm.c:1345 failed to find process pid registration 2020/02/25 15:46:53 ZEBRA: client 15 disconnected. 0 bgp routes removed from the rib 2020/02/25 15:46:53 BGP: VRF Deletion: default(0) 2020/02/25 15:46:53 ZEBRA: release_daemon_table_chunks: Released 0 table chunks 2020/02/25 15:46:53 ZEBRA: client 28 disconnected. 0 vnc routes removed from the rib 2020/02/25 15:46:53 ZEBRA: release_daemon_table_chunks: Released 0 table chunks 2020/02/25 15:46:53 ZEBRA: client 33 disconnected. 0 ospf routes removed from the rib 2020/02/25 15:46:53 ZEBRA: Zebra final shutdown 2020/02/25 15:46:53 ZEBRA: client 15 says hello and bids fair to announce only bgp routes vrf=0 2020/02/25 15:46:53 ZEBRA: client 28 says hello and bids fair to announce only vnc routes vrf=0 2020/02/25 15:46:53 ZEBRA: client 33 says hello and bids fair to announce only ospf routes vrf=0 2020/02/25 15:46:53 ZEBRA: client 38 says hello and bids fair to announce only static routes vrf=0

Spantik commented 4 years ago

It looks like you BGP session with leaf is trying to come up, at least I can see that they are exchanging keepalive (Openconfim and established state) and then there seems to be terminating signal being sent.

2020/02/25 15:44:53 BGP: 10.10.16.82 KEEPALIVE rcvd 2020/02/25 15:44:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire) 2020/02/25 15:44:53 BGP: 10.10.16.82 sending KEEPALIVE 2020/02/25 15:45:53 BGP: 10.10.16.82 KEEPALIVE rcvd 2020/02/25 15:45:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire) 2020/02/25 15:45:53 BGP: 10.10.16.82 sending KEEPALIVE 2020/02/25 15:46:53 BGP: 10.10.16.82 KEEPALIVE rcvd 2020/02/25 15:46:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire) 2020/02/25 15:46:53 BGP: 10.10.16.82 sending KEEPALIVE 2020/02/25 15:46:53 STATIC: Terminating on signal 2020/02/25 15:46:53 OSPF: Terminating on signal 2020/02/25 15:46:53 BGP: Terminating on signal

Could you please let me know what are the triggers here? Why are all clients are being terminated?

qlyoung commented 4 years ago

What does this show:

journalctl -xeu frr.service

All the daemons are being terminated, so systemd is killing them, which usually means watchfrr isn't getting liveness pings from daemons. Journalctl should have some more info about what's going on.

magnate3 commented 4 years ago

the log shows : zebra state -> dow、bgpd state -> down、ospfd state -> down、 staticd state -> down。 however,

[root@localhost ~]# systemctl status frr ● frr.service - FRRouting Loaded: loaded (/usr/lib/systemd/system/frr.service; enabled; vendor preset: disabled) Active: active (running) since Tue 2020-02-25 15:46:53 CST; 17h ago Docs: https://frrouting.readthedocs.io/en/latest/setup.html Process: 34114 ExecStop=/usr/lib/frr/frrinit.sh stop (code=exited, status=0/SUCCESS) Process: 34139 ExecStart=/usr/lib/frr/frrinit.sh start (code=exited, status=0/SUCCESS)

[root@localhost ~]# netstat -tapnl|grep ':26' tcp 0 0 127.0.0.1:2604 0.0.0.0: LISTEN 34175/ospfd
tcp 0 0 127.0.0.1:2605 0.0.0.0:
LISTEN 34168/bgpd
tcp 0 0 127.0.0.1:2616 0.0.0.0: LISTEN 34178/staticd
tcp 0 0 127.0.0.1:2601 0.0.0.0:
LISTEN 34163/zebra

journalctl -xeu frr.service

533 -- Unit frr.service has begun starting up. 534 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: watchfrr 7.3-MyOwnFRRVersion starting: vty@0 535 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 268435457] zebra state -> down : initial connection attempt failed 536 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 268435457] bgpd state -> down : initial connection attempt failed 537 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 268435457] ospfd state -> down : initial connection attempt failed 538 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 268435457] staticd state -> down : initial connection attempt failed 539 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 100663303] Forked background command [pid 34146]: / usr/lib/frr/watchfrr.sh restart all 540 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: zebra state -> up : connect succeeded 541 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: bgpd state -> up : connect succeeded 542 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: ospfd state -> up : connect succeeded 543 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: staticd state -> up : connect succeeded 544 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: all daemons up, doing startup-complete notify 545 Feb 25 15:46:53 localhost.localdomain frrinit.sh[34139]: Started watchfrr 546 Feb 25 15:46:53 localhost.localdomain systemd[1]: Started FRRouting.

penguin02007 commented 4 years ago

I believe I am having similar issue with frr 7.3.1 with bgp evpn.

frr is fine after I commented out l2vpn section, if not it got a stack trace.

#vrf tenant3
# vni 404003
#vrf tenant2
# vni 404002
#vrf tenant1
# vni 404001
!
interface eth1
 ipv6 nd ra-interval 10
 no ipv6 nd suppress-ra
interface eth2
 ipv6 nd ra-interval 10
 no ipv6 nd suppress-ra

router bgp 65503
 bgp router-id 10.250.250.3
 bgp bestpath as-path multipath-relax
 neighbor FABRIC peer-group
 neighbor FABRIC remote-as external
 neighbor FABRIC timers 1 3
 neighbor eth1 interface peer-group FABRIC
 neighbor eth2 interface peer-group FABRIC
 !
 address-family ipv4 unicast
  redistribute connected route-map loopbacks
 exit-address-family
 !
# address-family l2vpn evpn
#   neighbor FABRIC activate
#   advertise-all-vni
#   advertise ipv4 unicast
#   advertise ipv6 unicast
# exit-address-family
!
route-map loopbacks permit 10
 match interface lo
!
line vty
!
Mar 22 06:47:08 server03 bgpd[6689]: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from eth1 in vrf default
Mar 22 06:47:08 server03 bgpd[6689]: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from eth1 in vrf default
Mar 22 06:47:08 server03 bgpd[6689]: Received signal 11 at 1584859628 (si_addr 0x0, PC 0x55b9c26240d9); aborting...
Mar 22 06:47:08 server03 bgpd[6689]: Backtrace for 12 stack frames:
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(zlog_backtrace_sigsafe+0x60) [0x7ff5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(zlog_signal+0x10c) [0x7ff5b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(+0x6c774) [0x7ff5b44aa774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890) [0x7ff5b3a80890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(bgp_zebra_announce+0x619) [0x55b9c26240d9]890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(+0x7b9d6) [0x55b9c25df9d6][0x55b9c26240d9]890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(work_queue_run+0xd6) [0x7ff5b44c15a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(thread_call+0x56) [0x7ff5b44b7f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(frr_run+0xd8) [0x7ff5b4487dd8]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(main+0x324) [0x55b9c259ca74]run+0xd8) [0x7ff5b4487dd8]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7ff5b369eb97]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(_start+0x2a) [0x55b9c259eb8a]in+0xe7) [0x7ff5b369eb97]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: in thread work_queue_run scheduled from lib/workqueue.c:140
                                     9c26240d9); aborting...
Mar 22 06:47:08 server03 watchfrr[6594]: [EC 268435457] bgpd state -> down : read returned EOF
Mar 22 06:47:08 server03 zebra[6614]: [EC 4043309121] Client 'vnc' encountered an error and is shutting down.
Mar 22 06:47:08 server03 zebra[6614]: client 26 disconnected. 0 vnc routes removed from the rib
Mar 22 06:47:08 server03 zebra[6614]: [EC 4043309121] Client 'bgp' encountered an error and is shutting down.
Mar 22 06:47:08 server03 zebra[6614]: zebra/zebra_ptm.c:1345 failed to find process pid registration
Mar 22 06:47:08 server03 zebra[6614]: client 15 disconnected. 14 bgp routes removed from the rib
magnate3 commented 4 years ago

do you have ways to solve the prolblems

RobertB93 commented 4 years ago

I believe I am having similar issue with frr 7.3.1 with bgp evpn.

frr is fine after I commented out l2vpn section, if not it got a stack trace.

Yeah, it's currently the same for me, i can confirm.

penguin02007 commented 4 years ago

@RobertB93 can you share your frr.conf and interfaces file?

RobertB93 commented 4 years ago

@RobertB93 can you share your frr.conf and interfaces file?

Of course, here we go:

frr version 7.3
frr defaults traditional
hostname prox1
log syslog informational
no ip forwarding
no ipv6 forwarding
service integrated-vtysh-config
!
router-id 10.50.12.1
!
router bgp 4200001011
 no bgp default ipv4-unicast
 coalesce-time 1000
 neighbor EVPN peer-group
 neighbor EVPN remote-as 65001
 neighbor EVPN ebgp-multihop 5
 neighbor EVPN update-source lo
 neighbor UNDERLAY peer-group
 neighbor UNDERLAY remote-as 65001
 neighbor 10.50.10.3 peer-group EVPN
 neighbor 10.50.10.4 peer-group EVPN
 neighbor 10.50.31.8 peer-group UNDERLAY
 neighbor 10.50.31.10 peer-group UNDERLAY
 !
 address-family ipv4 unicast
  redistribute connected
  neighbor UNDERLAY activate
 exit-address-family
 !
 address-family l2vpn evpn
  neighbor EVPN activate
  vni 123
   route-target import 101:1
   route-target export 101:1
  exit-vni
  advertise-all-vni
 exit-address-family
!
line vty
!
auto lo
iface lo inet loopback
    address 10.50.12.1/32
    address 10.50.4.1/32

auto eno1
iface eno1 inet
    mtu 9214

auto eno2
iface eno2 inet
    mtu 9214

auto vmbr0
iface vmbr0
    mtu 9214
        bridge-ports eno1
        bridge-stp off
        bridge-pvid 1
        bridge-vids 1-4094
        bridge-vlan-aware yes

auto vmbr0.200
iface vmbr0.200
    mtu 1500
        address x.x.x.x/y
        gateway x.x.x.x

auto vmbr0.51
iface vmbr0.51
    mtu 9214
    address 10.50.31.9/31
    address 10.50.31.11/31

auto vni123
iface vni123
        vxlan-id 123
        vxlan-local-tunnelip 10.50.4.1
        bridge-learning off
        bridge-arp-nd-suppress on
        bridge-unicast-flood off
        bridge-multicast-flood off

auto vmbr123
iface vmbr123
        bridge-ports vni123
        bridge-stp off
        bridge-fd 0

As an additional note: using frr 7.2.1 seems to be stable and is not crashing

Spantik commented 4 years ago

initial connection attempt failed

Sorry for delay. It seems that FRR service has no issue here as frr service is starting.

541 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: bgpd state -> up : connect succeeded 542 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: ospfd state -> up : connect succeeded 543 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: staticd state -> up : connect succeeded 544 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: all daemons up, doing startup-complete notify 545 Feb 25 15:46:53 localhost.localdomain frrinit.sh[34139]: Started watchfrr 546 Feb 25 15:46:53 localhost.localdomain systemd[1]: Started FRRouting.

Spantik commented 4 years ago

Mar 22 06:47:08 server03 bgpd[6689]: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from eth1 in vrf default Mar 22 06:47:08 server03 bgpd[6689]: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from eth1 in vrf default Mar 22 06:47:08 server03 bgpd[6689]: Received signal 11 at 1584859628 (si_addr 0x0, PC 0x55b9c26240d9); aborting... Mar 22 06:47:08 server03 bgpd[6689]: Backtrace for 12 stack frames: Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(zlog_backtrace_sigsafe+0x60) [0x7ff5b4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(zlog_signal+0x10c) [0x7ff5b4489fbc]5b4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(+0x6c774) [0x7ff5b44aa774]b4489fbc]5b4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890) [0x7ff5b3a80890]774]b4489fbc]5b4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(bgp_zebra_announce+0x619) [0x55b9c26240d9]890]774]b4489fbc]5b4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(+0x7b9d6) [0x55b9c25df9d6][0x55b9c26240d9]890]774]b4489fbc]5b4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(work_queue_run+0xd6) [0x7ff5b44c15a6]4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(thread_call+0x56) [0x7ff5b44b7f86]a6]4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(frr_run+0xd8) [0x7ff5b4487dd8]f86]a6]4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(main+0x324) [0x55b9c259ca74]run+0xd8) [0x7ff5b4487dd8]f86]a6]4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7ff5b369eb97]f86]a6]4489b60] Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(_start+0x2a) [0x55b9c259eb8a]in+0xe7) [0x7ff5b369eb97]f86]a6]4489b60] Mar 22 06:47:08 server03 bgpd[6689]: in thread work_queue_run scheduled from lib/workqueue.c:140

Can you please help with core if you have? With L2VPN config BGP does keeps coring? Is there any specific config with in L2VPN which you think is offending?

Spantik commented 4 years ago

@polychaeta autoclose in one week.