`make check` fails though following `building-frr-for-ubuntu1804` and `building-libyang`

[kwatsen]

Fresh install of Unbuntu 18.0.2. Following installation instructions provided by building-frr-for-ubuntu1804.rst and building-libyang.rst.

BTW, shouldn't building-libyang.rst be folded into the the platform-specific build instructions now that YANG is required?

The only deviation was in not passing the last two configure parameters:

    --with-pkg-git-version \
    --with-pkg-extra-version=-MyOwnFRRVersion

Command history:

$ history
   23  git clone https://github.com/FRRouting/frr.git
   24  cd frr/
   25  ./bootstrap.sh 
   26  uname -a
   27  sudo apt-get install    git autoconf automake libtool make gawk libreadline-dev texinfo    pkg-config libpam0g-dev libjson-c-dev bison flex python-pytest    libc-ares-dev python3-dev libsystemd-dev python-ipaddress    python3-sphinx install-info build-essential libsystemd-dev
   28  sudo apt-get install     protobuf-c-compiler     libprotobuf-c-dev
   29  sudo apt-get install     libzmq5     libzmq3-dev
   30  sudo groupadd -r -g 92 frr
   31  sudo groupadd -r -g 85 frrvty
   32  sudo adduser --system --ingroup frr --home /var/run/frr/    --gecos "FRR suite" --shell /sbin/nologin frr
   33  sudo usermod -a -G frrvty frr
   34  man apt-get
   35  apt list --installed | grep yang
   36  apt list --installed
   37  apt list --installed | grep lib
   38  find ./ -name "libyang"
   39  find ./ -name "libyang*"
   40  find ./ -name "*libyang*"
   41  wget https://ci1.netdef.org/artifact/LIBYANG-YANGRELEASE/shared/build-1/Ubuntu-18.04-x86_64-Packages/libyang-dev_0.16.46_amd64.deb
   42  wget https://ci1.netdef.org/artifact/LIBYANG-YANGRELEASE/shared/build-1/Ubuntu-18.04-x86_64-Packages/libyang_0.16.46_amd64.deb
   43  sudo apt install libpcre3-dev
   44  sudo dpkg -i libyang-dev_0.16.46_amd64.deb libyang_0.16.46_amd64.deb
   45  ./configure     --prefix=/usr     --enable-exampledir=/usr/share/doc/frr/examples/     --localstatedir=/var/run/frr     --sbindir=/usr/lib/frr     --sysconfdir=/etc/frr     --enable-multipath=64     --enable-user=frr     --enable-group=frr     --enable-vty-group=frrvty     --enable-configfile-mask=0640     --enable-logfile-mask=0640     --enable-fpm     --enable-systemd=yes

The make check summary:

=============== 191 failed, 213 passed, 1 skipped in 12.38 seconds ================

The report (detailed failures attached):

=============================== test session starts ===============================
platform linux2 -- Python 2.7.15rc1, pytest-3.3.2, py-1.5.2, pluggy-0.6.0 -- /usr/bin/python
cachedir: .cache
rootdir: /home/kent/frr/tests, inifile: pytest.ini
collected 405 items                                                               

bgpd/test_aspath.py::TestAspath::test_seq1extra <- helpers/python/frrtest.py PASSED [  0%]
bgpd/test_aspath.py::TestAspath::test_4b_AS_PATH_too_long <- helpers/python/frrtest.py PASSED [  0%]
bgpd/test_aspath.py::TestAspath::test_basic_test <- helpers/python/frrtest.py PASSED [  0%]
bgpd/test_aspath.py::TestAspath::test_confed2 <- helpers/python/frrtest.py PASSED [  0%]
bgpd/test_aspath.py::TestAspath::test_4b_AS_PATH_too_short <- helpers/python/frrtest.py PASSED [  1%]
bgpd/test_aspath.py::TestAspath::test_seqset2 <- helpers/python/frrtest.py PASSED [  1%]
bgpd/test_aspath.py::TestAspath::test_exit_cleanly <- helpers/python/frrtest.py PASSED [  1%]
bgpd/test_aspath.py::TestAspath::test_length_too_long <- helpers/python/frrtest.py PASSED [  1%]
bgpd/test_aspath.py::TestAspath::test_basic_4_byte_as_path <- helpers/python/frrtest.py PASSED [  2%]
bgpd/test_aspath.py::TestAspath::test_long <- helpers/python/frrtest.py PASSED [  2%]
bgpd/test_aspath.py::TestAspath::test_tripleseq1 <- helpers/python/frrtest.py PASSED [  2%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_3 <- helpers/python/frrtest.py PASSED [  2%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_2 <- helpers/python/frrtest.py PASSED [  3%]
bgpd/test_aspath.py::TestAspath::test_reconcile_confed <- helpers/python/frrtest.py PASSED [  3%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_6 <- helpers/python/frrtest.py PASSED [  3%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_5 <- helpers/python/frrtest.py PASSED [  3%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_4 <- helpers/python/frrtest.py PASSED [  4%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_9 <- helpers/python/frrtest.py PASSED [  4%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_8 <- helpers/python/frrtest.py PASSED [  4%]
bgpd/test_aspath.py::TestAspath::test_confset <- helpers/python/frrtest.py PASSED [  4%]
bgpd/test_aspath.py::TestAspath::test_zero_size_overflow <- helpers/python/frrtest.py PASSED [  5%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_17 <- helpers/python/frrtest.py PASSED [  5%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_16 <- helpers/python/frrtest.py PASSED [  5%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_15 <- helpers/python/frrtest.py PASSED [  5%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_14 <- helpers/python/frrtest.py PASSED [  6%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_13 <- helpers/python/frrtest.py PASSED [  6%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_12 <- helpers/python/frrtest.py PASSED [  6%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_11 <- helpers/python/frrtest.py PASSED [  6%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_10 <- helpers/python/frrtest.py PASSED [  7%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_19 <- helpers/python/frrtest.py PASSED [  7%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_18 <- helpers/python/frrtest.py PASSED [  7%]
bgpd/test_aspath.py::TestAspath::test_reconcile_start_trans_error <- helpers/python/frrtest.py PASSED [  7%]
bgpd/test_aspath.py::TestAspath::test_invalid_segment_type <- helpers/python/frrtest.py PASSED [  8%]
bgpd/test_aspath.py::TestAspath::test_4b_AS_PATH_bad_flags <- helpers/python/frrtest.py PASSED [  8%]
bgpd/test_aspath.py::TestAspath::test_multi <- helpers/python/frrtest.py PASSED [  8%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_7 <- helpers/python/frrtest.py PASSED [  8%]
bgpd/test_aspath.py::TestAspath::test_aggregate_test_4 <- helpers/python/frrtest.py PASSED [  9%]
bgpd/test_aspath.py::TestAspath::test_aggregate_test_3 <- helpers/python/frrtest.py PASSED [  9%]
bgpd/test_aspath.py::TestAspath::test_aggregate_test_2 <- helpers/python/frrtest.py PASSED [  9%]
bgpd/test_aspath.py::TestAspath::test_aggregate_test_1 <- helpers/python/frrtest.py PASSED [  9%]
bgpd/test_aspath.py::TestAspath::test_aggregate_test_0 <- helpers/python/frrtest.py PASSED [ 10%]
bgpd/test_aspath.py::TestAspath::test_seq1 <- helpers/python/frrtest.py PASSED [ 10%]
bgpd/test_aspath.py::TestAspath::test_seq3 <- helpers/python/frrtest.py PASSED [ 10%]
bgpd/test_aspath.py::TestAspath::test_seq2 <- helpers/python/frrtest.py PASSED [ 10%]
bgpd/test_aspath.py::TestAspath::test_seq4 <- helpers/python/frrtest.py PASSED [ 11%]
bgpd/test_aspath.py::TestAspath::test_reconcile_start_trans <- helpers/python/frrtest.py PASSED [ 11%]
bgpd/test_aspath.py::TestAspath::test_incorrect_flag <- helpers/python/frrtest.py PASSED [ 11%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_22 <- helpers/python/frrtest.py PASSED [ 11%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_20 <- helpers/python/frrtest.py PASSED [ 12%]
bgpd/test_aspath.py::TestAspath::test_left_cmp_21 <- helpers/python/frrtest.py PASSED [ 12%]
bgpd/test_aspath.py::TestAspath::test_as4_path_with_as2_format_data <- helpers/python/frrtest.py PASSED [ 12%]
bgpd/test_aspath.py::TestAspath::test_reconcile_start_trans4 <- helpers/python/frrtest.py PASSED [ 12%]
bgpd/test_aspath.py::TestAspath::test_4b_AS4_PATH_confed <- helpers/python/frrtest.py PASSED [ 13%]
bgpd/test_aspath.py::TestAspath::test_as4_with_incorrect_attr_length <- helpers/python/frrtest.py PASSED [ 13%]
bgpd/test_aspath.py::TestAspath::test_reconcile_new_asp <- helpers/python/frrtest.py PASSED [ 13%]
bgpd/test_aspath.py::TestAspath::test_reconcile_test_0 <- helpers/python/frrtest.py PASSED [ 13%]
bgpd/test_aspath.py::TestAspath::test_reconcile_test_1 <- helpers/python/frrtest.py PASSED [ 14%]
bgpd/test_aspath.py::TestAspath::test_reconcile_test_2 <- helpers/python/frrtest.py PASSED [ 14%]
bgpd/test_aspath.py::TestAspath::test_reconcile_test_3 <- helpers/python/frrtest.py PASSED [ 14%]
bgpd/test_aspath.py::TestAspath::test_reconcile_test_4 <- helpers/python/frrtest.py PASSED [ 14%]
bgpd/test_aspath.py::TestAspath::test_someprivate <- helpers/python/frrtest.py PASSED [ 15%]
bgpd/test_aspath.py::TestAspath::test_length_too_short <- helpers/python/frrtest.py PASSED [ 15%]
bgpd/test_aspath.py::TestAspath::test_reconcile_lead_asp <- helpers/python/frrtest.py PASSED [ 15%]
bgpd/test_aspath.py::TestAspath::test_seqset <- helpers/python/frrtest.py PASSED [ 15%]
bgpd/test_aspath.py::TestAspath::test_confed <- helpers/python/frrtest.py PASSED [ 16%]
bgpd/test_aspath.py::TestAspath::test_redundantset2 <- helpers/python/frrtest.py PASSED [ 16%]
bgpd/test_aspath.py::TestAspath::test_zero_size_overflow_valid_segment <- helpers/python/frrtest.py PASSED [ 16%]
bgpd/test_aspath.py::TestAspath::test_confmulti <- helpers/python/frrtest.py PASSED [ 16%]
bgpd/test_aspath.py::TestAspath::test_redundantset <- helpers/python/frrtest.py PASSED [ 17%]
bgpd/test_aspath.py::TestAspath::test_left_cmp <- helpers/python/frrtest.py PASSED [ 17%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_8 <- helpers/python/frrtest.py PASSED [ 17%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_9 <- helpers/python/frrtest.py PASSED [ 17%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_6 <- helpers/python/frrtest.py PASSED [ 18%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_7 <- helpers/python/frrtest.py PASSED [ 18%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_4 <- helpers/python/frrtest.py PASSED [ 18%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_5 <- helpers/python/frrtest.py PASSED [ 18%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_2 <- helpers/python/frrtest.py PASSED [ 19%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_3 <- helpers/python/frrtest.py PASSED [ 19%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_0 <- helpers/python/frrtest.py PASSED [ 19%]
bgpd/test_aspath.py::TestAspath::test_prepend_test_1 <- helpers/python/frrtest.py PASSED [ 19%]
bgpd/test_aspath.py::TestAspath::test_4b_AS4_PATH_w_o_AS_PATH <- helpers/python/frrtest.py PASSED [ 20%]
bgpd/test_aspath.py::TestAspath::test_empty_get_test <- helpers/python/frrtest.py PASSED [ 20%]
bgpd/test_aspath.py::TestAspath::test_allprivate <- helpers/python/frrtest.py PASSED [ 20%]
bgpd/test_aspath.py::TestAspath::test_4b_AS_PATH_too_long2 <- helpers/python/frrtest.py PASSED [ 20%]
bgpd/test_aspath.py::TestAspath::test_empty <- helpers/python/frrtest.py PASSED [ 20%]
bgpd/test_bgp_table.py::TestTable::test_Checks_successfull_2 <- helpers/python/frrtest.py PASSED [ 21%]
bgpd/test_bgp_table.py::TestTable::test_Checks_successfull_6 <- helpers/python/frrtest.py PASSED [ 21%]
bgpd/test_bgp_table.py::TestTable::test_Checks_successfull <- helpers/python/frrtest.py PASSED [ 21%]
bgpd/test_bgp_table.py::TestTable::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 21%]
bgpd/test_bgp_table.py::TestTable::test_Checks_successfull_5 <- helpers/python/frrtest.py PASSED [ 22%]
bgpd/test_bgp_table.py::TestTable::test_Checks_successfull_4 <- helpers/python/frrtest.py PASSED [ 22%]
bgpd/test_bgp_table.py::TestTable::test_Checks_successfull_3 <- helpers/python/frrtest.py PASSED [ 22%]
bgpd/test_capability.py::TestCapability::test_DynCap_Dynamic_Capability_Message_IP_Multicast <- helpers/python/frrtest.py PASSED [ 22%]
bgpd/test_capability.py::TestCapability::test_dyn_empty_Dynamic_capability_but_empty <- helpers/python/frrtest.py PASSED [ 23%]
bgpd/test_capability.py::TestCapability::test_ORF_ORF_simple_single_entry_single_tuple <- helpers/python/frrtest.py PASSED [ 23%]
bgpd/test_capability.py::TestCapability::test_padded_valid_with_padding <- helpers/python/frrtest.py PASSED [ 23%]
bgpd/test_capability.py::TestCapability::test_nodata_header_no_data_but_length_says_there_is <- helpers/python/frrtest.py PASSED [ 23%]
bgpd/test_capability.py::TestCapability::test_ORFnu_ORF_multi_entry_tuple_entry_number_too_long <- helpers/python/frrtest.py PASSED [ 24%]
bgpd/test_capability.py::TestCapability::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 24%]
bgpd/test_capability.py::TestCapability::test_AS4real_AS4_capability_in_series_of_capabilities <- helpers/python/frrtest.py PASSED [ 24%]
bgpd/test_capability.py::TestCapability::test_DynCapLong_Dynamic_Capability_Message_IP_Multicast_truncated <- helpers/python/frrtest.py PASSED [ 24%]
bgpd/test_capability.py::TestCapability::test_minsize_violates_minsize_requirement <- helpers/python/frrtest.py PASSED [ 25%]
bgpd/test_capability.py::TestCapability::test_MP6_MP_IP4_MPLS_labeled_VPN <- helpers/python/frrtest.py PASSED [ 25%]
bgpd/test_capability.py::TestCapability::test_MP3_MP_IP6_MPLS_labeled_VPN <- helpers/python/frrtest.py PASSED [ 25%]
bgpd/test_capability.py::TestCapability::test_GR_trunc_GR_capability_but_truncated <- helpers/python/frrtest.py PASSED [ 25%]
bgpd/test_capability.py::TestCapability::test_MP_overflow_MP_IP4_Unicast_length_too_long <- helpers/python/frrtest.py PASSED [ 26%]
bgpd/test_capability.py::TestCapability::test_AS4series_AS4_capability_in_series_of_capabilities <- helpers/python/frrtest.py PASSED [ 26%]
bgpd/test_capability.py::TestCapability::test_dyn_old_Dynamic_capability_deprecated_version <- helpers/python/frrtest.py PASSED [ 26%]
bgpd/test_capability.py::TestCapability::test_MPv6_MP_IPv6_Uni <- helpers/python/frrtest.py PASSED [ 26%]
bgpd/test_capability.py::TestCapability::test_ORF_empty_ORF_capability_but_empty <- helpers/python/frrtest.py PASSED [ 27%]
bgpd/test_capability.py::TestCapability::test_AS4real2_AS4_capability_in_series_of_capabilities <- helpers/python/frrtest.py PASSED [ 27%]
bgpd/test_capability.py::TestCapability::test_MP8_MP_unknown_AFI_SAFI <- helpers/python/frrtest.py PASSED [ 27%]
bgpd/test_capability.py::TestCapability::test_AS4_AS4_capability <- helpers/python/frrtest.py PASSED [ 27%]
bgpd/test_capability.py::TestCapability::test_Cap_singlets_One_capability_per_Optional_Param <- helpers/python/frrtest.py PASSED [ 28%]
bgpd/test_capability.py::TestCapability::test_DynCapMPCoverflow_Dynamic_Capability_Message_IP_Multicast_cap_data_length <- helpers/python/frrtest.py PASSED [ 28%]
bgpd/test_capability.py::TestCapability::test_Cap_series_Series_of_capability_one_Optional_Param <- helpers/python/frrtest.py PASSED [ 28%]
bgpd/test_capability.py::TestCapability::test_GR_GR_capability <- helpers/python/frrtest.py PASSED [ 28%]
bgpd/test_capability.py::TestCapability::test_DynCapPadded_Dynamic_Capability_Message_IP_Multicast_padded <- helpers/python/frrtest.py PASSED [ 29%]
bgpd/test_capability.py::TestCapability::test_ORFlu_ORF_multi_entry_tuple_length_too_long <- helpers/python/frrtest.py PASSED [ 29%]
bgpd/test_capability.py::TestCapability::test_ORFlo_ORF_multi_entry_tuple_hdr_length_too_short <- helpers/python/frrtest.py PASSED [ 29%]
bgpd/test_capability.py::TestCapability::test_AS4more_AS4_capability_after_other_caps_singlets <- helpers/python/frrtest.py PASSED [ 29%]
bgpd/test_capability.py::TestCapability::test_MP2_MP_IP_Multicast <- helpers/python/frrtest.py PASSED [ 30%]
bgpd/test_capability.py::TestCapability::test_caphdr_capability_header_and_no_more <- helpers/python/frrtest.py PASSED [ 30%]
bgpd/test_capability.py::TestCapability::test_MP_short_MP_IP4_Unicast_length_too_short_minimum <- helpers/python/frrtest.py PASSED [ 30%]
bgpd/test_capability.py::TestCapability::test_ORFpad_ORF_multi_entry_tuple_padded_to_align <- helpers/python/frrtest.py PASSED [ 30%]
bgpd/test_capability.py::TestCapability::test_ORF_many_ORF_multi_entry_tuple <- helpers/python/frrtest.py PASSED [ 31%]
bgpd/test_capability.py::TestCapability::test_GR_short_GR_capability_but_header_length_too_short <- helpers/python/frrtest.py PASSED [ 31%]
bgpd/test_capability.py::TestCapability::test_GR_long_GR_capability_but_header_length_too_long <- helpers/python/frrtest.py PASSED [ 31%]
bgpd/test_capability.py::TestCapability::test_AS4_empty_AS4_capability_but_empty <- helpers/python/frrtest.py PASSED [ 31%]
bgpd/test_capability.py::TestCapability::test_MP_empty_MP_capability_but_empty <- helpers/python/frrtest.py PASSED [ 32%]
bgpd/test_capability.py::TestCapability::test_DynCapMPCpadded_Dynamic_Capability_Message_IP_Multicast_cap_data_padded <- helpers/python/frrtest.py PASSED [ 32%]
bgpd/test_capability.py::TestCapability::test_MP4_MP_IP_Uni <- helpers/python/frrtest.py PASSED [ 32%]
bgpd/test_capability.py::TestCapability::test_ORFno_ORF_multi_entry_tuple_entry_number_too_short <- helpers/python/frrtest.py PASSED [ 32%]
bgpd/test_capability.py::TestCapability::test_GR_empty_GR_capability_but_empty <- helpers/python/frrtest.py PASSED [ 33%]
bgpd/test_capability.py::TestCapability::test_MP5_MP_IP6_MPLS_VPN <- helpers/python/frrtest.py PASSED [ 33%]
bgpd/test_ecommunity.py::TestEcommunity::test_asn4 <- helpers/python/frrtest.py PASSED [ 33%]
bgpd/test_ecommunity.py::TestEcommunity::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 33%]
bgpd/test_ecommunity.py::TestEcommunity::test_asn <- helpers/python/frrtest.py PASSED [ 34%]
bgpd/test_ecommunity.py::TestEcommunity::test_ipaddr_so <- helpers/python/frrtest.py PASSED [ 34%]
bgpd/test_ecommunity.py::TestEcommunity::test_ipaddr <- helpers/python/frrtest.py PASSED [ 34%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_2_IPV6_MP_Reach_global_nexthop_2_NLRIs <- helpers/python/frrtest.py PASSED [ 34%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_lnh_IPV6_MP_Reach_global_local_nexthops_2_NLRIs_default <- helpers/python/frrtest.py PASSED [ 35%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_unreach_IPV6_MP_Unreach_1_NLRI <- helpers/python/frrtest.py PASSED [ 35%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_nlri_IPV6_MP_Reach_NLRI_bitlen_overflow <- helpers/python/frrtest.py PASSED [ 35%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_unreach_nlrilen_IPv4_MP_Unreach_nlri_length_overflow <- helpers/python/frrtest.py PASSED [ 35%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_VPNv4_0_nlri_IPv4_VPNv4_MP_Reach_RD_Nexthop_3_NLRI_3rd_0_bogus <- helpers/python/frrtest.py PASSED [ 36%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_unreach_nlri_IPV6_MP_Unreach_NLRI_bitlen_overflow <- helpers/python/frrtest.py PASSED [ 36%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_unreach_IPv4_MP_Unreach_2_NLRIs_default <- helpers/python/frrtest.py PASSED [ 36%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_nhlen3_IPV6_MP_Reach_nexthop_length_overflow <- helpers/python/frrtest.py PASSED [ 36%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_VPNv4_plen1_long_IPv4_VPNv4_MP_Reach_RD_Nexthop_2_NLRIs_1st_plen_long <- helpers/python/frrtest.py PASSED [ 37%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_bug_IPv6_global_nexthop_1_default_NLRI <- helpers/python/frrtest.py PASSED [ 37%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_nhlen4_IPV6_MP_Reach_nexthop_length_short <- helpers/python/frrtest.py PASSED [ 37%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_IPv4_MP_Reach_2_NLRIs_default <- helpers/python/frrtest.py PASSED [ 37%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_nhlen_IPV6_MP_Reach_inappropriate_nexthop_length <- helpers/python/frrtest.py PASSED [ 38%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_VPNv4_bogus_plen_IPv4_MPLS_labeled_VPN_MP_Reach_RD_Nexthop_NLRI_bogus_p_len <- helpers/python/frrtest.py PASSED [ 38%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_unreach2_IPV6_MP_Unreach_2_NLRIs <- helpers/python/frrtest.py PASSED [ 38%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_VPNv4_bogus_rd_type_IPv4_VPNv4_MP_Reach_RD_NH_2_NLRI_unknown_RD_in_1st_log_but_parse <- helpers/python/frrtest.py PASSED [ 38%]
bgpd/test_mp_attr.py::TestMpAttr::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 39%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_nhlen_IPv4_MP_Reach_nexthop_lenth_overflow <- helpers/python/frrtest.py PASSED [ 39%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_nhlen2_IPV6_MP_Reach_invalid_nexthop_length <- helpers/python/frrtest.py PASSED [ 39%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_nlrilen_IPv4_MP_Reach_nlri_lenth_overflow <- helpers/python/frrtest.py PASSED [ 39%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_IPV6_MP_Reach_global_nexthop_1_NLRI <- helpers/python/frrtest.py PASSED [ 40%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_unreach_default_IPV6_MP_Unreach_2_NLRIs_default <- helpers/python/frrtest.py PASSED [ 40%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_VPNv4_plenn_long_IPv4_VPNv4_MP_Reach_RD_Nexthop_3_NLRIs_last_plen_long <- helpers/python/frrtest.py PASSED [ 40%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv6_default_IPV6_MP_Reach_global_nexthop_2_NLRIs_default <- helpers/python/frrtest.py PASSED [ 40%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_VPNv4_IPv4_VPNv4_MP_Reach_RD_Nexthop_2_NLRIs <- helpers/python/frrtest.py PASSED [ 40%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_VPNv4_plen1_short_IPv4_VPNv4_MP_Reach_RD_Nexthop_2_NLRIs_1st_plen_short <- helpers/python/frrtest.py PASSED [ 41%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_unreach_VPNv4_IPv4_MPLS_labeled_VPN_MP_Unreach_RD_3_NLRIs <- helpers/python/frrtest.py PASSED [ 41%]
bgpd/test_mp_attr.py::TestMpAttr::test_IPv4_VPNv4_plenn_short_IPv4_VPNv4_MP_Reach_RD_Nexthop_2_NLRIs_last_plen_short <- helpers/python/frrtest.py PASSED [ 41%]
bgpd/test_mpath.py::TestMpath::test_bgp_path_info_mpath_update <- helpers/python/frrtest.py PASSED [ 41%]
bgpd/test_mpath.py::TestMpath::test_bgp_mp_list <- helpers/python/frrtest.py PASSED [ 42%]
bgpd/test_mpath.py::TestMpath::test_bgp_maximum_paths_config <- helpers/python/frrtest.py PASSED [ 42%]
bgpd/test_mpath.py::TestMpath::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 42%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_remove_private_AS_all_replace_AS <- helpers/python/frrtest.py FAILED [ 42%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_capability_orf_prefix_list_both <- helpers/python/frrtest.py FAILED [ 43%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_maximum_prefix_4 <- helpers/python/frrtest.py FAILED [ 43%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_maximum_prefix_5 <- helpers/python/frrtest.py FAILED [ 43%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_maximum_prefix_2 <- helpers/python/frrtest.py FAILED [ 43%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_maximum_prefix_3 <- helpers/python/frrtest.py FAILED [ 44%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_remove_private_AS <- helpers/python/frrtest.py FAILED [ 44%]
bgpd/test_peer_attr.py::TestFlag::test_peer_disable_connected_check <- helpers/python/frrtest.py FAILED [ 44%]
bgpd/test_peer_attr.py::TestFlag::test_peer_strict_capability_match <- helpers/python/frrtest.py FAILED [ 44%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_attribute_unchanged_as_path <- helpers/python/frrtest.py FAILED [ 45%]
bgpd/test_peer_attr.py::TestFlag::test_peer_dont_capability_negotiate <- helpers/python/frrtest.py FAILED [ 45%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_maximum_prefix_2 <- helpers/python/frrtest.py FAILED [ 45%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_attribute_unchanged_as_path_next_hop_med <- helpers/python/frrtest.py FAILED [ 45%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_distribute_list <- helpers/python/frrtest.py FAILED [ 46%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_prefix_list_2 <- helpers/python/frrtest.py FAILED [ 46%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_remove_private_AS_all <- helpers/python/frrtest.py FAILED [ 46%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_send_community <- helpers/python/frrtest.py FAILED [ 46%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_route_server_client <- helpers/python/frrtest.py FAILED [ 47%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_route_reflector_client <- helpers/python/frrtest.py FAILED [ 47%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_attribute_unchanged_as_path_med <- helpers/python/frrtest.py FAILED [ 47%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_remove_private_AS_all_replace_AS <- helpers/python/frrtest.py FAILED [ 47%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_next_hop_self <- helpers/python/frrtest.py FAILED [ 48%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_default_originate <- helpers/python/frrtest.py FAILED [ 48%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_next_hop_self <- helpers/python/frrtest.py FAILED [ 48%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_route_map_2 <- helpers/python/frrtest.py FAILED [ 48%]
bgpd/test_peer_attr.py::TestFlag::test_peer_local_as_1_no_prepend <- helpers/python/frrtest.py FAILED [ 49%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_prefix_list_2 <- helpers/python/frrtest.py FAILED [ 49%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_distribute_list <- helpers/python/frrtest.py FAILED [ 49%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_next_hop_self <- helpers/python/frrtest.py FAILED [ 49%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_remove_private_AS_all_replace_AS <- helpers/python/frrtest.py FAILED [ 50%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_remove_private_AS_replace_AS <- helpers/python/frrtest.py FAILED [ 50%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_distribute_list <- helpers/python/frrtest.py FAILED [ 50%]
bgpd/test_peer_attr.py::TestFlag::test_exit_cleanly <- helpers/python/frrtest.py FAILED [ 50%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_allowas_in <- helpers/python/frrtest.py FAILED [ 51%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_allowas_in_origin <- helpers/python/frrtest.py FAILED [ 51%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_weight <- helpers/python/frrtest.py FAILED [ 51%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_send_community <- helpers/python/frrtest.py FAILED [ 51%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_maximum_prefix_3 <- helpers/python/frrtest.py FAILED [ 52%]
bgpd/test_peer_attr.py::TestFlag::test_peer_local_as <- helpers/python/frrtest.py FAILED [ 52%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_attribute_unchanged_med <- helpers/python/frrtest.py FAILED [ 52%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_unsuppress_map <- helpers/python/frrtest.py FAILED [ 52%]
bgpd/test_peer_attr.py::TestFlag::test_peer_advertisement_interval <- helpers/python/frrtest.py FAILED [ 53%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_maximum_prefix_4 <- helpers/python/frrtest.py FAILED [ 53%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_capability_orf_prefix_list_receive <- helpers/python/frrtest.py FAILED [ 53%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_route_reflector_client <- helpers/python/frrtest.py FAILED [ 53%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_maximum_prefix_3 <- helpers/python/frrtest.py FAILED [ 54%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_maximum_prefix_2 <- helpers/python/frrtest.py FAILED [ 54%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_send_community_large <- helpers/python/frrtest.py FAILED [ 54%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_allowas_in_origin <- helpers/python/frrtest.py FAILED [ 54%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_attribute_unchanged_as_path_next_hop_med <- helpers/python/frrtest.py FAILED [ 55%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_route_reflector_client <- helpers/python/frrtest.py FAILED [ 55%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_distribute_list <- helpers/python/frrtest.py FAILED [ 55%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_attribute_unchanged_as_path_next_hop <- helpers/python/frrtest.py FAILED [ 55%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_capability_orf_prefix_list_both <- helpers/python/frrtest.py FAILED [ 56%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_capability_orf_prefix_list_receive <- helpers/python/frrtest.py FAILED [ 56%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_maximum_prefix_5 <- helpers/python/frrtest.py FAILED [ 56%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_remove_private_AS_replace_AS <- helpers/python/frrtest.py FAILED [ 56%]
bgpd/test_peer_attr.py::TestFlag::test_peer_timers_connect <- helpers/python/frrtest.py FAILED [ 57%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_capability_orf_prefix_list_both <- helpers/python/frrtest.py FAILED [ 57%]
bgpd/test_peer_attr.py::TestFlag::test_peer_local_as_1_no_prepend_replace_as <- helpers/python/frrtest.py FAILED [ 57%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_route_server_client <- helpers/python/frrtest.py FAILED [ 57%]
bgpd/test_peer_attr.py::TestFlag::test_peer_update_source <- helpers/python/frrtest.py FAILED [ 58%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_attribute_unchanged_as_path <- helpers/python/frrtest.py FAILED [ 58%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_remove_private_AS <- helpers/python/frrtest.py FAILED [ 58%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_weight <- helpers/python/frrtest.py FAILED [ 58%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_allowas_in_origin <- helpers/python/frrtest.py FAILED [ 59%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_send_community_extended <- helpers/python/frrtest.py FAILED [ 59%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_remove_private_AS_replace_AS <- helpers/python/frrtest.py FAILED [ 59%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_filter_list <- helpers/python/frrtest.py FAILED [ 59%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_prefix_list_2 <- helpers/python/frrtest.py FAILED [ 60%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_addpath <- helpers/python/frrtest.py FAILED [ 60%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_filter_list_2 <- helpers/python/frrtest.py FAILED [ 60%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_filter_list <- helpers/python/frrtest.py FAILED [ 60%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_allowas_in <- helpers/python/frrtest.py FAILED [ 60%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_send_community_extended <- helpers/python/frrtest.py FAILED [ 61%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_next_hop_self_force <- helpers/python/frrtest.py FAILED [ 61%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_distribute_list_2 <- helpers/python/frrtest.py FAILED [ 61%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_filter_list_2 <- helpers/python/frrtest.py FAILED [ 61%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_send_community <- helpers/python/frrtest.py FAILED [ 62%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_attribute_unchanged_as_path <- helpers/python/frrtest.py FAILED [ 62%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_default_originate <- helpers/python/frrtest.py FAILED [ 62%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_attribute_unchanged_med <- helpers/python/frrtest.py FAILED [ 62%]
bgpd/test_peer_attr.py::TestFlag::test_peer_timers <- helpers/python/frrtest.py FAILED [ 63%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_attribute_unchanged_as_path_med <- helpers/python/frrtest.py FAILED [ 63%]
bgpd/test_peer_attr.py::TestFlag::test_peer_enforce_first_as <- helpers/python/frrtest.py FAILED [ 63%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_attribute_unchanged_med <- helpers/python/frrtest.py FAILED [ 63%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_send_community_large <- helpers/python/frrtest.py FAILED [ 64%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_prefix_list <- helpers/python/frrtest.py FAILED [ 64%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_route_map <- helpers/python/frrtest.py FAILED [ 64%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_filter_list_2 <- helpers/python/frrtest.py FAILED [ 64%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_attribute_unchanged_as_path_next_hop <- helpers/python/frrtest.py FAILED [ 65%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_prefix_list <- helpers/python/frrtest.py FAILED [ 65%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_route_map <- helpers/python/frrtest.py FAILED [ 65%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_next_hop_self_force <- helpers/python/frrtest.py FAILED [ 65%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_default_originate_route_map <- helpers/python/frrtest.py FAILED [ 66%]
bgpd/test_peer_attr.py::TestFlag::test_peer_shutdown <- helpers/python/frrtest.py FAILED [ 66%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_attribute_unchanged_as_path_med <- helpers/python/frrtest.py FAILED [ 66%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_attribute_unchanged_as_path_next_hop_med <- helpers/python/frrtest.py FAILED [ 66%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_soft_reconfiguration_inbound <- helpers/python/frrtest.py FAILED [ 67%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_attribute_unchanged_next_hop <- helpers/python/frrtest.py FAILED [ 67%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_prefix_list <- helpers/python/frrtest.py FAILED [ 67%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_next_hop_self_force <- helpers/python/frrtest.py FAILED [ 67%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_addpath <- helpers/python/frrtest.py FAILED [ 68%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_allowas_in_origin <- helpers/python/frrtest.py FAILED [ 68%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_unsuppress_map <- helpers/python/frrtest.py FAILED [ 68%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_route_map <- helpers/python/frrtest.py FAILED [ 68%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_attribute_unchanged_next_hop <- helpers/python/frrtest.py FAILED [ 69%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_prefix_list_2 <- helpers/python/frrtest.py FAILED [ 69%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_distribute_list_2 <- helpers/python/frrtest.py FAILED [ 69%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_distribute_list_2 <- helpers/python/frrtest.py FAILED [ 69%]
bgpd/test_peer_attr.py::TestFlag::test_peer_passive <- helpers/python/frrtest.py FAILED [ 70%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_prefix_list <- helpers/python/frrtest.py FAILED [ 70%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_maximum_prefix <- helpers/python/frrtest.py FAILED [ 70%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_as_override <- helpers/python/frrtest.py FAILED [ 70%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_route_server_client <- helpers/python/frrtest.py FAILED [ 71%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_filter_list_2 <- helpers/python/frrtest.py FAILED [ 71%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_remove_private_AS_all <- helpers/python/frrtest.py FAILED [ 71%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_soft_reconfiguration_inbound <- helpers/python/frrtest.py FAILED [ 71%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_remove_private_AS_all_replace_AS <- helpers/python/frrtest.py FAILED [ 72%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_addpath <- helpers/python/frrtest.py FAILED [ 72%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_soft_reconfiguration_inbound <- helpers/python/frrtest.py FAILED [ 72%]
bgpd/test_peer_attr.py::TestFlag::test_peer_capability_extended_nexthop <- helpers/python/frrtest.py FAILED [ 72%]
bgpd/test_peer_attr.py::TestFlag::test_peer_update_source_2 <- helpers/python/frrtest.py FAILED [ 73%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_default_originate <- helpers/python/frrtest.py FAILED [ 73%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_filter_list <- helpers/python/frrtest.py FAILED [ 73%]
bgpd/test_peer_attr.py::TestFlag::test_peer_capability_dynamic <- helpers/python/frrtest.py FAILED [ 73%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_send_community_large <- helpers/python/frrtest.py FAILED [ 74%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_allowas_in <- helpers/python/frrtest.py FAILED [ 74%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_capability_orf_prefix_list_send <- helpers/python/frrtest.py FAILED [ 74%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_as_override <- helpers/python/frrtest.py FAILED [ 74%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_route_reflector_client <- helpers/python/frrtest.py FAILED [ 75%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_capability_orf_prefix_list_send <- helpers/python/frrtest.py FAILED [ 75%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_attribute_unchanged_as_path_med <- helpers/python/frrtest.py FAILED [ 75%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_attribute_unchanged_next_hop <- helpers/python/frrtest.py FAILED [ 75%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_capability_orf_prefix_list_receive <- helpers/python/frrtest.py FAILED [ 76%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_next_hop_self <- helpers/python/frrtest.py FAILED [ 76%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_attribute_unchanged_as_path_next_hop_med <- helpers/python/frrtest.py FAILED [ 76%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_attribute_unchanged_next_hop <- helpers/python/frrtest.py FAILED [ 76%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_filter_list <- helpers/python/frrtest.py FAILED [ 77%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_route_map_2 <- helpers/python/frrtest.py FAILED [ 77%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_unsuppress_map <- helpers/python/frrtest.py FAILED [ 77%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_default_originate <- helpers/python/frrtest.py FAILED [ 77%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_route_map_2 <- helpers/python/frrtest.py FAILED [ 78%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_capability_orf_prefix_list_send <- helpers/python/frrtest.py FAILED [ 78%]
bgpd/test_peer_attr.py::TestFlag::test_peer_override_capability <- helpers/python/frrtest.py FAILED [ 78%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_as_override <- helpers/python/frrtest.py FAILED [ 78%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_remove_private_AS_replace_AS <- helpers/python/frrtest.py FAILED [ 79%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_next_hop_self_force <- helpers/python/frrtest.py FAILED [ 79%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_as_override <- helpers/python/frrtest.py FAILED [ 79%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_attribute_unchanged_as_path_next_hop <- helpers/python/frrtest.py FAILED [ 79%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_default_originate_route_map <- helpers/python/frrtest.py FAILED [ 80%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_attribute_unchanged_med <- helpers/python/frrtest.py FAILED [ 80%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_attribute_unchanged_as_path <- helpers/python/frrtest.py FAILED [ 80%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_weight <- helpers/python/frrtest.py FAILED [ 80%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_remove_private_AS <- helpers/python/frrtest.py FAILED [ 80%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_route_map_2 <- helpers/python/frrtest.py FAILED [ 81%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_allowas_in <- helpers/python/frrtest.py FAILED [ 81%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_maximum_prefix <- helpers/python/frrtest.py FAILED [ 81%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_capability_orf_prefix_list_receive <- helpers/python/frrtest.py FAILED [ 81%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_maximum_prefix_3 <- helpers/python/frrtest.py FAILED [ 82%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_maximum_prefix_4 <- helpers/python/frrtest.py FAILED [ 82%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_maximum_prefix_5 <- helpers/python/frrtest.py FAILED [ 82%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_maximum_prefix_5 <- helpers/python/frrtest.py FAILED [ 82%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_maximum_prefix_4 <- helpers/python/frrtest.py FAILED [ 83%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_default_originate_route_map <- helpers/python/frrtest.py FAILED [ 83%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_capability_orf_prefix_list_both <- helpers/python/frrtest.py FAILED [ 83%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_capability_orf_prefix_list_send <- helpers/python/frrtest.py FAILED [ 83%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_maximum_prefix_2 <- helpers/python/frrtest.py FAILED [ 84%]
bgpd/test_peer_attr.py::TestFlag::test_peer_password <- helpers/python/frrtest.py FAILED [ 84%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_send_community_extended <- helpers/python/frrtest.py FAILED [ 84%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_maximum_prefix <- helpers/python/frrtest.py FAILED [ 84%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_attribute_unchanged_as_path_next_hop <- helpers/python/frrtest.py FAILED [ 85%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_distribute_list_2 <- helpers/python/frrtest.py FAILED [ 85%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_unsuppress_map <- helpers/python/frrtest.py FAILED [ 85%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_soft_reconfiguration_inbound <- helpers/python/frrtest.py FAILED [ 85%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_remove_private_AS <- helpers/python/frrtest.py FAILED [ 86%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_multicast_route_map <- helpers/python/frrtest.py FAILED [ 86%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_multicast_send_community_large <- helpers/python/frrtest.py FAILED [ 86%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_send_community <- helpers/python/frrtest.py FAILED [ 86%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_default_originate_route_map <- helpers/python/frrtest.py FAILED [ 87%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_send_community_extended <- helpers/python/frrtest.py FAILED [ 87%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_remove_private_AS_all <- helpers/python/frrtest.py FAILED [ 87%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_route_server_client <- helpers/python/frrtest.py FAILED [ 87%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_remove_private_AS_all <- helpers/python/frrtest.py FAILED [ 88%]
bgpd/test_peer_attr.py::TestFlag::test_peer_description <- helpers/python/frrtest.py FAILED [ 88%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv4_unicast_weight <- helpers/python/frrtest.py FAILED [ 88%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_addpath <- helpers/python/frrtest.py FAILED [ 88%]
bgpd/test_peer_attr.py::TestFlag::test_peer_ipv6_unicast_maximum_prefix <- helpers/python/frrtest.py FAILED [ 89%]
isisd/test_fuzz_isis_tlv.py::TestFuzzIsisTLV::test_exit_cleanly_2 <- helpers/python/frrtest.py PASSED [ 89%]
isisd/test_fuzz_isis_tlv.py::TestFuzzIsisTLV::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 89%]
isisd/test_isis_lspdb.py::TestIsisLSPDB::test_exit_cleanly_2 <- helpers/python/frrtest.py PASSED [ 89%]
isisd/test_isis_lspdb.py::TestIsisLSPDB::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 90%]
isisd/test_isis_vertex_queue.py::TestIsisVertexQueue::test_exit_cleanly_2 <- helpers/python/frrtest.py PASSED [ 90%]
isisd/test_isis_vertex_queue.py::TestIsisVertexQueue::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 90%]
lib/test_graph.py::TestGraph::test_refout <- helpers/python/frrtest.py PASSED [ 90%]
lib/test_idalloc.py::TestIDAlloc::test_ID_Allocator_test_successful <- helpers/python/frrtest.py PASSED [ 91%]
lib/test_idalloc.py::TestIDAlloc::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 91%]
lib/test_nexthop_iter.py::TestNexthopIter::test_Simple_test_passed <- helpers/python/frrtest.py PASSED [ 91%]
lib/test_nexthop_iter.py::TestNexthopIter::test_PRNG_test_passed <- helpers/python/frrtest.py PASSED [ 91%]
lib/test_nexthop_iter.py::TestNexthopIter::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 92%]
lib/test_ringbuf.py::TestRingbuf::test_exit_cleanly_2 <- helpers/python/frrtest.py PASSED [ 92%]
lib/test_ringbuf.py::TestRingbuf::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 92%]
lib/test_srcdest_table.py::TestSrcdestTable::test_PRNG_Test_successful <- helpers/python/frrtest.py PASSED [ 92%]
lib/test_srcdest_table.py::TestSrcdestTable::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 93%]
lib/test_stream.py::TestStream::test_refout <- helpers/python/frrtest.py PASSED [ 93%]
lib/test_table.py::TestTable::test_Verifying_successor_4 <- helpers/python/frrtest.py PASSED [ 93%]
lib/test_table.py::TestTable::test_Verifying_successor_5 <- helpers/python/frrtest.py PASSED [ 93%]
lib/test_table.py::TestTable::test_Verifying_successor_7 <- helpers/python/frrtest.py PASSED [ 94%]
lib/test_table.py::TestTable::test_Verifying_successor_2 <- helpers/python/frrtest.py PASSED [ 94%]
lib/test_table.py::TestTable::test_Verifying_successor_3 <- helpers/python/frrtest.py PASSED [ 94%]
lib/test_table.py::TestTable::test_Verifying_cmp <- helpers/python/frrtest.py PASSED [ 94%]
lib/test_table.py::TestTable::test_Verifying_successor_8 <- helpers/python/frrtest.py PASSED [ 95%]
lib/test_table.py::TestTable::test_Verifying_successor_9 <- helpers/python/frrtest.py PASSED [ 95%]
lib/test_table.py::TestTable::test_Verifying_cmp_4 <- helpers/python/frrtest.py PASSED [ 95%]
lib/test_table.py::TestTable::test_Verifying_cmp_5 <- helpers/python/frrtest.py PASSED [ 95%]
lib/test_table.py::TestTable::test_Verifying_cmp_6 <- helpers/python/frrtest.py PASSED [ 96%]
lib/test_table.py::TestTable::test_Verifying_cmp_2 <- helpers/python/frrtest.py PASSED [ 96%]
lib/test_table.py::TestTable::test_Verifying_cmp_3 <- helpers/python/frrtest.py PASSED [ 96%]
lib/test_table.py::TestTable::test_Verifying_successor <- helpers/python/frrtest.py PASSED [ 96%]
lib/test_table.py::TestTable::test_Verifying_successor_10 <- helpers/python/frrtest.py PASSED [ 97%]
lib/test_table.py::TestTable::test_Verifying_successor_11 <- helpers/python/frrtest.py PASSED [ 97%]
lib/test_table.py::TestTable::test_Verified_pausing <- helpers/python/frrtest.py PASSED [ 97%]
lib/test_table.py::TestTable::test_Verifying_successor_6 <- helpers/python/frrtest.py PASSED [ 97%]
lib/test_table.py::TestTable::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 98%]
lib/test_timer_correctness.py::TestTimerCorrectness::test_Expected_output_and_actual_output_match <- helpers/python/frrtest.py PASSED [ 98%]
lib/test_timer_correctness.py::TestTimerCorrectness::test_exit_cleanly <- helpers/python/frrtest.py PASSED [ 98%]
lib/test_ttable.py::TestTTable::test_refout <- helpers/python/frrtest.py PASSED [ 98%]
lib/test_zmq.py::TestZMQ::test_refout PASSED                                [ 99%]
lib/cli/test_cli.py::TestCli::test_refout <- helpers/python/frrtest.py FAILED [ 99%]
lib/cli/test_commands.py::TestCommands::test_refout SKIPPED                 [ 99%]
lib/northbound/test_oper_data.py::TestNbOperData::test_refout <- helpers/python/frrtest.py FAILED [ 99%]
ospf6d/test_lsdb.py::TestLSDB::test_refout <- helpers/python/frrtest.py FAILED [100%]

--------------- generated xml file: /home/kent/frr/tests/tests.xml ----------------

failures.txt

[qlyoung]

This is a known bug, you must successfully complete a make install before running a make check. You can skip make check generally, but if you want to run it just run a make install first.

[kwatsen]

okay, but then can this PR be used to fix the docs to say that?

I was looking at building-frr-for-ubuntu1804.rst, but the misordering may be in other docs as well.

[qlyoung]

Fair enough, I will add this to the documentation or a wiki page for known bugs at the moment

[eqvinox]

Note that this issue only occurs when using a libyang version older than 0.16.74; we also need to fix our outdated build instructions for that. (The modified version of libyang from the opensourcerouting repo is no longer required, upstream 0.16.105/0.16-r3 works.)

[qlyoung]

Lol, it's in the output of ./configure, but it's about halfway through ./configure's screen dump so I'm sure nobody sees it:

configure: WARNING: ===== old libyang (before 0.16.74) detected =====
configure: WARNING: The available version of libyang does not seem to support
configure: WARNING: built-in YANG extension modules.  This will cause "make check"
configure: WARNING: to fail and may create installation and version mismatch issues.
configure: WARNING: Support for the old mechanism will be removed at some point.
configure: WARNING: Please update libyang to version 0.16.74 or newer.
configure: WARNING: ===== old libyang (before 0.16.74) detected =====

[eqvinox]

docs fixed by @qlyoung in #4001 to say that >=0.16.74 is required

[eqvinox]

I think the warning in the middle of configure... well... the compat foo for old libyang will be gone soon anyway & at that point it'll error out, I think we're fine until then.

[eqvinox]

fixed by building FRR against libyang >= 0.16.74