SichangHe / internet_route_verification

Parse Routing Policy Specification Language from IRR and compare BGP routes against it
1 stars 0 forks source link

Fraction of ASes/routes with all reports in one type or have one type #99

Open SichangHe opened 7 months ago

SichangHe commented 7 months ago

(Updated) Generated with https://github.com/SichangHe/internet_route_verification_meta/commit/437b5fa573b6899dbd825e75e9731178d1f8fec8 using data in #120.

```elixir 26447600 routes in total. 530461 all ok, 2.01%. 9084 all skip, 0.03%. 776655 all unrec, 2.94%. 76517 all meh, 0.29%. 229592 all err, 0.87%. 20690710 have ok, 78.23%. 15763 have skip, 0.06%. 22674204 have unrec, 85.73%. 15439316 have meh, 58.38%. 12232425 have err, 46.25%. 9084 have no import, 0.03%; 26438516 have import. 2663535 all ok in import, 10.07% among routes with import. 0 all skip in import, 0.00% among routes with import. 1583672 all unrec in import, 5.99% among routes with import. 434414 all meh in import, 1.64% among routes with import. 410299 all err in import, 1.55% among routes with import. 18432507 have ok in import, 69.72% among routes with import. 1016 have skip in import, 0.00% among routes with import. 17443205 have unrec in import, 65.98% among routes with import. 11520660 have meh in import, 43.58% among routes with import. 8161463 have err in import, 30.87% among routes with import. 9084 have no export, 0.03%; 26438516 have export. 1623263 all ok in export, 6.14% among routes with export. 218 all skip in export, 0.00% among routes with export. 4626246 all unrec in export, 17.50% among routes with export. 305204 all meh in export, 1.15% among routes with export. 475894 all err in export, 1.80% among routes with export. 12776328 have ok in export, 48.32% among routes with export. 14773 have skip in export, 0.06% among routes with export. 20509961 have unrec in export, 77.58% among routes with export. 10787729 have meh in export, 40.80% among routes with export. 6668620 have err in export, 25.22% among routes with export. ```

Previous comments:

This import/export only result matches #88. The result considering both import and export shows more diversity, so I would like to plot those as well.

The fraction of these "pure" routes seem low.

SichangHe commented 7 months ago

Edit: No. The large fraction of unrecorded export is probably due to single exports.

SichangHe commented 2 months ago
```ruby 82945 ASes in total. 11796 all ok, 14.2%. 0 all skip, 0.0%. 42759 all unrec, 51.6%. 6200 all meh, 7.5%. 1158 all err, 1.4%. 61913 all same status, 74.6%. 30964 have ok, 37.33%. 23 have skip, 0.03%. 45522 have unrec, 54.88%. 25596 have meh, 30.86%. 10309 have err, 12.43%. 69556 have no import, 83.86%; 13389 have import. 1842 all ok in import, 13.76% among ASes with import. 0 all skip in import, 0.00% among ASes with import. 5725 all unrec in import, 42.76% among ASes with import. 2041 all meh in import, 15.24% among ASes with import. 429 all err in import, 3.20% among ASes with import. 4622 have ok in import, 34.52% among ASes with import. 5 have skip in import, 0.04% among ASes with import. 6339 have unrec in import, 47.34% among ASes with import. 5102 have meh in import, 38.11% among ASes with import. 2204 have err in import, 16.46% among ASes with import. 4 have no export, 0.00%; 82941 have export. 11995 all ok in export, 14.46% among ASes with export. 1 all skip in export, 0.00% among ASes with export. 42831 all unrec in export, 51.64% among ASes with export. 6447 all meh in export, 7.77% among ASes with export. 1201 all err in export, 1.45% among ASes with export. 30533 have ok in export, 36.81% among ASes with export. 18 have skip in export, 0.02% among ASes with export. 45137 have unrec in export, 54.42% among ASes with export. 25027 have meh in export, 30.17% among ASes with export. 9811 have err in export, 11.83% among ASes with export. ```
SichangHe commented 2 months ago

Edit: consider excluding skips and unrecorded cases. Edit: consider relaxed/safelisted separately in overall (not import or export specific).

82945 ASes in total.
37413 ASes without skip or unrec.

11796 all ok, 14.2% among all, 31.5% excluding skips.
0 all skip, 0.0% among all, 0.0% excluding skips.
42759 all unrec, 51.6% among all, 0.0% excluding skips.
1158 all err, 1.4% among all, 3.1% excluding skips.
279 all relaxed, 0.3% among all, 0.7% excluding skips.
5755 all safelisted, 6.9% among all, 15.4% excluding skips.
61747 all same status, 74.4% among all, 34.6% excluding skips.

30964 have ok, 37.3%.
28549 excluding ASes with skips have ok, 76.3%.
23 have skip, 0.0%.
45522 have unrec, 54.9%.
25596 have meh, 30.9%.
23387 excluding ASes with skips have meh, 62.5%.
10309 have err, 12.4%.
8659 excluding ASes with skips have err, 23.1%.
5929 have relaxed, 7.1%.
5162 excluding ASes with skips have relaxed, 13.8%.
23575 have safelisted, 28.4%.
21482 excluding ASes with skips have safelisted, 57.4%.

69556 have no import, 83.9%; 13389 have import.
1842 all ok in import, 13.8% among ASes with import.
0 all skip in import, 0.0% among ASes with import.
5725 all unrec in import, 42.8% among ASes with import.
2041 all meh in import, 15.2% among ASes with import.
429 all err in import, 3.2% among ASes with import.

4622 have ok in import, 34.5% among ASes with import.
5 have skip in import, 0.0% among ASes with import.
6339 have unrec in import, 47.3% among ASes with import.
5102 have meh in import, 38.1% among ASes with import.
2204 have err in import, 16.5% among ASes with import.

4 have no export, 0.0%; 82941 have export.
11995 all ok in export, 14.5% among ASes with export.
1 all skip in export, 0.0% among ASes with export.
42831 all unrec in export, 51.6% among ASes with export.
6447 all meh in export, 7.8% among ASes with export.
1201 all err in export, 1.4% among ASes with export.

30533 have ok in export, 36.8% among ASes with export.
18 have skip in export, 0.0% among ASes with export.
45137 have unrec in export, 54.4% among ASes with export.
25027 have meh in export, 30.2% among ASes with export.
9811 have err in export, 11.8% among ASes with export.
SichangHe commented 2 months ago
779259438 routes in total.
12583903 all ok, 1.6%.
437486 all skip, 0.1%.
23278887 all unrec, 3.0%.
2218968 all meh, 0.3%.
12607104 all err, 1.6%.
51126348 all same status, 6.6%.

162915113 all ok, excluding skips, 20.9%.
67655229 all meh, excluding skips, 8.7%.
71987263 all err, excluding skips, 9.2%.
302557605 all same status, excluding skips, 38.8%.

584260174 have ok, 75.0%.
259040 have skip, 0.0%.
651386685 have unrec, 83.6%.
476113163 have meh, 61.1%.
365939924 have err, 47.0%.

76966052 all ok in import, 9.9%.
0 all skip in import, 0.0%.
47462547 all unrec in import, 6.1%.
7902255 all meh in import, 1.0%.
22658880 all err in import, 2.9%.
154989734 all same status in import, 19.9%.

512860643 have ok in import, 65.8%.
30378 have skip in import, 0.0%.
491243278 have unrec in import, 63.0%.
389095126 have meh in import, 49.9%.
224282834 have err in import, 28.8%.
220883805 all ok in import, excluding skips, 28.3%.
92318322 all meh in import, excluding skips, 11.8%.
59497846 all err in import, excluding skips, 7.6%.

38274568 all ok in export, 4.9%.
4673 all skip in export, 0.0%.
132580469 all unrec in export, 17.0%.
6409562 all meh in export, 0.8%.
24469761 all err in export, 3.1%.
201739033 all same status in export, 25.9%.

366286524 have ok in export, 47.0%.
230055 have skip in export, 0.0%.
591586755 have unrec in export, 75.9%.
308524470 have meh in export, 39.6%.
255703928 have err in export, 32.8%.
170360347 all ok in export, excluding skips, 21.9%.
118629821 all meh in export, excluding skips, 15.2%.
98459126 all err in export, excluding skips, 12.6%.
SichangHe commented 2 months ago
779259438 routes in total, 476113163 have special/whitelistd cases.
0 all spec_export_customers, 0.0%.
22542 all spec_as_is_origin_but_no_route, 0.0%.
5527 all spec_as_set_contains_origin_but_no_route, 0.0%.
0 all spec_import_customer, 0.0%.
0 all spec_import_from_neighbor, 0.0%.
297238 all spec_uphill, 0.0%.
304780 all spec_uphill_tier1, 0.0%.
28047 all spec_tier1_pair, 0.0%.
10373 all spec_peer_only_provider_policies, 0.0%.
0 all spec_customer_only_provider_policies, 0.0%.
809 all spec_other_only_provider_policies, 0.0%.
669316 all same status, 0.1%.

855291 all spec_export_customers among special/whitelisted cases, 0.1%.
12566098 all spec_as_is_origin_but_no_route among special/whitelisted cases, 1.6%.
4072317 all spec_as_set_contains_origin_but_no_route among special/whitelisted cases, 0.5%.
6251335 all spec_import_customer among special/whitelisted cases, 0.8%.
10321588 all spec_import_from_neighbor among special/whitelisted cases, 1.3%.
161857530 all spec_uphill among special/whitelisted cases, 20.8%.
79330898 all spec_uphill_tier1 among special/whitelisted cases, 10.2%.
43325696 all spec_tier1_pair among special/whitelisted cases, 5.6%.
3216892 all spec_peer_only_provider_policies among special/whitelisted cases, 0.4%.
2227520 all spec_customer_only_provider_policies among special/whitelisted cases, 0.3%.
596928 all spec_other_only_provider_policies among special/whitelisted cases, 0.1%.
324622093 all same subtype among special/whitelisted case, 41.7%.

11458287 have spec_export_customers, 1.5%.
28955320 have spec_as_is_origin_but_no_route, 3.7%.
9318104 have spec_as_set_contains_origin_but_no_route, 1.2%.
17156700 have spec_import_customer, 2.2%.
23932405 have spec_import_from_neighbor, 3.1%.
263210325 have spec_uphill, 33.8%.
190167691 have spec_uphill_tier1, 24.4%.
102287364 have spec_tier1_pair, 13.1%.
6775134 have spec_peer_only_provider_policies, 0.9%.
10622584 have spec_customer_only_provider_policies, 1.4%.
1193727 have spec_other_only_provider_policies, 0.2%.
SichangHe commented 2 months ago
779259438 routes in total, 651386685 have unrecorded cases.
0 all unrec_import_empty, 0.0%.
0 all unrec_export_empty, 0.0%.
386721 all unrec_aut_num, 0.0%.
3221 all unrec_as_set_route, 0.0%.
216860 all unrec_some_as_set_route, 0.0%.
5820 all unrec_as_set, 0.0%.
0 all unrec_some_as_set, 0.0%.
204 all unrec_as_routes, 0.0%.
365 all unrec_route_set, 0.0%.
0 all unrec_peering_set, 0.0%.
0 all unrec_filter_set, 0.0%.
613191 all same status, 0.1%.

44331858 all unrec_import_empty among unrecorded cases, 5.7%.
42986371 all unrec_export_empty among unrecorded cases, 5.5%.
40277244 all unrec_aut_num among unrecorded cases, 5.2%.
3586373 all unrec_as_set_route among unrecorded cases, 0.5%.
44229822 all unrec_some_as_set_route among unrecorded cases, 5.7%.
25567097 all unrec_as_set among unrecorded cases, 3.3%.
145 all unrec_some_as_set among unrecorded cases, 0.0%.
102601 all unrec_as_routes among unrecorded cases, 0.0%.
222610 all unrec_route_set among unrecorded cases, 0.0%.
62844 all unrec_peering_set among unrecorded cases, 0.0%.
257010 all unrec_filter_set among unrecorded cases, 0.0%.
201623975 all same subtype among unrecorded case, 25.9%.

380773692 have unrec_import_empty, 48.9%.
385758900 have unrec_export_empty, 49.5%.
193951293 have unrec_aut_num, 24.9%.
20876645 have unrec_as_set_route, 2.7%.
229932256 have unrec_some_as_set_route, 29.5%.
135915218 have unrec_as_set, 17.4%.
2919 have unrec_some_as_set, 0.0%.
1006359 have unrec_as_routes, 0.1%.
1186465 have unrec_route_set, 0.2%.
108775 have unrec_peering_set, 0.0%.
1257887 have unrec_filter_set, 0.2%.
175963865 with 0 import and 0 export rule, 22.6%.
486788273 with either 0 import or 0 export rule, 62.5%.
245745219 refer to ASes without originating route in filter, 31.5%.
138696897 refer to missing RPSL objects, 17.8%.
SichangHe commented 1 month ago
82945 ASes in total.
25596 ASes with specal cases, 30.9%.
0 all spec_export_customers, 0.0%.
260 all spec_as_is_origin_but_no_route, 0.3%.
18 all spec_as_set_contains_origin_but_no_route, 0.0%.
0 all spec_import_customer, 0.0%.
0 all spec_import_from_neighbor, 0.0%.
5200 all spec_uphill, 6.3%.
230 all spec_uphill_tier1, 0.3%.
0 all spec_tier1_pair, 0.0%.
0 all spec_peer_only_provider_policies, 0.0%.
0 all spec_customer_only_provider_policies, 0.0%.
0 all spec_other_only_provider_policies, 0.0%.
0 all spec_export_customers, 0.0%.
0 all spec_import_customer, 0.0%.
278 all spec_as_.*origin.*, 0.3%.
0 all spec_.*_only_provider_policies, 0.0%.
0 all spec_tier1_pair, 0.0%.
5732 all spec_uphill.*, 6.9%.
11718 all same special case subtype, 14.1%.

0 all spec_export_customers among special cases, 0.0%.
260 all spec_as_is_origin_but_no_route among special cases, 0.3%.
18 all spec_as_set_contains_origin_but_no_route among special cases, 0.0%.
0 all spec_import_customer among special cases, 0.0%.
0 all spec_import_from_neighbor among special cases, 0.0%.
5200 all spec_uphill among special cases, 6.3%.
230 all spec_uphill_tier1 among special cases, 0.3%.
0 all spec_tier1_pair among special cases, 0.0%.
0 all spec_peer_only_provider_policies among special cases, 0.0%.
0 all spec_customer_only_provider_policies among special cases, 0.0%.
0 all spec_other_only_provider_policies among special cases, 0.0%.
0 all spec_export_customers among special cases, 0.0%.
0 all spec_import_customer among special cases, 0.0%.
278 all spec_as_.*origin.* among special cases, 0.3%.
0 all spec_.*_only_provider_policies among special cases, 0.0%.
0 all spec_tier1_pair among special cases, 0.0%.
5732 all spec_uphill.* among special cases, 6.9%.
11718 all same subtype among special case, 14.1%.

994 have spec_export_customers, 1.2%.
3816 have spec_as_is_origin_but_no_route, 4.6%.
1702 have spec_as_set_contains_origin_but_no_route, 2.1%.
325 have spec_import_customer, 0.4%.
153 have spec_import_from_neighbor, 0.2%.
21766 have spec_uphill, 26.2%.
5298 have spec_uphill_tier1, 6.4%.
8 have spec_tier1_pair, 0.0%.
763 have spec_peer_only_provider_policies, 0.9%.
499 have spec_customer_only_provider_policies, 0.6%.
840 have spec_other_only_provider_policies, 1.0%.
994 have spec_export_customers, 1.2%.
325 have spec_import_customer, 0.4%.
5181 have spec_as_.*origin.*, 6.2%.
1159 have spec_.*_only_provider_policies, 1.4%.
8 have spec_tier1_pair, 0.0%.
23298 have spec_uphill.*, 28.1%.
SichangHe commented 1 month ago
664496 AS pairs in total.
 127728 AS pairs with specal cases, 19.2%.
0 all spec_export_customers, 0.0%.
142 all spec_as_is_origin_but_no_route, 0.0%.
20 all spec_as_set_contains_origin_but_no_route, 0.0%.
0 all spec_import_customer, 0.0%.
0 all spec_import_from_neighbor, 0.0%.
10430 all spec_uphill, 1.6%.
1093 all spec_uphill_tier1, 0.2%.
4 all spec_tier1_pair, 0.0%.
581 all spec_peer_only_provider_policies, 0.1%.
0 all spec_customer_only_provider_policies, 0.0%.
73 all spec_other_only_provider_policies, 0.0%.
0 all spec_export_customers, 0.0%.
0 all spec_import_customer, 0.0%.
173 all spec_as_.*origin.*, 0.0%.
654 all spec_.*_only_provider_policies, 0.1%.
4 all spec_tier1_pair, 0.0%.
11523 all spec_uphill.*, 1.7%.
24697 all same special case subtype, 3.7%.

0 all spec_export_customers among special cases, 0.0%.
142 all spec_as_is_origin_but_no_route among special cases, 0.0%.
20 all spec_as_set_contains_origin_but_no_route among special cases, 0.0%.
0 all spec_import_customer among special cases, 0.0%.
0 all spec_import_from_neighbor among special cases, 0.0%.
10430 all spec_uphill among special cases, 1.6%.
1093 all spec_uphill_tier1 among special cases, 0.2%.
4 all spec_tier1_pair among special cases, 0.0%.
581 all spec_peer_only_provider_policies among special cases, 0.1%.
0 all spec_customer_only_provider_policies among special cases, 0.0%.
73 all spec_other_only_provider_policies among special cases, 0.0%.
0 all spec_export_customers among special cases, 0.0%.
0 all spec_import_customer among special cases, 0.0%.
173 all spec_as_.*origin.* among special cases, 0.0%.
654 all spec_.*_only_provider_policies among special cases, 0.1%.
4 all spec_tier1_pair among special cases, 0.0%.
11523 all spec_uphill.* among special cases, 1.7%.
24697 all same subtype among special case, 3.7%.

2547 have spec_export_customers, 0.4%.
7975 have spec_as_is_origin_but_no_route, 1.2%.
8176 have spec_as_set_contains_origin_but_no_route, 1.2%.
1336 have spec_import_customer, 0.2%.
1517 have spec_import_from_neighbor, 0.2%.
59440 have spec_uphill, 8.9%.
16337 have spec_uphill_tier1, 2.5%.
161 have spec_tier1_pair, 0.0%.
25593 have spec_peer_only_provider_policies, 3.9%.
3549 have spec_customer_only_provider_policies, 0.5%.
10416 have spec_other_only_provider_policies, 1.6%.
2547 have spec_export_customers, 0.4%.
1336 have spec_import_customer, 0.2%.
15864 have spec_as_.*origin.*, 2.4%.
39558 have spec_.*_only_provider_policies, 6.0%.
161 have spec_tier1_pair, 0.0%.
d75777 have spec_uphill.*, 11.4%.