Closed SichangHe closed 5 months ago
Reading the first phrase I was like "why were we thinking on comparing # neighbors vs # of good pairs"? I think these will be correlated for ASes that maintain their RPSL policies well... but this is what seems useful: Trying to relate RPSL policies or operational practices to the observations (# of good pairs).
The second entry in issue #34 goes in this direction: " AS %good pairs vs
operational practices (in this case the creation of RPSL rules) with route validity (here % of good pairs). Other comparisons might also make sense.
On Sat, Dec 16, 2023 at 7:57 AM Steven Hé (Sīchàng) < @.***> wrote:
In #38 https://github.com/SichangHe/internet_route_verification/issues/38, we planned to plot "AS #neighbors vs #good pairs", but are they correlated?
For convenience, I calculated all correlations: #neighbors, #rules,
import/exports, #report items.
It seems that unfortunately #neighbor is only correlated to #peer. These seem to be correlated.
Column1 Column2 Correlation35 export_meh import_meh 0.87785043 import_err import_meh 0.73908952 export_err import_meh 0.89275553 export_err export_meh 0.92080154 export_err import_err 0.70126758 skip_regex_tilde import_skip 0.99955882 skip_community export_skip 0.85050396 unrec_import_empty import_unrec 0.827590119 unrec_export_empty unrec_import_empty 0.776415160 unrec_route_set import_meh 0.850998161 unrec_route_set export_meh 0.822646163 unrec_route_set export_err 0.908722230 unrec_some_as_set_route unrec_as_set_route 0.992018307 spec_uphill_tier1 import_meh 0.963138308 spec_uphill_tier1 export_meh 0.867745309 spec_uphill_tier1 import_err 0.734378310 spec_uphill_tier1 export_err 0.907111318 spec_uphill_tier1 unrec_route_set 0.837746332 spec_tier1_pair import_meh 0.875641333 spec_tier1_pair export_meh 0.923481334 spec_tier1_pair import_err 0.755159335 spec_tier1_pair export_err 0.976138343 spec_tier1_pair unrec_route_set 0.890857350 spec_tier1_pair spec_uphill_tier1 0.885100405 spec_import_customer_oifps spec_import_peer_oifps 0.998954472 spec_as_is_origin_but_no_route import_meh 0.821592473 spec_as_is_origin_but_no_route export_meh 0.850151475 spec_as_is_origin_but_no_route export_err 0.859303483 spec_as_is_origin_but_no_route unrec_route_set 0.810841490 spec_as_is_origin_but_no_route spec_uphill_tier1 0.776713491 spec_as_is_origin_but_no_route spec_tier1_pair 0.876693628 err_filter_as_set err_filter 0.971174710 err_remote_as_num import_meh 0.881387711 err_remote_as_num export_meh 0.920176712 err_remote_as_num import_err 0.735059713 err_remote_as_num export_err 0.987088721 err_remote_as_num unrec_route_set 0.906280728 err_remote_as_num spec_uphill_tier1 0.897559729 err_remote_as_num spec_tier1_pair 0.996345734 err_remote_as_num spec_as_is_origin_but_no_route 0.867252827 err_peering import_meh 0.881386828 err_peering export_meh 0.920176829 err_peering import_err 0.735059830 err_peering export_err 0.987088838 err_peering unrec_route_set 0.906280845 err_peering spec_uphill_tier1 0.897558846 err_peering spec_tier1_pair 0.996345851 err_peering spec_as_is_origin_but_no_route 0.867252858 err_peering err_remote_as_num 1.0000001377 export import 0.9025571427 neighbor peer 0.9349181482 rules import 0.9775191483 rules export 0.9730511486 import_total import_ok 0.7283201487 import_total export_ok 0.7413941535 import_total customer 0.7549721832 export_total export_ok 0.7717891837 export_total import_meh 0.7590601838 export_total export_meh 0.7131621840 export_total export_err 0.7160811848 export_total unrec_route_set 0.7259711855 export_total spec_uphill_tier1 0.7139911856 export_total spec_tier1_pair 0.7195831861 export_total spec_as_is_origin_but_no_route 0.7032981868 export_total err_remote_as_num 0.7174531871 export_total err_peering 0.7174521880 export_total customer 0.8386201885 export_total import_total 0.9083742213 exchange_total export_ok 0.7729732218 exchange_total import_meh 0.7376062229 exchange_total unrec_route_set 0.7027122261 exchange_total customer 0.8116462266 exchange_total import_total 0.9808952272 exchange_total export_total 0.9723682340 %ok %export_ok 0.9939012409 %skip %export_skip 0.9694162479 %unrec %export_unrec 0.9976242550 %meh %export_meh 0.9907072622 %err %export_err 0.960630
— Reply to this email directly, view it on GitHub https://github.com/SichangHe/internet_route_verification/issues/109, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACPO53VNLL777M5ZI2RZBLYJV5BTAVCNFSM6AAAAABAXQGXRSVHI2DSMVQWIX3LMV43ASLTON2WKOZSGA2DINZQGY2TMNQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>
Trying to relate RPSL policies or operational practices to the observations
relate operational practices (in this case the creation of RPSL rules) with route validity (here % of good pairs)
Only these possible correlations seem to fall into this category:
Column1 Column2 Correlation
1535 import_total customer 0.754972
1880 export_total customer 0.838620
2261 exchange_total customer 0.811646
ASes with more customers obviously have more imports and exports.
What is surprising is the lack of correlation among everything else.
Wouldn't these also fall into that category (or maybe I am misunderstanding the labels):
1486 import_total import_ok 0.728320
1487 import_total export_ok 0.741394
1535 import_total customer 0.754972
1832 export_total export_ok 0.771789
1837 export_total import_meh 0.759060
1838 export_total export_meh 0.713162
1840 export_total export_err 0.716081
What exactly does customer
mean here?
Is there no correlation between import_total
and %ok / %err
?
Do you also filter for negative correlation (or maybe you take the absolute value of the correlation)?
Wouldn't these also fall into that category (or maybe I am misunderstanding the labels):
1486 import_total import_ok 0.728320 1487 import_total export_ok 0.741394 1535 import_total customer 0.754972 1832 export_total export_ok 0.771789 1837 export_total import_meh 0.759060 1838 export_total export_meh 0.713162 1840 export_total export_err 0.716081
No. None of these are policies/operational practices. (import_total
: #total observed imports. import_ok
: #ok observed imports.)
What exactly does
customer
mean here?
Is there no correlation between
import_total
and%ok / %err
?
Very unlikely.
2333 %ok import_total -3.885267e-03
2611 %err import_total 4.103025e-02
Do you also filter for negative correlation (or maybe you take the absolute value of the correlation)?
I used absolute value 0.7 as the cutoff. Commit: https://github.com/SichangHe/internet_route_verification_meta/commit/4454c023b79b30d517ced824332325473a7848e8
Edit:
Should be: Correlation between #import rules and %ok
2329 %ok import 4.601393e-02
2607 %err import 7.570217e-02
import_total
: #total observed imports
Ah, I thought those were the total of RPSL import policies, which would be one way of looking at how much RPSL an operator has created. Maybe we could do this (we should also have the number of RPSL import/export policies for each AS).
We do have #import rules (import
) and #export rules (export
).
Updated correlated items, using AS stats from all 59 RIBs:
Column1 Column2 Correlation
16 export_unrec import_ok 0.800056
35 export_meh import_meh 0.767606
38 import_err export_ok 0.829469
43 import_err import_meh 0.710487
52 export_err import_meh 0.841755
53 export_err export_meh 0.792681
58 skip_regex_tilde import_skip 0.988967
82 skip_community export_skip 0.904583
119 unrec_export_empty unrec_import_empty 0.700516
177 unrec_as_set export_unrec 0.707716
209 unrec_as_set_route unrec_as_set 0.724423
211 unrec_some_as_set_route import_ok 0.946487
216 unrec_some_as_set_route export_unrec 0.764624
307 spec_uphill_tier1 import_meh 0.909276
308 spec_uphill_tier1 export_meh 0.727346
310 spec_uphill_tier1 export_err 0.869358
332 spec_tier1_pair import_meh 0.784409
333 spec_tier1_pair export_meh 0.809042
335 spec_tier1_pair export_err 0.914755
350 spec_tier1_pair spec_uphill_tier1 0.842038
454 spec_import_from_neighbor unrec_as_set 0.839635
455 spec_import_from_neighbor unrec_as_set_route 0.808645
1377 export import 0.902796
1427 neighbor peer 0.934923
1482 rules import 0.977570
1483 rules export 0.973123
1541 import_total import_ok 0.811276
1542 import_total export_ok 0.724642
1546 import_total export_unrec 0.790155
1547 import_total import_meh 0.715823
1549 import_total import_err 0.760716
1590 import_total customer 0.792123
1892 export_total import_ok 0.792866
1893 export_total export_ok 0.707139
1897 export_total export_unrec 0.807157
1898 export_total import_meh 0.748270
1900 export_total import_err 0.726255
1912 export_total unrec_some_as_set_route 0.707830
1941 export_total customer 0.819476
1947 export_total import_total 0.971466
2279 exchange_total import_ok 0.808172
2280 exchange_total export_ok 0.721354
2284 exchange_total export_unrec 0.804108
2285 exchange_total import_meh 0.736746
2287 exchange_total import_err 0.749448
2299 exchange_total unrec_some_as_set_route 0.708317
2328 exchange_total customer 0.811120
2334 exchange_total import_total 0.993335
2340 exchange_total export_total 0.992329
2409 %ok %export_ok 0.991969
2479 %skip %export_skip 0.975684
2550 %unrec %export_unrec 0.996853
2622 %meh %export_meh 0.990044
2695 %err %export_err 0.936677
All correlations: as_all_corr.txt
We should likely identify some correlations that would be interesting to report on and focus on them. Even if they are low, it may be worth reporting on them (to say there is no correlation):
In #38, we planned to plot "AS #neighbors vs #good pairs", but are they correlated?
For convenience, I calculated all correlations: #neighbors, #rules, #import/exports, #report items.
It seems that unfortunately #neighbor is only correlated to #peer.
These seem to be correlated.
```ruby Column1 Column2 Correlation 35 export_meh import_meh 0.877850 43 import_err import_meh 0.739089 52 export_err import_meh 0.892755 53 export_err export_meh 0.920801 54 export_err import_err 0.701267 58 skip_regex_tilde import_skip 0.999558 82 skip_community export_skip 0.850503 96 unrec_import_empty import_unrec 0.827590 119 unrec_export_empty unrec_import_empty 0.776415 160 unrec_route_set import_meh 0.850998 161 unrec_route_set export_meh 0.822646 163 unrec_route_set export_err 0.908722 230 unrec_some_as_set_route unrec_as_set_route 0.992018 307 spec_uphill_tier1 import_meh 0.963138 308 spec_uphill_tier1 export_meh 0.867745 309 spec_uphill_tier1 import_err 0.734378 310 spec_uphill_tier1 export_err 0.907111 318 spec_uphill_tier1 unrec_route_set 0.837746 332 spec_tier1_pair import_meh 0.875641 333 spec_tier1_pair export_meh 0.923481 334 spec_tier1_pair import_err 0.755159 335 spec_tier1_pair export_err 0.976138 343 spec_tier1_pair unrec_route_set 0.890857 350 spec_tier1_pair spec_uphill_tier1 0.885100 405 spec_import_customer_oifps spec_import_peer_oifps 0.998954 472 spec_as_is_origin_but_no_route import_meh 0.821592 473 spec_as_is_origin_but_no_route export_meh 0.850151 475 spec_as_is_origin_but_no_route export_err 0.859303 483 spec_as_is_origin_but_no_route unrec_route_set 0.810841 490 spec_as_is_origin_but_no_route spec_uphill_tier1 0.776713 491 spec_as_is_origin_but_no_route spec_tier1_pair 0.876693 628 err_filter_as_set err_filter 0.971174 710 err_remote_as_num import_meh 0.881387 711 err_remote_as_num export_meh 0.920176 712 err_remote_as_num import_err 0.735059 713 err_remote_as_num export_err 0.987088 721 err_remote_as_num unrec_route_set 0.906280 728 err_remote_as_num spec_uphill_tier1 0.897559 729 err_remote_as_num spec_tier1_pair 0.996345 734 err_remote_as_num spec_as_is_origin_but_no_route 0.867252 827 err_peering import_meh 0.881386 828 err_peering export_meh 0.920176 829 err_peering import_err 0.735059 830 err_peering export_err 0.987088 838 err_peering unrec_route_set 0.906280 845 err_peering spec_uphill_tier1 0.897558 846 err_peering spec_tier1_pair 0.996345 851 err_peering spec_as_is_origin_but_no_route 0.867252 858 err_peering err_remote_as_num 1.000000 1377 export import 0.902557 1427 neighbor peer 0.934918 1482 rules import 0.977519 1483 rules export 0.973051 1486 import_total import_ok 0.728320 1487 import_total export_ok 0.741394 1535 import_total customer 0.754972 1832 export_total export_ok 0.771789 1837 export_total import_meh 0.759060 1838 export_total export_meh 0.713162 1840 export_total export_err 0.716081 1848 export_total unrec_route_set 0.725971 1855 export_total spec_uphill_tier1 0.713991 1856 export_total spec_tier1_pair 0.719583 1861 export_total spec_as_is_origin_but_no_route 0.703298 1868 export_total err_remote_as_num 0.717453 1871 export_total err_peering 0.717452 1880 export_total customer 0.838620 1885 export_total import_total 0.908374 2213 exchange_total export_ok 0.772973 2218 exchange_total import_meh 0.737606 2229 exchange_total unrec_route_set 0.702712 2261 exchange_total customer 0.811646 2266 exchange_total import_total 0.980895 2272 exchange_total export_total 0.972368 2340 %ok %export_ok 0.993901 2409 %skip %export_skip 0.969416 2479 %unrec %export_unrec 0.997624 2550 %meh %export_meh 0.990707 2622 %err %export_err 0.960630 ```