search

m-lab / annotation-service

Annotation integration service for M-Lab data
Apache License 2.0
3 stars 5 forks source link

Missing annotations for ipv6 trn02 #292

Open gfr10598 opened 2 years ago

gfr10598 commented 2 years ago

Addresses in prefix 2a07:1ec0:775 are not being annotated by site.Annotate(). This is showing up in the prototype pcap parser, where we use it to identify which end of a connection is the server. The three IP addresses (in ndt/pcap data) that are not being annotate are: 2a07:1ec0:775::203 2a07:1ec0:775::216 2a07:1ec0:775::229

These should be annotated with siteinfo for trn02, which include 2a07:1ec0:775::/48 https://siteinfo.mlab-oti.measurementlab.net/v1/sites/annotations.json

Annotation seems to be working fine for trn02 in uuid-annotator, based on ndt7 tables: SELECT raw.ServerIP, Server FROM measurement-lab.ndt.ndt7 WHERE date > "2021-12-14" AND raw.ServerIP LIKE "%2a07:1ec0:775%" LIMIT 1000

It also seems to be working ok in tcpinfo annotation in the legacy pipeline: SELECT Server FROM measurement-lab.ndt.tcpinfo WHERE partition_date > "2021-12-14" AND Server.IP LIKE "%2a07:1ec0:775%" LIMIT 1000

gfr10598 commented 2 years ago

Today, the pcap parser is failing to annotate server side IPs for mex01 -"2604:d600:1000:3::75" -"2604:d600:1000:3::88" -"2604:d600:1000:3::101"

This log message may be suspicious: site.go:49: 242 sites loaded with 452 networks

Should there be 484 networks?