search

m-lab / etl

M-Lab ingestion pipeline
Apache License 2.0
22 stars 7 forks source link

GeoLocation annotation for Paris Traceroute are missing #355

Open yachang opened 6 years ago

yachang commented 6 years ago

Reported by @critzo Paris-traceroute IPs look to be un-annotated in older data. Are they currently getting annotated?

Second issue: Same question, but for Sidestream instead of Paris Traceroute.

yachang commented 6 years ago

I redeploy PT parser in Sandbox. And there is Geo annotation in output PT table:

SELECT test_id, connection_spec.client_ip, connection_spec.server_ip, connection_spec.client_geolocation.country_code FROM [mlab-sandbox:mlab_sandbox.traceroute_20171026] WHERE project = 3 LIMIT 100

I will move ahead and verify in production.

yachang commented 6 years ago

@critzo

What is the exact date for "older" data where Geo Annotation missed?

yachang commented 6 years ago

According to offline discussion with @gfr10598 , he reprocessed all 2017 data in early Nov. The output is not transferred to the public table yet.

We might wait till all reprocessed output in public BQ table to verify it again.