m-lab / etl

M-Lab ingestion pipeline
Apache License 2.0
22 stars 7 forks source link

Some tests are missing from new pipeline output (20161101) #176

Open gfr10598 opened 7 years ago

gfr10598 commented 7 years ago

This might just be because of midnight partitioning. Is it in the previous days data?

ndt.iupui.mlab1.ath03.measurement-lab.org 2016/11/01/20161101T00:00:38.481388000Z_host-197.45.225.91.tedata.net:57004.c2s_snaplog.gz ndt.iupui.mlab1.ath03.measurement-lab.org 2016/11/01/20161101T00:00:38.481388000Z_host-197.45.225.91.tedata.net:57018.s2c_snaplog.gz

gfr10598 commented 7 years ago

Doesn't seem to be just midnight. Also this file name does not show up in any logged errors or warnings.