search

m-lab / murakami

Run automated internet measurement tests in a Docker container.
Apache License 2.0
41 stars 11 forks source link

convert.py fails if some test output files have different fields #68

Closed robertodauria closed 4 years ago

robertodauria commented 4 years ago

Test output formats change over time. speedtest-cli has added some new fields (e.g. serverUrl2) that were not there years ago.

Currently, the code reads the fields from the first record it finds, then proceeds to write the CSV header line based on that. When it finds new fields, it fails. It should either ignore new fields or include them in the header line.

critzo commented 4 years ago

Since the conversion of Y1 data only needs to happen once, I'll manage to get around the errors and parse the data, then close out this branch.