m-lab / murakami

Run automated internet measurement tests in a Docker container.
Apache License 2.0
41 stars 11 forks source link

Understanding how failed test results are uploaded and represented #54

Closed critzo closed 2 years ago

critzo commented 4 years ago

Currently if a test fails, and the local exporter is enabled, a failed test result would be stored on disk. However, if the test failed due to a lack of connectivity, any remote exporters would not send the failure result to GCS or remote server.

In a future Murakami feature change, we could consider changing the way exporters work, and re-use Pusher, or a version of it, to monitor a local folder and push results when connectivity is available. This would ensure that all results, including test failures are reported.

critzo commented 2 years ago

Reviewing old issues.. if an ndt test does not complete due to an error, the error is now included in the murakami schema results.