We already finished initial implementation of the _STATUS.log and it works as expected. We can see in Grafana table all information about run tests status and same logs in Kibana
Screenshot
But from the Grafana table above it is not clear if tests run was finished and how long it take.
Also, it will be good to have information about all used components version in the logs to not search that in Dist-Tests source code.
Proposal
[x] Update existing _STATUS.log and add additional fields about used components
gethid: docker image of the Geth used during the tests
prometheusid: docker image of the Prometheus used during the tests
codexcontractsethid: docker image of the codex-contracts-eth used during the tests
[ ] Add a new status log with information about the whole run - run_STATUS.log(do we need a separate file or we can append that data into existing _STATUS.log file?). It should have format similar to the _STATUS.log with some exceptions
Category: "Finish - %Category%" # A special category name, which identify finish of the whole run
Fixture: "" # Empty - we don't have that information in that context
Test Name: "" # Empty - we don't have that information in that context
Status: "%Failed%/%Skipped%/%Passed%/%Total%" # Tests count by category
Duration: "%Total Duration%" # Whole run duration
We are using file name pattern and file format similar to the _STATUS.log to handle parsing and shipping by the same logs shipper rules.
This implementation will help us to accomplish the following
By the end of the all tests run we will have a delimiter in the Grafana table to distinguish runs by colors
We will be able to see stats about duration and number of tests by runs
And just an example of the runner output, and we would like to see that data(in a different format) in our log file
Passed! - Failed: 0, Passed: 26, Skipped: 2, Total: 28, Duration: 31 m 19 s - Tests.dll (net7.0)
Intro
We already finished initial implementation of the
_STATUS.log
and it works as expected. We can see in Grafana table all information about run tests status and same logs in KibanaScreenshot
But from the Grafana table above it is not clear if tests run was finished and how long it take.
Also, it will be good to have information about all used components version in the logs to not search that in Dist-Tests source code.
Proposal
[x] Update existing
_STATUS.log
and add additional fields about used components[ ] Add a new status log with information about the whole run -
run_STATUS.log
(do we need a separate file or we can append that data into existing_STATUS.log
file?). It should have format similar to the_STATUS.log
with some exceptionsWe are using file name pattern and file format similar to the
_STATUS.log
to handle parsing and shipping by the same logs shipper rules.This implementation will help us to accomplish the following
And just an example of the runner output, and we would like to see that data(in a different format) in our log file