search

aviaviavi / curl-runnings

A declarative test framework for quickly and easily writing integration tests against JSON APIs.
MIT License
158 stars 13 forks source link

logging summary of testcases #53

Closed ghost closed 4 years ago

ghost commented 4 years ago

Hello again,

Is there a way to log to a file (JSON preferably)? We need a summary of the test case results (along with the new timers) logged to a file in order to be visualized by another service. It could be a very simple JSON with a key: testresult and the value: [PASS] GET Latest Testresult (0.02 seconds) it would be much nice if it was in lists though:

[
    {
        "case_name": "Get all",
        "verdict": "fail",
        "time": "0.50"
    },
    {
        "case_name": "Post testresult",
        "verdict": "pass",
        "time": "0.06"
    }
]
aviaviavi commented 4 years ago

Hey @Rashadse. That functionality doesn't currently exist in curl-runnings either, but it could be added.

aviaviavi commented 4 years ago

Just curious, are you trying to hook this up to your own internal dashboards, or another external tool? We've had requests for TAP (#13) and Report Portal (#41)

ghost commented 4 years ago

You could say it is technically internal tool. But it is our own elastic search cluster that is visualised by kibana. Logging to the json file would save us a lot of parsing work with regx or grok.

aviaviavi commented 4 years ago

Got it, thanks for that info