martinthomson / i-d-template

A template for IETF internet draft git repositories
Other
208 stars 182 forks source link

Job summaries #330

Closed mnot closed 2 years ago

mnot commented 2 years ago

This seems promising. Most obvious places to use it:

martinthomson commented 2 years ago

Indeed. The trick being to provide a useful summary of what happened without overdoing it.

For building drafts, it seems like we might report on the number of drafts that were successfully built, which drafts did not successfully build, plus the number of errors that were produced. Counting or reporting on errors requires a little post processing, but the other items seem fairly trivial to produce and could provide some value.

Ideally we could reproduce some of the error logs, but that might require some engineering. I'm thinking a wrapper script that calls exec when the variable isn't set, but captures and reformats output when the task fails and output is produced.

martinthomson commented 2 years ago

Here is what I have so far. I need to build out the upload pieces, but this is the main event:

Build Failed

✅ draft-ietf-quic-http

✅ draft-ietf-quic-qpack

✅ rfc8999

❌ rfc9000: step 'nl' failed ``` rfc9000.md has no newline on the last line ```
❌ rfc9000: step 'ws' failed ``` rfc9000.md contains trailing whitespace ```

✅ rfc9001

✅ rfc9002

mnot commented 2 years ago

good start