Levels of success for CODECHECK certificates

[nuest]

I took a more detailed look at SciGen.Report today together with its founder @amorim-cjs. SciGen.Report has different levels of reproducibility, which might be interesting to capture in the codecheck.yml as proper metadata. The CODECHECK certificates do mentions this kind of information (and the summary in the codecheck.yml might too), but a structured proper field with a set of predefined values could be valuable to intergration and visulisation of search results, for example.

Here is a screenshot of the SciGen.Report options when I want to submit a review and the variants that are relevant to CODECHECK (considering that "negative" CODECHECK certificates are not something that will ever be published in the same way):

• Yes, within margin, all of it as written
• Yes, within margin, but extra information was needed (please clarify)
• Yes, but only partially (please specify)

[nuest]

SciGen.Report now has a new interesting collection of possible terms, which might help us describing the extent of a check:

See https://scigen.report/info/reproducibility for the background.

With codecheck, we're staying in the "same/same" quadrant.

[amorim-cjs]

Thank you for the observation. Do let me know if you or anyone see problems with these terms. For example, in case they don't seem to fit some needs.