dodona-edu / universal-judge

Universal judge for educational software testing
https://docs.dodona.be/en/tested
MIT License
9 stars 5 forks source link

Support custom checks from DSL #391

Closed pdawyndt closed 1 year ago

pdawyndt commented 1 year ago

TESTed already supports custom checks, but only from the JSON-specification of testsuites. Find way to support custom checks from the DSL.

FYI: A custom check is a function that is passed the expected and generated result, both converted into object of the programming language in which the custom check is implemented. The DSL thus needs a way to specify the file where the custom check is implemented, together with the name of the function (unless that name is fixed)