Closed ninsch3000 closed 1 year ago
For the actual runs I did not observe this behaviour. It could be, that the processes write the file to the correct location. My previous comment and solution was not needed.
I had to change a line in metrics json2tsv, since the json now can have entries without "type", causing a KeyError. I caught it in the list comprehension by adding another if statement beforehand. The other commits are tailored to our execution.
Before merging, change branches in requirements.txt
files to main
Fixes #459, #461, #462, #463 Currently our SWFs are not compatible with the OEB VRE infrastructure and must thus be run somewhere else. However, the output json files are supposed to comply with the OEB schemas, so that APAeval results can be uploaded into the OEB database and be visualized on the OEB website.
In this PR the following changes have been made:
JSON_templates
, remove timestamp from manifest objectparticipant
objects, that is for allvalidated_participant.challenge.json
, only save a singleparticipant
object that contains all challenge ids from allvalidated_participant.challenge.json
in theconsolidated_results.json
.consolidated_results.json
JSON_templates
requirement linkbarplot
in aggregation objectsChecklist