Check the submission files of participants before evaluating.
Rules for system response files:
files must be in UTF-8, tsv encoded (.tsv extension), with annotations in IOB format.
files need to contain all content item lines and empty lines in the order of the original input file.
files must comply with the following naming convention:
TEAMNAME_TASKBUNDLEID_LANG_RUNNUMBER.tsv
where:
TEAMNAME: is the name of the team such as registered via the CLEF portal
TASKBUNDLEID: is one of the bundle ids as indicated in Table 4.
LANG: is de,fr,en
RUNNUMBER: is 1,2,3 Example: dreamteam_bundle1_de_2.tsv
files must include all columns and instantiate the unspecified values in the required
columns according to the chosen task bundle.
files can include the comment lines present in the input, but do not need to.
Check the submission files of participants before evaluating.
Rules for system response files: