search

ArneBinder / dialam-2024-shared-task

see http://dialam.arg.tech/
0 stars 0 forks source link

integrate official eval scripts #27

Closed ArneBinder closed 5 months ago

ArneBinder commented 5 months ago

output of python src/evaluation/eval_official.py -h:

usage: eval_official.py [-h] --mode MODE --predictions_dir PREDICTIONS_DIR --gold_dir GOLD_DIR [--nodeset_id NODESET_ID] [--silent]

Evaluate arguments

optional arguments:
  -h, --help            show this help message and exit
  --mode MODE           Mode of evaluation (arguments/illocutions)
  --predictions_dir PREDICTIONS_DIR
                        Path to the directory containing the gold nodesets
  --gold_dir GOLD_DIR   Path to the directory containing the predicted nodesets
  --nodeset_id NODESET_ID
                        ID of the nodeset to evaluate. If not provided, evaluate all nodesets in predictions_dir
  --silent              Whether to show verbose output