search

huji-nlp / ucca

Universal Conceptual Cognitive Annotation (UCCA)
https://universalconceptualcognitiveannotation.github.io/
GNU General Public License v3.0
20 stars 20 forks source link

TypeError: '<' not supported between instances of 'Candidate' and 'Candidate' #93

Closed danielhers closed 4 years ago

danielhers commented 4 years ago

Running scripts.evaluate_standard with --errors --units --verbose gives this exception:

Traceback (most recent call last):
  File "/home/daniel/workspace/ucca/scripts/evaluate_standard.py", line 126, in <module>
    main(check_args(argparser.parse_args()))
  File "/home/daniel/workspace/ucca/scripts/evaluate_standard.py", line 26, in main
    eval_type=evaluation.UNLABELED if args.unlabeled else None)
  File "/home/daniel/workspace/ucca/ucca/evaluation.py", line 356, in evaluate
    for evaluation_type in (eval_type or EVAL_TYPES))
  File "/home/daniel/workspace/ucca/ucca/evaluation.py", line 163, in __init__
    self.evaluators = dict(evaluator_results)
  File "/home/daniel/workspace/ucca/ucca/evaluation.py", line 356, in <genexpr>
    for evaluation_type in (eval_type or EVAL_TYPES))
  File "/home/daniel/workspace/ucca/ucca/evaluation.py", line 148, in get_scores
    print_tags_and_text(p1, only[0])
  File "/home/daniel/workspace/ucca/ucca/evaluation.py", line 65, in print_tags_and_text
    print((",".join(sorted(set(filter(None, tags)))) + ": " + text) if tags else text)
TypeError: '<' not supported between instances of 'Candidate' and 'Candidate'

@nschneid