MantisAI / nervaluate

Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13
MIT License
154 stars 19 forks source link

Not enough values to unpack (Evaluator) #78

Open TessDejaeghere opened 3 months ago

TessDejaeghere commented 3 months ago

Hi all!

I tried applying the Evaluator to my nested list entities, but it only returns "results" and "results_by_tag".

evaluator = Evaluator(true, predicted, tags=['FAUNA', 'FLORA'], loader="list") results, results_by_tag, result_indices, result_indices_by_tag = evaluator.evaluate()

Error:

ValueError: not enough values to unpack (expected 4, got 2)

Any idea how I can fix this? Or am I missing something? :) Thank you!

davidsbatista commented 3 months ago

Hi @TessDejaeghere

Can you tell us which version of nervaluate you are running and the content of trueand predictedso that we can replicate the error.

Also, currently, nervaluate doesn't support nested entities.