how to get the acc , P and R by NERDA

ebanalyse / NERDA

Framework for fine-tuning pretrained transformers for Named-Entity Recognition (NER) tasks

MIT License

153 stars 35 forks source link

Closed Shengyu-Liu558 closed 2 years ago

Shengyu-Liu558 commented 3 years ago

how to get the acc , P and R by NERDA?

smaakage85 commented 3 years ago

I will look into this and get back to you ASAP : )

Hansyvea commented 3 years ago

you can use seqval package to evaluate, though it would be nicer for NERDA to evaluate performance after each epoch :)

smaakage85 commented 3 years ago

Have not had the ressources for doing this, so sorry. If anyone dares, I would really love a Pull Request for this enhancement.

smaakage85 commented 2 years ago

Hi again @Hansyvea and @Shengyu-Liu558

With the latest release of NERDA (0.9.6), evaluate_performance() returns precision and recall for all tags.

Also, if you want to compute to compute accuracy, you can just run:

model.evaluate_performance(return_accuracy = True)

I close this issue.

Best, Lars