search

cisnlp / simalign

Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
MIT License
347 stars 47 forks source link

Evaluation Scripts & Results Reproduction #13

Closed qianliu0708 closed 3 years ago

qianliu0708 commented 4 years ago

Thanks for the impressive work of SimAlign.

Currently I am working on reproducing the results in your paper, but I don't know how to compute the redefined precision and recall measures presented by Och & Ney, 2003, i.e., which labels should be S labels or P labels?

Could you please provide the eavluation scripts on the test sets used in paper?

Thanks.

pdufter commented 4 years ago

Hi @qianliu0708 we plan to add the evaluation scripts soon.

spookyQubit commented 3 years ago

Hi @pdufter, thanks a lot to you and your collaborators on this very interesting work. When your time permits, it would indeed be great if evaluation scripts are provided to reproduce the scores. -- Thanks.

masoudjs commented 3 years ago

Hi @spookyQubit, We have added the evaluation script as well as some sample sentences with gold alignments. If there are any issues with the code or the samples, please reach out to us.

spookyQubit commented 3 years ago

@masoudjs thanks a lot. Really appreciate it.