Annotation results of Step 1 of the Edit-based human evaluation.

tmu-nlp / SEEDA

3 stars 0 forks source link

Annotation results of Step 1 of the Edit-based human evaluation. #2

Open gotutiyan opened 2 months ago

gotutiyan commented 2 months ago

Thank you for publishing the ranking data.

Do you have any plans to publish the results of Step 1?

In particular, I would like to use valid/invalid annotation results for each system correction. (In other words, the results corresponding to "Checking system edits (@Output)" in the Figure2 of your paper.)

imkymn commented 2 months ago

We hadn't initially planned to release the data for step 1; however, we are considering doing so to provide additional resources, although organizing the data may take some time.

gotutiyan commented 2 months ago

Thank you for your response, I'm looking forward to publishing the data :)