acl-org / reviewer-paper-matching

Reviewer-paper matching for ACL
BSD 3-Clause "New" or "Revised" License
24 stars 3 forks source link

Get corpus of real bids for evaluation #11

Closed neubig closed 4 years ago

neubig commented 4 years ago

Currently, we can do evaluation using a mocked-up setting using EMNLP2019 papers and ACL2020 area chairs by assuming that area chairs can evaluate any paper in their area and only papers in their area. It would be good to get a better evaluation corpus with real bids.

neubig commented 4 years ago

We decided to use some from workshops that the developers have access to.