The release of whole set of the evaluation graphs in shared task

cfmrp / mtool

Software to Manipulate Different Flavors of Semantic Graphs

http://mrp.nlpl.eu

GNU Lesser General Public License v3.0

51 stars 24 forks source link

The release of whole set of the evaluation graphs in shared task #68

Closed longxudou closed 5 years ago

longxudou commented 5 years ago

Hi, I notice that only the sub-set of the evaluation graphs (named lpps) has released in MRP website on August 9, 2019. Is there any plan to release the whole set of the evaluation graphs? By this way, we could test our follow-up research work on this data.

Thank you for organizing this interesting shared task! We have learned a lot through this.

oepen commented 5 years ago

we are discussing the possibility of re-running the MRP shared task in 2020, hence have opted to be a bit protective of the full evaluation data for the time being.

please see the archives in the ‘mrp-participants’ mailing list for the possibility of having (a limited number of) additional, post-evaluation submissions scored by us.