Update about the coming soon FLUE tasks

Tixierae commented 4 years ago

Hi! Thank you for your open source initiative, and for creating FLUE. I was wondering if you could provide us with an update about when the code and data will be released for the following tasks, which are listed as 'coming soon' on the website:

5.1. Verb Sense Disambiguation

Named Entity Recognition
Question Answering

We are developing our own language model and would like to evaluate it across all FLUE tasks. Thank you!

formiel commented 4 years ago

Hi @Tixierae,

Thank you for your interest in the FLUE benchmark!

Regarding NER and QA, we unfortunately haven't been able to work that out yet. I hope I can find some time to work on this over the next months. To avoid confusion, I will remove them from the README, sorry about that!

Regarding Disambiguation, @loic-vial could you please help on this?

VSegonne commented 4 years ago

Hi, Regarding VSD, This will be available in the next few weeks. Best regards, VS

Le ven. 3 juil. 2020 à 01:49, formiel notifications@github.com a écrit :

Hi @Tixierae https://github.com/Tixierae,

Thank you for your interest in the FLUE benchmark!

Regarding NER and QA, we unfortunately haven't been able to work that out yet. I hope I can find some time to work on this over the next months. To avoid confusion, I will remove them from the README, sorry about that!

Regarding Disambiguation, @loic-vial https://github.com/loic-vial could you please help on this?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/getalp/Flaubert/issues/29#issuecomment-653263744, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEEH3YHW5VAPUSRJRCIILITRZUMJ7ANCNFSM4OMN2SKA .

Tixierae commented 4 years ago

Thank you both for the quick replies and the updates! We will stay tuned!

getalp / Flaubert

Update about the coming soon FLUE tasks #29