search

nyu-mll / GLUE-baselines

[DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations
https://gluebenchmark.com
739 stars 164 forks source link

Has CoLA changed? #10

Closed davidefiocco closed 5 years ago

davidefiocco commented 5 years ago

Hi! I have seen that CoLA has hit release 1.1 https://nyu-mll.github.io/CoLA/.

Are the changes documented anywhere? Is this expected to impact GLUE benchmarks in any significant way?

W4ngatang commented 5 years ago

Hi David,

We saw that CoLA changed but are still evaluating on the old version (using the data available on the GLUE site). We'll soon release SuperGLUE, which has mostly different tasks than GLUE.