strubell / LISA

Linguistically-Informed Self-Attention implemented in TensorFlow
Apache License 2.0
201 stars 27 forks source link

eval the model with golden parsing #1

Open GaryYufei opened 6 years ago

GaryYufei commented 6 years ago

I am wondering if there is a place to config the eval with the golden parsing?

strubell commented 5 years ago

Sure, in parse_attention.json if you change:

"eval_attention_to_copy": {
    "layer": "parse_head",
    "output": "scores"
}

to:

"eval_attention_to_copy": {
    "label": "parse_head"
}

that should evaluate using the gold parse head labels.