hideaki-j / convsrch_literature_survey

Conversational search literature survey

0 stars 0 forks source link

Coreference Resolution without Span Representations (ACL21) #1

Open hideaki-j opened 3 years ago

hideaki-j commented 3 years ago

Coreference Resolution without Span Representations (ACL21)

Contribution summary

Kirstain et al. proposed s2e (start-to-end) coref model, a simple and efficient transformer-based coref model,
to mitigate large memory footprint
and achieved three times better memory efficiency.

Authors

Yuval Kirstain, Ori Ram, and Omer Levy (Tel Aviv University)

Motivation

The previous method uses span representation to perform coref, which requires O(n²d) space and much GPU memory.

Method

The proposed method uses only span boundaries (ie, its start and end tokens); here there is no representation for each span (but just for boundaries), leading smaller space.

Screen Shot 2021-09-02 at 11 12 40 AM

Results / Insight

Three times more (GPU) memory efficient, without deteriorating the performance.

hideaki-j commented 3 years ago

Others

Code: https://github.com/yuvalkirstain/s2e-coref