search

mandarjoshi90 / coref

BERT for Coreference Resolution
Apache License 2.0
441 stars 92 forks source link

Question about a Independent. #15

Closed fairy-of-9 closed 4 years ago

fairy-of-9 commented 4 years ago

I have a question about a Independent.

If I use Independent and max_segment_len = 128, It divide all documents into 128 tokens. After 128 tokens enter BERT, It will make an embedding for them.

In this situation, (1) Is it looking for a antecedent only within the 128 tokens? OR (2) Put all segments in BERT and get embedding for all tokens. and after that, Is it looking for a antecedent within all token?

mandarjoshi90 commented 4 years ago

It's (2). Here's where the segments are being merged.

https://github.com/mandarjoshi90/coref/blob/master/independent.py#L264

fairy-of-9 commented 4 years ago

Thank you!