search

google-research / electra

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Apache License 2.0
2.31k stars 351 forks source link

Tagging Task Segment ids #131

Open kamalkraj opened 2 years ago

kamalkraj commented 2 years ago

Why Tagging Task segment ids are ones instead of zeros?

https://github.com/google-research/electra/blob/8a46635f32083ada044d7e9ad09604742600ee7b/finetune/tagging/tagging_tasks.py#L144

Tagging task only contains the first segment and it should be zeros, right?

@clarkkev