search

jbrry / Irish-BERT

Repository to store helper scripts for creating an Irish BERT model.
Other
9 stars 0 forks source link

What happens with sentences greater than 128 tokens in length with BERT #46

Open jbrry opened 3 years ago

jbrry commented 3 years ago

What vector representation does the BERT model provide if the sequence length is over 128 tokens? Over 512 tokens?

Look at some long sentences in ga_idt.