Question if models have the same tokenizer

prajjwal1 / generalize_lm_nli

Code for the paper EMNLP 2021 workshop paper "Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics"

GNU General Public License v3.0

27 stars 3 forks source link

Closed surya-narayanan closed 1 year ago

surya-narayanan commented 1 year ago

Hi,

quick question- do all the bert-(mini / tiny / medium / small) models have the same tokenizer?

prajjwal1 commented 1 year ago

Yes.