Open CaptXiong opened 2 years ago
The tokenizer.vocab_size is 30522, however it should be 28996 which is just the same with config.vocab_size. I suggust that we can just download the model from hugging face.
The tokenizer.vocab_size is 30522, however it should be 28996 which is just the same with config.vocab_size. I suggust that we can just download the model from hugging face.