Open brewswang opened 1 year ago
ValueError: Asking to pad but the tokenizer does not have a padding token. Please select a token to use as pad_token (tokenizer.pad_token = tokenizer.eos_token e.g.) or add a new pad token via tokenizer.add_special_tokens({'pad_token': '[PAD]'}).
pad_token
(tokenizer.pad_token = tokenizer.eos_token e.g.)
tokenizer.add_special_tokens({'pad_token': '[PAD]'})
ValueError: Asking to pad but the tokenizer does not have a padding token. Please select a token to use as
pad_token(tokenizer.pad_token = tokenizer.eos_token e.g.)or add a new pad token viatokenizer.add_special_tokens({'pad_token': '[PAD]'}).