Use custom tokenizer

[JinSeoungwoo]

I want to add a token to the tokenizer of my Mistral model and train it. what settings should I change? Only embedding size?

[erfanzar]

yes in order to train you model with custom embedding layer and custom tokenizer you should only change the config and replace the wte data with old wte