Closed sarthusarth closed 1 year ago
Is the token prefix specified in your config.json file?
Yeah as @guustfranssensEY mentioned, make sure you have the prefix. This is an example from model-config.yaml:
roberta-base:
embedding: 'embeddings.word_embeddings'
type: 'mlm'
activations:
- '\d+\.output\.dense'
token_prefix: 'Ġ'
partial_token_prefix: ''
Thanks now I can load my model. But I get this error now, what am I missing ?
That's an odd and unfamiliar error. Were you able to resolve it?
Trying to use a custom trained Roberta model by loading the config file but getting the error the token prefix is not present in the config. Any idea how to fix it?