Closed clownrat6 closed 4 months ago
Because mistral update the tokenizer, some bugs occur when adopting previous requirements.txt.
requirements.txt
tokenizer bug: Error when loading tokenizer from a file: data did not match any variant of untagged enum ModelWrapper updating transformers==4.40.0 tokenizers==0.19.1 can fix this bug.
transformers==4.40.0 tokenizers==0.19.1
accelerate bug: TypeError: Accelerator.init() got an unexpected keyword argument 'use_seedable_sampler' updating accelerate==0.26.1 can fix this bug.
accelerate==0.26.1
Because mistral update the tokenizer, some bugs occur when adopting previous
requirements.txt.Items
tokenizer bug: Error when loading tokenizer from a file: data did not match any variant of untagged enum ModelWrapper updating
transformers==4.40.0 tokenizers==0.19.1can fix this bug.accelerate bug: TypeError: Accelerator.init() got an unexpected keyword argument 'use_seedable_sampler' updating
accelerate==0.26.1can fix this bug.