search

FreedomIntelligence / LLMZoo

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
Apache License 2.0
2.93k stars 201 forks source link

BloomTokenizer does not exist #33

Open porridgeshoes opened 1 year ago

porridgeshoes commented 1 year ago

how to fix this error：Tokenizer class BloomTokenizer does not exist or is not currently imported. 图片 my transformers version is 4.30.0.dev0.

panyuyang commented 1 year ago

use: AutoTokenizer.from_pretrained(model_path, use_fast=True)