Langboat / Mengzi

Mengzi Pretrained Models
Apache License 2.0
534 stars 63 forks source link

mengzi-gpt-neo-base在huggingface上无法体验,有异常爆出 #51

Open liruixue opened 1 year ago

liruixue commented 1 year ago

如题, 错误信息: Can't load tokenizer using from_pretrained, please update its configuration: Can't load tokenizer for 'Langboat/mengzi-gpt-neo-base'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'Langboat/mengzi-gpt-neo-base' is the correct path to a directory containing all relevant files for a GPT2TokenizerFast tokenizer.

KosukeTrue commented 1 year ago

File "~/miniconda3/envs/mengzi/lib/python3.7/tarfile.py", line 187, in nti n = int(s.strip() or "0", 8) ValueError: invalid literal for int() with base 8: 'rebuild_'

During handling of the above exception, another exception occurred:

OSError: Unable to load weights from pytorch checkpoint file for 'mengzi-bert-base/pytorch_model.bin' at 'mengzi-bert-base/pytorch_model.bin'. If you tried to load a PyTorch model from a TF 2.0 checkpoint, please set from_tf=True.

KosukeTrue commented 1 year ago

torch版本不对,改成1.11或者以上

Oscar推荐的1.2.0版本不适用于Mengzi提供的模型