search

thu-coai / CDial-GPT

A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models
MIT License
1.76k stars 255 forks source link

from pretrian error #64

Closed iris-qq closed 2 years ago

iris-qq commented 3 years ago 
from transformers import AutoTokenizer

tokenizer = AutoTokenzier.from_pretrain("thu-coai/CDial-GPT2_LCCC-base")

Unrecognized model in thu-coai/CDial-GPT2_LCCC-base. Should have a model_type key in its config.json, or contain one of the following strings in its name: wav2vec2, convbert, led, blenderbot-small, retribert, mt5, t5, mobilebert, distilbert, albert, bert-generation, camembert, xlm-roberta, pegasus, marian, mbart, mpnet, bart, blenderbot, reformer, longformer, roberta, deberta, flaubert, fsmt, squeezebert, bert, openai-gpt, gpt2, transfo-xl, xlnet, xlm-prophetnet, prophetnet, xlm, ctrl, electra, encoder-decoder, funnel, lxmert, dpr, layoutlm, rag, tapas

lemon234071 commented 3 years ago

You should follow our instruction instead of using AutoTokenizer