Closed DY-TL closed 7 months ago
[root@ llm-export]# python llm_export.py --path ../qwen --export_split --type Qwen-VL-Chat
The device support i8sdot:0, support fp16:0, support i8mm: 0 You are using a model of type qwen to instantiate a model of type Qwen/Qwen-VL. This is not supported for all configurations of models and can yield errors. Traceback (most recent call last): File "/home/dyb/llm-export/llm_export.py", line 887, in <module> llm_exporter = llm_models[model_type](args) File "/home/dyb/llm-export/llm_export.py", line 596, in __init__ super().__init__(args) File "/home/dyb/llm-export/llm_export.py", line 91, in __init__ self.load_model(args.path) File "/home/dyb/llm-export/llm_export.py", line 599, in load_model self.tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True) File "/tmp/qwen/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 730, in from_pretrained raise ValueError( ValueError: Unrecognized configuration class <class 'transformers_modules.qwen.configuration_qwen.QWenConfig'> to build an AutoTokenizer. Model type should be one of AlbertConfig, AlignConfig, BartConfig, BertConfig, BertGenerationConfig, BigBirdConfig, BigBirdPegasusConfig, BioGptConfig, BlenderbotConfig, BlenderbotSmallConfig, BlipConfig, Blip2Config, BloomConfig, BridgeTowerConfig, CamembertConfig, CanineConfig, ChineseCLIPConfig, ClapConfig, CLIPConfig, CLIPSegConfig, CodeGenConfig, ConvBertConfig, CpmAntConfig, CTRLConfig, Data2VecTextConfig, DebertaConfig, DebertaV2Config, DistilBertConfig, DPRConfig, ElectraConfig, ErnieConfig, ErnieMConfig, EsmConfig, FlaubertConfig, FNetConfig, FSMTConfig, FunnelConfig, GitConfig, GPT2Config, GPT2Config, GPTBigCodeConfig, GPTNeoConfig, GPTNeoXConfig, GPTNeoXJapaneseConfig, GPTJConfig, GPTSanJapaneseConfig, GroupViTConfig, HubertConfig, IBertConfig, InstructBlipConfig, JukeboxConfig, LayoutLMConfig, LayoutLMv2Config, LayoutLMv3Config, LEDConfig, LiltConfig, LlamaConfig, LongformerConfig, LongT5Config, LukeConfig, LxmertConfig, M2M100Config, MarianConfig, MBartConfig, MegaConfig, MegatronBertConfig, MgpstrConfig, MobileBertConfig, MPNetConfig, MraConfig, MT5Config, MvpConfig, NezhaConfig, NllbMoeConfig, NystromformerConfig, OneFormerConfig, OpenAIGPTConfig, OPTConfig, OwlViTConfig, PegasusConfig, PegasusXConfig, PerceiverConfig, Pix2StructConfig, PLBartConfig, ProphetNetConfig, QDQBertConfig, RagConfig, RealmConfig, ReformerConfig, RemBertConfig, RetriBertConfig, RobertaConfig, RobertaPreLayerNormConfig, RoCBertConfig, RoFormerConfig, RwkvConfig, Speech2TextConfig, Speech2Text2Config, SpeechT5Config, SplinterConfig, SqueezeBertConfig, SwitchTransformersConfig, T5Config, TapasConfig, TransfoXLConfig, UMT5Config, ViltConfig, VisualBertConfig, Wav2Vec2Config, Wav2Vec2ConformerConfig, WhisperConfig, XCLIPConfig, XGLMConfig, XLMConfig, XLMProphetNetConfig, XLMRobertaConfig, XLMRobertaXLConfig, XLNetConfig, XmodConfig, YosoConfig.
[root@ llm-export]# python llm_export.py --path ../qwen --export_split --type Qwen-VL-Chat