search

THUDM / VisualGLM-6B

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型
Apache License 2.0
4.09k stars 416 forks source link

qformer微调 #255

Open MoramiSu opened 1 year ago

MoramiSu commented 1 year ago

我想根据BLIP2对vit和qformer进行一阶段微调，请问visualglm的qformer是如何进行初始化的？word2vec的权重是什么呢？