search

Vision-CAIR / MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
https://minigpt-4.github.io
BSD 3-Clause "New" or "Revised" License
25.45k stars 2.92k forks source link

minigpt4_stage2_finetune dataset problem #245

Open magicwang1111 opened 1 year ago

magicwang1111 commented 1 year ago

model: arch: mini_gpt4 model_type: pretrain_vicuna freeze_vit: True freeze_qformer: True max_txt_len: 160 end_sym: "###" prompt_path: "prompts/alignment.txt" prompt_template: '###Human: {} ###Assistant: ' ckpt: '/path/to/stage1/checkpoint/'

Is the ckpt setting here pointing to vicuna or pretrained_minigpt4_13B.pth，I have trained 5000 pictures but only 45mb size , I see others only trained 3000 pictures but have 6g size.

TsuTikgiau commented 1 year ago

ckpt here points to the linear mapping layer (pretrained_minigpt4_13B.pth).