KeyError: 'optimizer'

[sugary199]

@PeizeSun hi， I met the same problem when funetuning the t2i model:

bash scripts/tokenizer/train_vq_finetune_continue.sh --cloud-save-path /data/vjuicefs_ai_camera_llm/11170092/00proj/LlamaGen/cloud_save --data-path /data/vjuicefs_ai_camera_llm/public_data/vivo_internal_data/AIPortrait/crop_imgs_ffhqcrop_png/20230703_fourth_fix-1_625 --image-size 256 --vq-model VQ-16 --dataset  coco --global-batch-size 32"

Does vq_ds16_t2i.pt also need to be updated?

Traceback (most recent call last):
  File "/data/vjuicefs_ai_camera_llm/11170092/00proj/LlamaGen/tokenizer/tokenizer_image/vq_train.py", line 320, in <module>
    main(args)
  File "/data/vjuicefs_ai_camera_llm/11170092/00proj/LlamaGen/tokenizer/tokenizer_image/vq_train.py", line 150, in main
    optimizer.load_state_dict(checkpoint["optimizer"])
KeyError: 'optimizer'
Traceback (most recent call last):
  File "/data/vjuicefs_ai_camera_llm/11170092/00proj/LlamaGen/tokenizer/tokenizer_image/vq_train.py", line 320, in <module>
    main(args)
  File "/data/vjuicefs_ai_camera_llm/11170092/00proj/LlamaGen/tokenizer/tokenizer_image/vq_train.py", line 150, in main
    optimizer.load_state_dict(checkpoint["optimizer"])
KeyError: 'optimizer'

[sugary199]

Or did I make a mistake somewhere? I would be very grateful if you could give me some help！

[PeizeSun]

Hi~ This is not the mistake in your side. It is because our released vq_ds16_t2i.pt doesn’t include optimizer parameters.

[sugary199]

Hi~ This is not the mistake in your side. It is because our released vq_ds16_t2i.pt doesn’t include optimizer parameters.

Thank you for response！ I was wondering if there are any plans to release an updated version with the necessary optimizer parameters？ Alternatively, is it possible to train without theses parameters? If you could provide some guidance or assistance, it would be extremely helpful for my work.

[Juice113]

I get the same problem when finetuning gptxl,
optimizer.load_state_dict(checkpoint["optimizer"]) KeyError: 'optimizer' t2i_XL_stage1_256.pt I wonder if this .pt file has the same problem? @PeizeSun thanks for your attention!