Fail to load GPT2 pretrained model for attribute controled generation

XiangLi1999 / Diffusion-LM

Diffusion-LM

Apache License 2.0

1.02k stars 133 forks source link

Fail to load GPT2 pretrained model for attribute controled generation #58

Open Rongzhi-Dong opened 1 year ago

Rongzhi-Dong commented 1 year ago

When I run the control generation code Diffusion-LM/improved-diffusion/scripts/infill.py : model_control = Classifier_GPT2.from_pretrained('predictability/diff_models/e2e-back_e=6_b=10_m=gpt2_wikitext-103-raw-v1_101_wp_full_multi16_t_aware').cuda() I got this attribute error: AttributeError: 'GPT2Config' object has no attribute 'input_emb_dim'