search

openai / image-gpt

Other
2.04k stars 387 forks source link

Pre-trained models for Bert Objective? #13

Open skull3r7 opened 3 years ago

skull3r7 commented 3 years ago

I have tried to use the pre-trained models (s-GPT) with the Bert objective. However, this only generates noise.

Are there extra pre-trained models that were trained on the bert task?

I could not find anything in the download.py, bert is not mentioned there.

chenmarkGH commented 3 years ago

I just updated download.py to allow downloading bert models: https://github.com/openai/image-gpt/commit/c6af2ebf57e2460c71fefa53cd9054b060cf716d. Please remember to set the hparams.bert flag!