Ucas-HaoranWei / Vary-toy

Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)
565 stars 41 forks source link

RuntimeError: Input type (c10::Half) and bias type (float) should be the same #24

Open Gary-code opened 4 months ago

Gary-code commented 4 months ago

we have no A100 GPU to train this model. How can we train this model with fp16?