aimagelab / meshed-memory-transformer

Meshed-Memory Transformer for Image Captioning. CVPR 2020
BSD 3-Clause "New" or "Revised" License
507 stars 136 forks source link

About Rl training #81

Open superhero-7 opened 2 years ago

superhero-7 commented 2 years ago

Hi,dear author: Thanks your great job,I am rencently working on RL training in another task. I take your scst training code to reference, and I got a terrible result. My XE training is great,but after fintue by rl training for one epoch, the result crash heavily!!! Maybe my code is something wrong,but I also curious about whether there is any skill about rl training or not?Beacause I find that the loss beacome extremely unstable during rl training. If you have any advice, please tell me.I will appreciate very much if you can reply me as soon as possible!!!Thanks!!!!