search

ruotianluo / ImageCaptioning.pytorch

I decide to sync up this repo and self-critical.pytorch. (The old master is in old master branch for archive)
MIT License
1.43k stars 409 forks source link

SCST on Diffusion Model #174

Open vinevix opened 1 year ago

vinevix commented 1 year ago

Hi, I'm trying to use SCST on a diffusion model for image captioning. It uses Cross Entropy Loss but it's trained on global features (and not local ones), is there any way reinforcement learning is going to work on a model like this?

ruotianluo commented 1 year ago

It does not matter if you use global or local. The FC model is using global feature and can be applied reinforcement learning.