What is the difference between `baseline` and `baseline_modelfree`? - Githubissues

hzwer / ICCV2019-LearningToPaint

ICCV2019 - Learning to Paint With Model-based Deep Reinforcement Learning

MIT License

2.25k stars 312 forks source link

What is the difference between `baseline` and `baseline_modelfree`? #45

Closed UdonDa closed 3 years ago

UdonDa commented 3 years ago

Hi, I have a question about your directory structure.

What is the difference between baseline and baseline_modelfree?

I think that they look the same.

Would you teach me the difference?

hzwer commented 3 years ago

Hi! I'sorry to replay you so late. The difference between the two is whether the renderer can conduct gradients. In other words, the model-free version requires the critic to model this painting task according to reward.