Hey, thanks for this great repository! I am a beginner in RL and I am trying to understand the practical implementation of TRPO.
What is the purpose of multiplying the variable 'mask' while computing advantage (in estimate_advantage() function)?
And what range of values do 'masks' take?
Since we are concatenating all episodes together inside the batch, mask is to make sure that rewards from previous episodes are not added to the current episode.
Hey, thanks for this great repository! I am a beginner in RL and I am trying to understand the practical implementation of TRPO. What is the purpose of multiplying the variable 'mask' while computing advantage (in estimate_advantage() function)? And what range of values do 'masks' take?
Thanks!