Closed rbahumi closed 4 years ago
TimeLimit wrapper there is no enforcement of maximum length.This can lead to a negative timestamp.
True, however, I don't think that's a problem. Also, we should not change the episode length if the user is not aware of that. The TimeFeatureWrapper
is only meant to add a feature, not to change the episode length.
the first episode should have a timestamp of 0 and the last a timestamp of 1:
It does not really matter, I did that to be consistent with this paper
Also, we should not change the episode length if the user is not aware of that.
Agree. Thanks for the quick replay.
Hi, Sorry for not making a proper pull request but I think it is better this way in the case of ipython notebooks.
The issue, in the case of not using TimeLimit wrapper there is no enforcement of maximum length. This can lead to a negative timestamp. Suggested fix:
In addition, and maybe I'm wrong here, but I think that the time calculation should be the other war around, and the first episode should have a timestamp of 0 and the last a timestamp of 1: