facebookresearch / rlmeta

RLMeta is a light-weight flexible framework for Distributed Reinforcement Learning Research.
MIT License
284 stars 28 forks source link

Separate C++ and Python APIs for SegmentTree #66

Closed xiaomengy closed 2 years ago

xiaomengy commented 2 years ago

This PR made the following changes.

  1. Separate C++ and Python APIs for SegmentTree so that it can be used in future C++ modules.
  2. Add Resize and ShrinkToFit Apis for SegmentTree
  3. Remove MinSegmentTree and use batch min instead of global min in PrioritizedReplayBuffer.