search

werner-duvaud / muzero-general

MuZero
https://github.com/werner-duvaud/muzero-general/wiki/MuZero-Documentation
MIT License
2.46k stars 606 forks source link

Why is continuous branch not merged into master? #137

Open outdoteth opened 3 years ago

outdoteth commented 3 years ago

Why not merge it and put add a configuration flag to toggle between continuous and discrete

werner-duvaud commented 3 years ago

Hi,

The continuous version is still in development and the continuous branch is not up to date. Also merging the two versions risks making the code more complicated to understand, especially since it's based on the pseudocode and the original version of MuZero is only discreet.

MartinEthier commented 3 years ago

Hello @werner-duvaud, the authors of MuZero have recently published a follow-up paper where they created their own adaptation of MuZero for continuous action spaces (link: https://arxiv.org/abs/2104.06303). Are there plans to implement the changes highlighted in this paper for the continuous branch in this repo?