thiagopbueno / model-aware-policy-optimization

MAPO: Model-Aware Policy Optimization algorithm
GNU General Public License v3.0
1 stars 0 forks source link

feat: use observed samples when branching factor is 0 #75

Closed 0xangelo closed 5 years ago

0xangelo commented 5 years ago

Use the next state from each observed transition (s,a,r,s) in losses.actor_model_aware_loss if config["branching_factor"] is set to 0.

I've run the following command to check that everything runs as intended

mapo --run MAPO --env Navigation-v0  --branching-factor 0 --use-true-dynamics --config-actor-net actor-1024-relu.json --config-critic-net critic-1024-relu.json --actor-lr 1e-4 --critic-lr 1e-4 --sample-batch-size 1 --train-batch-size 2048 --num-samples 4 --name nav0-mapo-true-dynamics-fcnet-1024

Closes #74