search

kengz / SLM-Lab

Modular Deep Reinforcement Learning framework in PyTorch. Companion library of the book "Foundations of Deep Reinforcement Learning".
https://slm-lab.gitbook.io/slm-lab/
MIT License
1.24k stars 264 forks source link

Any demo for soft actor critic on discrete action space? #436

Closed KK666-AI closed 4 years ago

KK666-AI commented 4 years ago

Cool Work.

It seems that you have implemented sac to support discrete action space. I wonder whether this project contains tiny demo from running soft actor critic on scenario of discrete action space.

Best, Ken

kengz commented 4 years ago

Hi @lihuiknight, yes, you can run any spec file using the lab command. For this particular case, u can run SAC on LunarLander, which is a discrete environment. For the command:

All in all, you can run it with the command

python run_lab.py slm_lab/spec/benchmark/sac/sac_lunar.json sac_lunar train

This should train within a few hours on a laptop.

Benchmark results and graphs can be found here