pytorch / tutorials

PyTorch tutorials.
https://pytorch.org/tutorials/
BSD 3-Clause "New" or "Revised" License
8.28k stars 4.08k forks source link

💡 [REQUEST] - Port TorchRL `Pendulum` tutorial from pytorch.org/rl to pytorch.org/tutorials #2352

Closed vmoens closed 1 year ago

vmoens commented 1 year ago

🚀 Descirbe the improvement or the new tutorial

For historical reasons, TorchRL privately hosts a bunch of tutorials. We'd like to bring the most significant ones to pytorch tutorials for more visibility.

Here is the tutorial.

Environments (or simulators) are a core part of many RL algorithms. The OpenAI Gym API has had a great success in the past years and paved the way for RL researchers to quickly test ideas with an easy-to-use tool. As a PyTorch-first library, torchrl aims at being (1) oblivious to the simulator (gym or other), (2) rely on pytorch for anything we can in the simulation process, (3) a good integration within the library and (4) a coverage of many different types of environments (simulators, real-life hardware, model-based, RLHF etc). For these reasons, TorchRL propose its own class of environments. We have a dedicated tutorial that covers their design and usage: you can help us port it where it belongs!

Steps:

  1. Port the tutorial from the RL repo to the tutorials repo.
  2. Fix any formatting issues or typos.
  3. Make sure the tutorial follows the tutorial template (template_tutorial.py)
  4. Preserve the original author

Existing tutorials on this topic

No response

Additional context

The tutorial should not require extra dependencies beyond those already present in requirements.txt

cc @nairbv @sekyondaMeta @svekars @carljparker @NicolasHug @kit1980 @subramen @jgong5 @mingfeima @XiaobingSuper @sanchitintel @ashokei @jingxu10 @ZailiWang @ZhaoqiongZ @leslie-fang-intel @Xia-Weiwen @sekahler2 @CaoE @zhuhaozhe @Valentine233

Samsonboadi commented 1 year ago

/Assigntome

svekars commented 1 year ago

This issue has been unassigned due to inactivity. If you are still planning to work on this, you can still send a PR referencing this issue.

IvanLauLinTiong commented 1 year ago

/assigntome

krishnakalyan3 commented 1 year ago

/assigntome