gemcollector / PIE-G

This is the repo of NeurIPS 2022 paper: "Pre-Trained Image Encoder for Generalizable Visual Reinforcement Learning"
MIT License
12 stars 2 forks source link

DeepMind manipulation task and Drawer World #1

Closed zichunxx closed 3 months ago

zichunxx commented 3 months ago

Hi! @gemcollector

Could you please update the training script and associated tasks to include the Deepmind manipulation task and Drawer World mentioned in your paper? I'd like to reproduce the results in your paper and see how the model performs with more tasks.

Looking forward to your reply! Thanks in advance!

gemcollector commented 3 months ago

Hello zichun! Sorry for the late reply! The drawer world is introduced from https://github.com/frank-xwang/VAI-ReinforcementLearning/. You can check this link to access the environment. If you want to reproduce the results, please carefully check the hyper-parameters. The Deepmind manipulation task is modified from the original dm-control tasks. You should manually change the mujoco setting of each scene. It's a little bit complicated.

Actually, I recommend you to use the https://github.com/gemcollector/RL-ViGen, and the robosuite part will match your requirements. :) If you have further questions, please let me know. :)

zichunxx commented 3 months ago

Thanks for your patient response, I will dive into the RL-ViGen.