search

jangirrishabh / Overcoming-exploration-from-demos

Implementation of the paper "Overcoming Exploration in Reinforcement Learning with Demonstrations" Nair et al. over the HER baselines from OpenAI
MIT License
152 stars 30 forks source link

learning without demo #5

Open watashihageteru opened 5 years ago

watashihageteru commented 5 years ago

how to learn without demonstration?

jangirrishabh commented 5 years ago

Hello @watashihageteru this work is based on developing learning algorithms that can leverage the information from demonstrations to speed up the learning process. However if you wish to train your algorithm without the demonstration data you can try to put "num_demonstrations = 0", but I think there are some parts of the code that have to be commented out still.

KhurramPirov commented 5 years ago

Hello @watashihageteru this work is based on developing learning algorithms that can leverage the information from demonstrations to speed up the learning process. However if you wish to train your algorithm without the demonstration data you can try to put "num_demonstrations = 0", but I think there are some parts of the code that have to be commented out still.

Can you send your files with demonstrations? And please explain how to debug this:

File "/home/khurram/DL_skoltech/Research_hand/HER_overcoming_exploration/experiment/ddpg.py", line 155, in initDemoBuffer demoData = np.load(demoDataFile) File "/home/khurram/.local/lib/python3.6/site-packages/numpy/lib/npyio.py", line 422, in load fid = open(os_fspath(file), "rb") IsADirectoryError: [Errno 21] Is a directory: '/home/khurram/DL_skoltech/'

jangirrishabh commented 5 years ago

Hello @KhurramPirov I have sent the demo file to your email. About the error I think it's because you are not giving the correct path to the demo .npz file you might want to try something like /home/khurram/DL_skoltech/data_fetch_random_100.npz in the train.py file.

jangirrishabh commented 5 years ago

You need demoData = np.load(demoDataFile, allow_pickle=True) to get through the errors

chaiban commented 5 years ago

Hello @jangirrishabh @KhurramPirov , can you share the demo file ?. Thank you.

jnyanghit commented 4 years ago

Hello @jangirrishabh @KhurramPirov , can you share the demo file ? Thank you

jnyanghit commented 4 years ago

Hello @jangirrishabh @KhurramPirov , can you share the demo file ? Thank you

jangirrishabh commented 4 years ago

Hello, you can generate the demo file by running the python script located in data_generation/fetch_data_generation.py

Check out the file contents for more information, hope it helps

jnyanghit commented 4 years ago

Oh,I have find it, thanks a lot

Focusssss commented 4 years ago

@jnyanghit Hello! I am a chinese graduate student and reproducing the experiment's results. I want to communicate with you about it. Sorry for any interruption.

Focusssss commented 4 years ago

Hello @jangirrishabh @KhurramPirov , thanks for sharing the demo file. I need it urgently, please.

Focusssss commented 4 years ago

@jangirrishabh Hello, how to get the demos of the GazeboWAMemptyEnv-v1

Focusssss commented 4 years ago

@KhurramPirov @chaiban @jnyanghit Excuse me, how to deal with the env of GazeboWAMemptyEnv-v1? For example, how to get the demo of the env or how to import the env?