search

tgangwani / BMIL

Pytorch code for "Learning Belief Representations for Imitation Learning in POMDPs" (UAI 2019)
17 stars 5 forks source link

How should I get the expert data? #2

Open nishizawa7276 opened 4 years ago

nishizawa7276 commented 4 years ago

I think I can't start learning because there is no expert data. However, I do not know how to create expert data. Please teach me how to create expert data.

zbzhu99 commented 4 years ago

The path to putting the expert data and the format of expert data are mentioned in README:

Expert trajectories Please update the path to expert trajectories in the file "code/conf/envParams.yaml". Also see the storage requirements in "code/expert_envs.py" and modify as per convenience.

I think you can write some rule policy or train an expert policy with forward RL algos and use these policies to roll out in the envs and store the observations and actions with pickle. Maybe you can refer to expert data generation part in stable-baselines GAIL.