jurgisp / pydreamer

PyTorch implementation of DreamerV2 model-based RL algorithm
MIT License
205 stars 47 forks source link

Are Hybrid Observations (image + vector observation) Available? #15

Closed CarlDegio closed 1 year ago

CarlDegio commented 1 year ago

I found that minecraft's configuration has both vector and image observation states, is its function modal mixing?

jurgisp commented 1 year ago

Yes, if you specify vecobs_size in the config. See for example minececraft config https://github.com/jurgisp/pydreamer/blob/8a4ea85a925b57ddf24a221b41dfb3257f89d63a/config/defaults.yaml#L244

CarlDegio commented 1 year ago

But minecraft seems to be removed, so I'm not sure about that. Thank you for your answer.