siddhanthaldar / BAKU

Code for BAKU: An Efficient Transformer for Multi-Task Policy Learning
https://baku-robot.github.io/
70 stars 5 forks source link

Inconsistency between the training data and the eval’s image rendering in MetaWorld. #10

Closed AdaChambers closed 1 month ago

AdaChambers commented 1 month ago

When I run python eval.py agent=baku suite=metaworld dataloader=metaworld suite/task=metaworld suite.hidden_dim=256 bc_weight=weights/metaworld/baku.pt use_proprio=false I find that the image of the eval rollout is like: image

However the image in the metaworld expert_demo dataset is like: image

The inconsistency may cause bad performance (almost 0% success rate) of the pretrained model. So a natural question is whether the Metaworld‘s env_wrapper rendering code is missing some image cropping operations or something else? Looking forward to anyone's response!

ATriplez commented 1 month ago

Hi, I had the same problem at first. At last I found out that the cause was my own installation of metaworld rather than using the version provided by the author which is below. I hope it will be helpful.

https://github.com/siddhanthaldar/Metaworld/tree/65a7c33c8326cadfef7e19590af98b2bf2640cb7

siddhanthaldar commented 1 month ago

I am closing this issue since it seems solved.