search

askforalfred / alfred

ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
MIT License
360 stars 77 forks source link

Is the behavior of AI2THOR 2.1.0 different in linux/mac? #76

Open soyeonm opened 3 years ago

soyeonm commented 3 years ago

Hello,

Are there any known issues of AI2THOR 2.1.0 returning different RGB view/ depth view/ or other metadata across linux/ mac?

For my own experimentation, I am using the same inputs as the original ALFRED paper + depth obtained from AI2THOR. I get different results across linux/ mac.

Do you have any insight on this?

Thanks!

MohitShridhar commented 3 years ago

@soyeonm all our experiments were run on Linux.

I haven't tested THOR or ALFRED on OSX extensively, but I vaguely remember a user having a similar issue with inconsistent RGB images on OSX. For better reproducibility, I would recommend the Docker Setup which uses an Ubuntu image.

nikepupu commented 3 years ago

The depth map on ai2thor mac version is not correct.