search

allenai / robothor-challenge

RoboTHOR Challenge
https://ai2thor.allenai.org/robothor/challenge/
Apache License 2.0
81 stars 15 forks source link

Agent has access to RGB or RGBD observation? #22

Closed Dhiraj100892 closed 4 years ago

Dhiraj100892 commented 4 years ago

On the Embodied AI workshop webpage, it is mentioned that RoboTHOR challenge has access to RGBD observation. However in the code only RGB observation has been provided to agent.

ekolve commented 4 years ago

I have just pushed a change https://github.com/allenai/robothor-challenge/commit/f052b754c347ee6898ecbed92a9c0096383a3060

You can either pull the change in or duplicate the change locally.

You will need to modify this file : https://github.com/allenai/robothor-challenge/blob/master/dataset/challenge_config.yaml to add to the `initialize section.

    renderDepthImage: True

Keep in mind that RGBD is not available at evaluation time for the leaderboard.

dhruvbatra commented 4 years ago

Keep in mind that RGBD is not available at evaluation time for the leaderboard.

Did something change? I thought we did agree on RGBD. Or am I misremembering?

roozbehm commented 4 years ago

There are two tracks now: RGB and RGBD. The RGB track models have access to depth data only during training (not evaluation).