allenai / ai2thor

An open-source platform for Visual AI.
http://ai2thor.allenai.org
Apache License 2.0
1.16k stars 215 forks source link

Scene Dump Creation #390

Open KaranManghi opened 4 years ago

KaranManghi commented 4 years ago

Hi, I needed some help with creating scene dumps like the ones provided to us in the Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning paper. Is there some code which I can use to create the scene dumps? I will need the agent to move around and collect data and make scene dumps at every location. And hence I would need a script to move the robot around autonomously too I guess. So is there some script to do both these tasks? Thanks.....

ekolve commented 4 years ago

We don't have any scripts to perform scene dumping, but its fairly simple to do this. Use GetReachablePositions (https://ai2thor.allenai.org/ithor/documentation/actions/agent-navigation/#get-reachable-positions) to find all the locations the agent can reach. Then use TeleportFull (https://ai2thor.allenai.org/ithor/documentation/actions/agent-navigation/#teleportfull) to send the agent to each location with a specific location with rotation/horizon values. For each TeleportFull you can save off the event.metadata and event.frame data.