I am wondering if there is a straightforward way to produce a related form of the topdown 2d map that is sent as an observation each time step. Instead of coloring by occupancy, is it possible to color by the semantic class of the object which is occupying that region? This seems related to the roomIndex map that one can produce using export_navgrids.js, but it would use properties of all the objects, and not necessarily the room type. I don't see exactly how to i) generate this ahead of time once per world (by modifying export_navgrids.js?), or ii) how to send that new 2d map to the agent through the python bindings. Any suggestions?
I am wondering if there is a straightforward way to produce a related form of the topdown 2d map that is sent as an observation each time step. Instead of coloring by occupancy, is it possible to color by the semantic class of the object which is occupying that region? This seems related to the
roomIndexmap that one can produce usingexport_navgrids.js, but it would use properties of all the objects, and not necessarily the room type. I don't see exactly how to i) generate this ahead of time once per world (by modifyingexport_navgrids.js?), or ii) how to send that new 2d map to the agent through the python bindings. Any suggestions?