facebookresearch / habitat-sim

A flexible, high-performance 3D simulator for Embodied AI research.
https://aihabitat.org/
MIT License
2.54k stars 414 forks source link

--Add Panoptic/Instance ID support to Semantic sensor #2316

Closed jturner65 closed 6 months ago

jturner65 commented 7 months ago

Motivation and Context

This PR will add the ability to have the semantic sensor produce images containing object ID of the objects rendered per-pixel in the same way that it currently produces semantic ID observations.

Until this PR in habitat-lab is merged, this PR will fail on lab tests due to hard-coded references to the stage ID.

NOTE (side thesis): This PR also refactors many uses of Eigen vec classes to Magnum instead.

How Has This Been Tested

Locally c++ and python tests pass

Types of changes

Checklist