facebookresearch / habitat-lab

A modular high-level library to train embodied AI agents across a variety of tasks and environments.
https://aihabitat.org/
MIT License
1.93k stars 481 forks source link

HITL - Add object visbility handling and hide "self" in viewports. #1959

Closed 0mdc closed 4 months ago

0mdc commented 4 months ago

Motivation and Context

This leverages instance metadata keyframes to hide objects in viewports.

It introduces the concept of "visibility layers".

This also changes rearrange_v2 such as the user's agent is hidden from the first person view.

Notes

Depends on:

Agents are now transparent to selection, so they won't be interfering with UI flow:

Examples

Before:

https://github.com/facebookresearch/habitat-lab/assets/110583667/7834dd94-b1a8-4147-8c80-b325d37c9118

After:

https://github.com/facebookresearch/habitat-lab/assets/110583667/7b0e4c6f-168e-4620-bde3-00c57b6f97e6

How Has This Been Tested

Tested on multiplayer HITL.

Types of changes

Checklist