facebookresearch / habitat-lab

A modular high-level library to train embodied AI agents across a variety of tasks and environments.
https://aihabitat.org/
MIT License
1.93k stars 481 forks source link

Bug in head-camera pose update in `KinematicHumanoid`, disrupts depth-based perception #1995

Open zephirefaith opened 3 months ago

zephirefaith commented 3 months ago

Habitat-Lab and Habitat-Sim versions

Habitat-Lab: main

Habitat-Sim: v0.3.1

Habitat is under active development, and we advise users to restrict themselves to stable releases of Habitat-Lab and Habitat-Sim. The bug you are about to report may already be fixed in the latest version.

Master branch contains 'bleeding edge' code, but we do appreciate bug reports for it!

🐛 Bug

KinematicHumanoid controller does not update head cameras to include base-rotation. Even though the depth and rgb images from sensors are aligned and make sense, the camera-pose associated with them (as read from sensor-mgr) do not.

Steps to Reproduce

Steps to reproduce the behavior:

1. 2. 3.

Please note that without a minimal working example to reproduce the bug, we may not be able to help you.

Expected behavior

Additional context