Unity-Technologies / ml-agents

The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
https://unity.com/products/machine-learning-agents
Other
16.59k stars 4.09k forks source link

Add depth map support for camera sensor #6125

Open clementinboittiaux opened 4 days ago

clementinboittiaux commented 4 days ago

Proposed change(s)

Add depth map support for camera sensor. Also add OpenEXR support for frame encoding.

Useful links (Github issues, JIRA tickets, ML-Agents forum threads etc.)

Types of change(s)

Checklist

Other comments

RGBD option has priority over Grayscale option. Compatibility should not be broken with previous versions.

The depth component is stored in the image alpha channel. Float RenderTexture and Texture32, as well as OpenEXR encoding ensure that depth is not compressed to 8-bits.

N.B. Adding compression flags to EXR encoding slows down the read/write rate.

Screencast from 27-06-2024 09:43:00.webm

CLAassistant commented 4 days ago

CLA assistant check
All committers have signed the CLA.