facebookresearch / habitat-sim

A flexible, high-performance 3D simulator for Embodied AI research.
https://aihabitat.org/
MIT License
2.54k stars 412 forks source link

Rendering equirectangular images from replica in HDR (.hdr or .exr) #988

Open elientumba2019 opened 3 years ago

elientumba2019 commented 3 years ago

❓ Questions and Help

Hello. Thanks for this amazing platform.

I have the following questions :  1) How do I render hdr (.hdr, .exr not rgba) images from the replica dataset using habitat-sim? 2) How do I render equirectangular images?

Thank you

Skylion007 commented 3 years ago
  1. See the example from Habitat-Lab about how to render equirect images from a cubemap.
  2. Pretty sure Magnum supports reading/writing HDR files, but I don't know if we actually support HDR rendering in Habtiat-Sim. @bigbike @mosra
elientumba2019 commented 3 years ago

@bigbike , @mosra . Hello, I hope you are well. Does habitat support writing HDR files? exr, or hdr. Specifically for the replica dataset as it comes with high dynamic range textures. Thank you

waldenlakes commented 3 years ago

@mosra @bigbike I also want to know how to render HDR images. Looking forward to your help. Thank you!

mosra commented 3 years ago

Magnum does support writing HDR and EXR files but Habitat isn't ready for that right now -- it always renders to a 8-bit framebuffer. It would need to be updated (here, here and probably some other places as well) to add an option for 16-/32-bit float output next to 8-bit.

waldenlakes commented 3 years ago

Magnum does support writing HDR and EXR files but Habitat isn't ready for that right now -- it always renders to a 8-bit framebuffer. It would need to be updated (here, here and probably some other places as well) to add an option for 16-/32-bit float output next to 8-bit.

Thanks alot for your help and I have been able to render HDR images.

Skylion007 commented 3 years ago

@waldenlakes PR welcome.