search

matterport / habitat-matterport-3dresearch

355 stars 31 forks source link

THe Observation problems #38

Closed Zanghu-ze closed 1 month ago

Zanghu-ze commented 1 month ago

Hello,

First of all, thank you for providing such an excellent dataset and tool!

I encountered an issue while using HabitatSim to control an agent with an RGB camera. Specifically, I noticed that some black blocks appeared in the rendered observations during normal scenario runs. Could you please provide any guidance or suggestions on how to address this issue? I'm curious if there are any recommended settings or adjustments that could help avoid these rendering problems. (You can see the black blocks on the right side of the image)

image
aclegg3 commented 1 month ago

Hey Zanghu,

Glad you are finding the dataset useful. I don't see anything unexpected in the image. Many scanned assets, especially from older methods tend to have holes in the mesh caused by occlusion in the scanned images. These look like standard scan holes. I have seen GPU bugs with black blocks before. E.g. https://github.com/facebookresearch/habitat-sim/issues/2310

Best,

Alex

On Fri, Oct 11, 2024 at 4:52 AM Zanghu-ze @.***> wrote:

Hello,

First of all, thank you for providing such an excellent dataset and tool!

I encountered an issue while using HabitatSim to control an agent with an RGB camera. Specifically, I noticed that some black blocks appeared in the rendered observations during normal scenario runs. Could you please provide any guidance or suggestions on how to address this issue? I'm curious if there are any recommended settings or adjustments that could help avoid these rendering problems. (You can see the black blocks on the right side of the image) image.png (view on web) https://github.com/user-attachments/assets/0b2879ae-7ade-4650-8995-99434fcc13df

— Reply to this email directly, view it on GitHub https://github.com/matterport/habitat-matterport-3dresearch/issues/38, or unsubscribe https://github.com/notifications/unsubscribe-auth/AALA2F4EBNMRXRPB4GXI4R3Z263YXAVCNFSM6AAAAABPYYOCDWVHI2DSMVQWIX3LMV43ASLTON2WKOZSGU4DCMJZHAYTCOI . You are receiving this because you are subscribed to this thread.Message ID: @.***>

Zanghu-ze commented 1 month ago

Thanks, Alex, I think your suggestion and solution are useful. I will try to refer to the link that you mentioned to check this problem. I will close this issue if there are no more other questions.