search

owl-project / NVISII

Apache License 2.0
332 stars 28 forks source link

Static noise in generated images. #170

Open rpapallas opened 12 months ago

rpapallas commented 12 months ago

Hello,

Thank you for this great library! I have used it in conjunction with DOPE to create synthetic data and re-train dope with custom objects. However, sometimes, the library will generate images with static noise. Please see a screenshot below. This happens randomly and re-running the same script multiple times would generate fine images but sometimes it will generate images like the one attached. I use this script.

Initially I thought it’s our graphics card / OS, but I tested it on two machines:

  1. Ubuntu 20.04 with RTX 3080, driver 535.129.03, CUDA 12.2
  2. Ubuntu 20.04 with RTX 4090, driver 535.129.03, CUDA 12.2

NVISII version: 1.1.72 on both machines.

Again note that this doesn’t happen all the time, but frequently enough. I don’t think this is part of the domain randomisation as the image is too noisy?

An example of problematic image:

IMG_0111

An example of a good image:

IMG_0112

TontonTremblay commented 12 months ago

This is caused by the newest version of optix denoiser which we did not integrate with. Sadly I do not have an easy solution rather than downgrading your drivers. I ran into the same problems with 535, which you need for the most recent cards. If you turn off the denoiser you should have "ok" images, but you will get a lot of noise in the images.

@natevm maybe we could add to feature request?

rpapallas commented 12 months ago

Thank you for the quick response, Jonathan.

rpapallas commented 11 months ago

I can confirm that downgrading to 525.147.05 fixed this issue. Feel free to close this issue, unless you want to convert it to feature request. Thank you again for your time.