"Ghost" artefacts in rendered images

[Tachimura]

Hello, I've been working with the perception package for a while now with some URP simulations. For some reason (URP not using alpha for background, etc...) i'm currently trying it out with HDRP but i am stuck with a problem.

Describe the bug

I'm trying to render some images but I'm having a strange "ghost" effect. Starting from the second rendered image i have all the previous renders greyed out in the background.

Here you can see the first render which is fine:

In the second render you can see the first render being greyed in the background:

From this point on all the previous renders (greyed out) keep getting stacked one over the other in the background:

In the Instance Segmentation images only the correct objects are labelled (which is good):

General Information

1. Unity version in use: 2021.3.15f1
2. Unity-Perception version in use: 1.0.0-preview.1

Additional context

1. I'm using the HDRP rendering pipeline, all set to its default values (only the color buffer format is set to R16G16B16A16).
2. All the perception settings are set to their default value.
3. All the "greyed objects" are correctly destroyed before the next render (i currently wait ~300 frames between two renders)

[mkamalza]

The good news here is that your segmentation image only shows the current objects, which means they are being correctly destroyed/moved out of view. The issue with the RGB images is curious. I haven't seen that before. A couple of things you could try:

• Check your camera's parameters such as background type
• If you are rendering to a texture, remove that and check results
• Set the color buffer format back to the default instead of R16G16B16A16
• Check your default post processing profiles. HDRP turns on motion blur by default and perhaps that can materialize in this way.

[Tachimura]

Hi @mkamalza and thanks you for the reply!

I've tried your tips but sadly, none worked.

• My camera background type is currently set to None (with the buffers being R16G16B16A16 I can get RGBA images with no background which is something I need).

• I'm not rendering into a texture so I have nothing to add here.

• As previously mentioned I need the buffers to be R16G16B16A16. I still tried setting them back to the default value but I get the same artifacts (a difference I've noted is that with the default color format, the artifacts have colors and not gray). I hope you can see the artifacts (they are mainly visible at the top of the image). if I disable the Sky&Fog Volume they become very visible.

• I tried removing the motion blur from all the post processing profiles but i still get the same problem.

GBuffers

While doing some more research about HDRP I found in this thread in the unity forum a user with a similar problem to mine and they say: "By default, HDRP didn't clear GBUFFER and some other buffers to get some GPU perf. " I tried to force clear the GBuffers as they mentioned but the useable methods and pipeline code do not match with what they posted (that thread was from 2019 so probably a lot has changed)

About GBuffers I've found some settings in the HDRP global settings under the header "Frame Settings", under all "Rendering" settings you can find there is a "Clear GBuffers" which is not checked, I tried to check it but again it didn't solve the problem.

[esgnn]

Could it be related to Temporal Anti-aliasing? If it is on, could you please try again without it.

[Tachimura]

@esgnn I tried all types of Anti-aliasing (No Anti-aliasing, FXAA, TAA and SMAA) but i keep getting these artifacts.

Also, this same project works fine (no shenanigans in the rendered images) if i run it with URP and the previous version of the perception library (Perception 0.11.2-preview.2). That's why i think it is something about HDRP that is creating these problems.

[esgnn]

@Tachimura hmm, how about motion blur? (don't forget to turn it of from default postprocessing effects). If doesn't work, maybe turning off postprocessing effects might reveal the culprit.

[Tachimura]

@esgnn I tried removing the Motion Blur but I keep getting the same artifacts. I don't know how to fully disable postprocessing so i just unticked all the effects in the volume profile (I hope it is correct).

As you can see the overall quality of the rendered image decreased but the artifacts are still here.

[esgnn]

Another thing you can try is to disable post processing all together for the camera. Couple of other questions just to be sure:

• Do you have another camera rendering?
• What happens if you don't annotate anything at all, just run the scene?

[Tachimura]

@esgnn I tried to disable post-processing from the camera as you shown me, but I keep getting the same artifacts. About the other questions:

• I only have 1 camera in the scene
• If I disable every "Labelling" scripts from the objects, I get the same artifacts in the rgb images but fully black segmentation images. RGB Image:

Segmap Image: