o3de / o3de-atom-sampleviewer

Atom sample viewer project for the Open 3D Engine
https://o3de.org
Other
32 stars 37 forks source link

AtomSampleViewer _fulltestsuite_.bv.luac materialpipelinetest multiple screen compare tests failing for materials #582

Open smurly opened 1 year ago

smurly commented 1 year ago

ASV commit 9f4adc46178bb9a85c85e7b68c5c1dd7ea65a3bc O3DE commit d2004b0e82b0f41d05de7f1a5bf5a12aa1cab0dd

Repro:

  1. build and run AtomSampleViewerStandalone.exe one windows
  2. Automation > run script. select scripts/fulltestsuite.bv.luac and click Run

Expected result: tests pass

Actual result: several screen compares for materialpipelinetest fail image comparison

Windows 10 Nvidia RTX 3070 Ti Driver Version: 30.0.14.9613 Processor: AMD Ryzen Threadripper 3970X 32-Core Processor (64 CPUs), ~3.7GHz Memory: 64GB also with Driver Version: 31.0.15.2849

image imageDiff_materialscreenshottests_materialpipelinetest_basic_deferredpipeline_1675726208 0000

![image](https://user-images.githubusercontent. imageDiff_materialscreenshottests_materialpipelinetest_enhanced_lowendpipeline_1675726208 0000 com/26234397/217433363-8f1a5015-3753-447e-a1a3-9eab9617f765.png)

image imageDiff_materialscreenshottests_materialpipelinetest_enhanced_deferredpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_enhanced_pdo_lowendpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_standard_deferredpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_standard_pdo_deferredpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_enhanced_pdo_deferredpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_enhanced_transparent_lowendpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_standard_transparent_lowendpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_standard_transparent_deferredpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_standard_tintedtransparent_lowendpipeline_1675726208 0000

image imageDiff_materialscreenshottests_materialpipelinetest_enhanced_tintedtransparent_lowendpipeline_1675726208 0000

image imageDiff_materialscreenshottests_002_wrinkle_regression_test_1675726208 0000

image imageDiff_materialscreenshottests_015_subsurfacescattering_transmission_thin_1675726208 0000

image imageDiff_materialscreenshottests_015_subsurfacescattering_transmission_1675726208 0000

image imageDiff_materialscreenshottests_015_subsurfacescattering_1675726208 0000

image imageDiff_materialscreenshottests_001_defaultwhite_1675726208 0000

image imageDiff_materialscreenshottests_minimalpbr_default_1675726208 0000

smurly commented 1 year ago

still occurring with latest ASV commit 9f4adc46178bb9a85c85e7b68c5c1dd7ea65a3bc O3DE commit 4e0c46be1febf66c61749c72851692de8ab0ce2d

amzn-tommy commented 1 year ago

I'm seeing two new failures in this test that were not originally reported. Reflection Probe visualization: ReflectionProbeVisualization

And also the enhanced transparent on the low end pipeline. This one was part of the original bug report, but now there is a specular reflection that has gone missing, in addition to the slight change in brightness that was originally reported. I see the same thing in the other enhanced transparent material screenshot, though I didn't including that screenshot here EnhancedTransparent_LowEndPipeline

moudgils commented 1 year ago

@galibzon is this still applicable?