chipsalliance / caliptra-rtl

HW Design Collateral for Caliptra RoT IP
Apache License 2.0
75 stars 38 forks source link

L0 regression tests failures #307

Closed saikumar0508 closed 11 months ago

saikumar0508 commented 12 months ago

Hi,

Below four tests are failing ( 1.0 Release)

smoke_test_doe_rand - observing assertion error, mismatch in the data comparison and unable to generate doe test vector file.

"/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/asserts/caliptra_top_sva.sv", 413: caliptra_top_tb.sva.genblk15[3].KV_client_wrdata_not_unknown: started at 279545000ps failed at 279545000ps Offending '(!$isunknown(caliptra_top_tb.caliptra_top_dut.key_vault1.kv_write[3].write_data))' SVA ERROR: KV client 3 data is unknown

"/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/asserts/caliptra_top_sva.sv", 222: caliptra_top_tb.sva.UDS_data_check.genblk1[0].DOE_UDS_data_check: started at 278325000ps failed at 281185000ps Offending '(caliptra_top_tb.caliptra_top_dut.key_vault1.kv_reg1.hwif_out.KEY_ENTRY[caliptra_top_tb.caliptra_top_dut.doe.doe_inst.i_doe_reg.hwif_out.DOE_CTRL.DEST.value][0] == caliptra_top_tb.tb_services_i.doe_test_vector.uds_plaintext[0])' SVA ERROR: DOE UDS output xxxxxxxx does not match plaintext xxxxxxxx! "/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/asserts/caliptra_top_sva.sv", 222: caliptra_top_tb.sva.UDS_data_check.genblk1[1].DOE_UDS_data_check: started at 278325000ps failed at 281185000ps

Run Path/Dump : /nsfs/devarsim2/smegavat/caliptra-rtl-main/smoke_test_doe_rand/inter.vpd

Log Path : /nsfs/devarsim2/smegavat/caliptra-rtl-main/smoke_test_doe_rand/DVEfiles/dve_gui.log

smoke_test_doe_scan - observing assertion error, mismatch in the data comparison and unable to generate doe test vector file.

"/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/asserts/caliptra_top_sva.sv", 413: caliptra_top_tb.sva.genblk15[3].KV_client_wrdata_not_unknown: started at 304195000ps failed at 304195000ps Offending '(!$isunknown(caliptra_top_tb.caliptra_top_dut.key_vault1.kv_write[3].write_data))' SVA ERROR: KV client 3 data is unknown

"/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/asserts/caliptra_top_sva.sv", 222: caliptra_top_tb.sva.UDS_data_check.genblk1[0].DOE_UDS_data_check: started at 303005000ps failed at 305835000ps Offending '(caliptra_top_tb.caliptra_top_dut.key_vault1.kv_reg1.hwif_out.KEY_ENTRY[caliptra_top_tb.caliptra_top_dut.doe.doe_inst.i_doe_reg.hwif_out.DOE_CTRL.DEST.value][0] == caliptra_top_tb.tb_services_i.doe_test_vector.uds_plaintext[0])' SVA ERROR: DOE UDS output xxxxxxxx does not match plaintext xxxxxxxx!

Run Path/Dump : /nsfs/devarsim2/smegavat/caliptra-rtl-main/smoke_test_doe_scan/inter.vpd

Log Path : /nsfs/devarsim2/smegavat/caliptra-rtl-main/smoke_test_doe_scan/DVEfiles/dve_gui.log

smoke_test_kv_securitystate -

Error :

"/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/rtl/caliptra_top.sv", 1312: caliptra_top_tb.caliptra_top_dut.AHB_MASTER_HADDR_X: started at 777415000ps failed at 777415000ps Offending '(!$isunknown(initiator_inst.haddr))' Fatal: "/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/rtl/caliptra_top.sv", 1312: caliptra_top_tb.caliptra_top_dut.AHB_MASTER_HADDR_X: at time 777415000 ps [CALIPTRA_ASSERT FAILED] [caliptra_top_tb.caliptra_top_dut.AHB_MASTER_HADDR_X] AHB_MASTER_HADDR_X (/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/rtl/caliptra_top.sv:1312) $finish called from file "/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/rtl/caliptra_top.sv", line 1312. $finish at simulation time 777415.000 ns

Run Path/Dump : /nsfs/devarsim2/smegavat/caliptra-rtl-main/smoke_test_kv_securitystate/inter.vpd

Log Path : /nsfs/devarsim2/smegavat/caliptra-rtl-main/smoke_test_kv_securitystate/DVEfiles/dve_gui.log

smoke_test_cg_wdt -

Error : "/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/rtl/caliptra_top.sv", 1312: caliptra_top_tb.caliptra_top_dut.AHB_MASTER_HADDR_X: started at 309955000ps failed at 309955000ps Offending '(!$isunknown(initiator_inst.haddr))' Fatal: "/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/rtl/caliptra_top.sv", 1312: caliptra_top_tb.caliptra_top_dut.AHB_MASTER_HADDR_X: at time 309955000 ps [CALIPTRA_ASSERT FAILED] [caliptra_top_tb.caliptra_top_dut.AHB_MASTER_HADDR_X] AHB_MASTER_HADDR_X (/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/rtl/caliptra_top.sv:1312) $finish called from file "/nsfs/devarsim2/smegavat/caliptra-rtl-main/src/integration/rtl/caliptra_top.sv", line 1312. $finish at simulation time 309955.000 ns

Run Path/Dump : /nsfs/devarsim2/smegavat/caliptra-rtl-main/smoke_test_cg_wdt/inter.vpd

Log Path : /nsfs/devarsim2/smegavat/caliptra-rtl-main/smoke_test_cg_wdt/DVEfiles/dve_gui.log

Please review the results and let me know If I'm missing anything or if any information is needed.

Thanks, Sai

calebofearth commented 12 months ago

Hello Sai,

You have several assertions firing here that indicate the presence of X data values in the simulation. Can you do some investigation into your simulation results to understand how these signals are being driven with X values? We aren't encountering these X values in either our published verilator results or in our internal VCS simulations.

My guess is that the test vector scripts are incorrectly copied to the run directory in your environment, or you're using a plusarg that triggers an unsatisfied dependency (e.g. running the sim with +RAND_DOE_VALUES implies a dependency upon the doe_test_gen.py script being available during a sim).

calebofearth commented 11 months ago

@saikumar0508 are there any updates on this issue? Were you able to resolve the run failures with these pointers?

upadhyayulakiran commented 11 months ago

Hi @saikumar0508 ,

The first two signatures seem to be coming from an env setup issue as Caleb mentioned above.

For the second two tests, we're not able to repro on our end. The tests pass locally and in our regressions. I'm not able to view your logs or waves. Can you debug a little more and post screenshots of the waves with some related signals?

Thanks, Kiran