lowRISC / opentitan

OpenTitan: Open source silicon root of trust
https://www.opentitan.org
Apache License 2.0
2.56k stars 762 forks source link

[doc] Coverage dashboard for Xcelium IP blocks empty #23663

Open vogelpi opened 4 months ago

vogelpi commented 4 months ago

Description

It looks like the coverage dashboard for all IP blocks using Xcelium for sign-off (AES, CSRNG, ENTROPY_SRC, OTBN etc.) is currently empty. The summary is reported (see https://reports.opentitan.org/hw/ip/csrng/dv/2024.06.11_11.43.06/report.html) but when you click on Coverage Dashboard, an empty dashboard is shown: https://reports.opentitan.org/hw/ip/csrng/dv/2024.06.11_11.43.06/cov_report/index.html

It's probably a matter of where the html file is copied to.

vogelpi commented 4 months ago

This is just documentation but it would help for the block-level signoffs to have these dashboards. @moidx do you know what the issue is here?

vogelpi commented 4 months ago

@rswarbrick in the past had a similar issue, was due to a cross site scripting issue.

vogelpi commented 4 months ago

We need to figure out how to solve this, may need a workaround.

rswarbrick commented 4 months ago

This was switched to a "detachable report" in March (#22081), following a recommendation in Cadence's "Integrated Metrics Center User Guide" (see the "Configuring Reports Options" section).

I think this is a bit of a bodge in their tool. The idea is that they write out all the coverage data into a big file ("data.report") which you can then load up explicitly in your web browser. A bit of a mess...

And this definitely doesn't work for nightly tests (where the "data.report" file presumably lives somewhere inaccessible on a server).

A short term bodge might be for the team running the nightly regressions to extract those files and put them somewhere accessible. I'm not sure how to do something more robust.

vogelpi commented 3 months ago

Lowering priority and moving to backlog. This is an infrastructure issue and we've managed closing coverage for some more Xcelium blocks without this.