[dvsim] Feature tracker

sriyerg commented 4 years ago

Here's the list of dvsim work items that are planned. Considering working on this tool is more like a 20% project for the most of us, the roll out is expected to be slow.

General:

[ ] Rebrand dvsim with atom
[ ] Add user guide and a reference manual
[x] Exit with error on failure - PR #1697
[ ] Add detailed documentation (user guide and ref manual)
[x] Create bsub job arrays
[x] Deploy on GCP
[x] Add support for selecting individual targets from a cfgs list - PR #1832
[ ] If a subset of cfgs selected via --select-cfgs from a supplied master cfgs list hjson, then update only the results for those cfgs in the published summary results table
[x] Email flow results - PR #1775
[x] Graceful exit on CTRL-C support: #1723
[ ] Spin out as a separate pip package so that it can be using in other lowrisc repos - PR #1634
[ ] Better support for tool-specific report parsing (this came out of https://github.com/lowRISC/opentitan/pull/1749#discussion_r394061155)
[ ] Extend dvsim to support uploading plots associated with the current report page
[x] Change how the tool invokes a specific *Cfg class (categorize by flow and not by tool), see also https://github.com/lowRISC/opentitan/pull/1749#discussion_r392414173
[x] Handle dumping of env variables from within the tool and remove them from the makefiles

DV:

[ ] Auto rerun failing tests with debug switches
[x] Add support for coverage reporting with Xcelium
[x] Run coverage task only if at least one test passed
[x] Run coverage analysis (--cov-analyze switch) with GUI as a detached process
[x] Add support for Xcelium profiling
[ ] Dump summary results (for master cfg) and individual simulation and coverage results for each cfg as a hjson file in the reports area (for db query / graphs / plots) (individual simulation and coverage results done in https://github.com/lowRISC/opentitan/pull/17174)
- [ ] https://github.com/lowRISC/opentitan/issues/16988

FPV:

[x] Add support for FPV (testplan annotation, publishing results, COI coverage etc) - PR #2549
[ ] Add support for GUI mode
[x] Support display build error - PR #2585
[x] Use a more detailed summary to send email - PR #2549
[x] Display failed properties and color code undetermined and cex - PR #2549
[ ] Support running formal in LSF
[ ] In fpv.tcl, separate DUT related configs into each DUT
[ ] In batch mode, if cov collection default value is on, need a switch to disable coverage
[ ] FPV only have summary page, so no report history for each module on the website

Lint:

[x] Add support for lint - PR #1596
[x] Add support for Verible - #1342, PR #1819
[x] Add support for policy config files for Verible, once available - #1342, PR #1996
[ ] Add support for structured output from Verible, once available - #1342, https://github.com/google/verible/issues/257
[ ] Improve handling of unneeded Deploy parameters, like sv_flist_gen_cmd in https://github.com/lowRISC/opentitan/pull/1749#discussion_r394061155

Synthesis:

[x] Add SynCfg.py class that derives from OneShotCfg.py - PR #1749
[x] Add initial config hjson files to enable running DC - PR #1749
[x] Add parser script to parse synthesis reports - PR #1749
[x] Add synthesis dashboard generation and publication mechanism - PR #1749
[ ] Add register report (with elab and optimized counts)
[ ] Extend dvsim to make synthesis summary reports
[ ] Add some nice synthesis dashboard plots for area splits (e.g. pie or bars)
[ ] Add history mechanism that compares synthesis results with the last couple of runs
[ ] Switch over to DC Edalize backend once available - https://github.com/olofk/edalize/issues/89

sriyerg commented 4 years ago

Bug: some keys need to be needlessly set.

weicaiyang commented 1 year ago

Just edited this issue to add an item under DV - https://github.com/lowRISC/opentitan/issues/16988

lowRISC / opentitan

[dvsim] Feature tracker #1727