Open mithro opened 3 years ago
FYI -- @pgielda
Is it something that is already running somewhere, e.g. on Travis and we just have to push the results? Because it seems that the Travis job is really simple and is not really running fpga-tool-perf? Or do you mean a completely new CI?
@pgielda @mithro Currently, fpga-tool-perf tests are running on Kokoro. There are two types of builds, one is run when submitting PRs (presubmit) and the other is run when merging on master (continuous).
The continuous CI is performing a wider range of tests (e.g. run multiple times with different seeds, etc.). I believe that we can add the BES library usage after the completion of the tests on the continuous CI
@acomodi can you send me some links? (Priv is fine)
https://source.cloud.google.com/results/invocations/6cac6cfd-6df7-4eac-9d52-3ab1ecc4941f/targets
Develop your code on the Google Cloud Platform.
If you look in the "log" page you get the following table;
+--------------------+--------------------------+---------+---------------+--------------+-------------+----------+---------------------+--------+
| Project | Toolchain | Family | Part | Board | Build Type | Build N. | Options | |
+--------------------+--------------------------+---------+---------------+--------------+-------------+----------+---------------------+--------+
| baselitex | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| baselitex | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| baselitex | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| baselitex | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| baselitex | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| baselitex | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| blinky | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| blinky | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n1 | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| bram-n1 | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| bram-n1 | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n1 | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n1 | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n1 | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n2 | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| bram-n2 | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| bram-n2 | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n2 | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n2 | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n2 | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n3 | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| bram-n3 | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| bram-n3 | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n3 | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n3 | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| bram-n3 | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| dram-test-64x1d | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| dram-test-64x1d | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| dram-test-64x1d | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| dram-test-64x1d | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| dram-test-64x1d | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| dram-test-64x1d | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| hamsternz-hdmi | nextpnr-xilinx-fasm2bels | xc7 | a200tsbg484-1 | nexys-video | generic-all | 000 | xdc_carry-n | failed |
| hamsternz-hdmi | nextpnr-xilinx | xc7 | a200tsbg484-1 | nexys-video | generic-all | 000 | xdc_carry-n | failed |
| hamsternz-hdmi | vivado | xc7 | a200tsbg484-1 | nexys-video | generic-all | 000 | xdc_carry-n | passed |
| hamsternz-hdmi | vpr-fasm2bels | xc7 | a200tsbg484-1 | nexys-video | generic-all | 000 | xdc_carry-n | failed |
| hamsternz-hdmi | vpr | xc7 | a200tsbg484-1 | nexys-video | generic-all | 000 | xdc_carry-n | failed |
| hamsternz-hdmi | yosys-vivado | xc7 | a200tsbg484-1 | nexys-video | generic-all | 000 | xdc_carry-n | failed |
| ibex | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| ibex | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | failed |
| ibex | nextpnr-xilinx-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | sdc_xdc_carry-n | failed |
| ibex | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| ibex | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | failed |
| ibex | nextpnr-xilinx | xc7 | z010clg400-1 | zybo | generic-all | 000 | sdc_xdc_carry-n | failed |
| ibex | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | vpr-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | vpr | xc7 | z010clg400-1 | zybo | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | sdc_xdc_carry-n | passed |
| ibex | yosys-vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | sdc_xdc_carry-n | passed |
| iir | quicklogic | eos | ql-eos-s3PD64 | chandalar | generic-all | 000 | pcf_carry-n | passed |
| iir | quicklogic | eos | ql-eos-s3PU64 | quickfeather | generic-all | 000 | pcf_carry-n | passed |
| jpeg-qnr | quicklogic | eos | ql-eos-s3PD64 | chandalar | generic-all | 000 | pcf_carry-n | passed |
| jpeg-qnr | quicklogic | eos | ql-eos-s3PU64 | quickfeather | generic-all | 000 | pcf_carry-n | passed |
| murax | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| murax | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | failed |
| murax | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| murax | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| murax | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| murax | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | sdc_xdc_carry-n | passed |
| oneblink | nextpnr-ice40 | ice40 | up5ksg48 | icebreaker | generic-all | 000 | pcf_carry-y | passed |
| oneblink | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| oneblink | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| oneblink | nextpnr-xilinx-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | pcf_xdc_carry-n | passed |
| oneblink | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| oneblink | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| oneblink | nextpnr-xilinx | xc7 | z010clg400-1 | zybo | generic-all | 000 | pcf_xdc_carry-n | passed |
| oneblink | quicklogic | eos | ql-eos-s3PU64 | quickfeather | generic-all | 000 | pcf_carry-n | passed |
| oneblink | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| oneblink | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| oneblink | vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | pcf_xdc_carry-n | passed |
| oneblink | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| oneblink | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| oneblink | vpr-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | pcf_xdc_carry-n | passed |
| oneblink | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| oneblink | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| oneblink | vpr | xc7 | z010clg400-1 | zybo | generic-all | 000 | pcf_xdc_carry-n | passed |
| oneblink | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| oneblink | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| oneblink | yosys-vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | pcf_xdc_carry-n | passed |
| picorv32 | nextpnr-ice40 | ice40 | up5ksg48 | icebreaker | generic-all | 000 | pcf_carry-y | passed |
| picorv32 | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | failed |
| picorv32 | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| picorv32 | nextpnr-xilinx-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | failed |
| picorv32 | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | failed |
| picorv32 | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| picorv32 | nextpnr-xilinx | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | failed |
| picorv32 | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | vpr-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | vpr | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picorv32 | yosys-vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | nextpnr-ice40 | ice40 | up5ksg48 | icebreaker | generic-all | 000 | pcf_carry-y | passed |
| picosoc-simpleuart | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | nextpnr-xilinx-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | nextpnr-xilinx | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | quicklogic | eos | ql-eos-s3PU64 | quickfeather | generic-all | 000 | pcf_carry-n | passed |
| picosoc-simpleuart | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | vpr-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | vpr | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-simpleuart | yosys-vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | nextpnr-ice40 | ice40 | up5ksg48 | icebreaker | generic-all | 000 | pcf_carry-y | passed |
| picosoc-spimemio | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | failed |
| picosoc-spimemio | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| picosoc-spimemio | nextpnr-xilinx-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | failed |
| picosoc-spimemio | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | failed |
| picosoc-spimemio | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| picosoc-spimemio | nextpnr-xilinx | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | failed |
| picosoc-spimemio | quicklogic | eos | ql-eos-s3PU64 | quickfeather | generic-all | 000 | pcf_carry-n | passed |
| picosoc-spimemio | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | vpr-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | vpr | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| picosoc-spimemio | yosys-vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| picosoc | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | pcf_sdc_xdc_carry-n | failed |
| picosoc | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | pcf_sdc_xdc_carry-n | passed |
| picosoc | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | pcf_sdc_xdc_carry-n | passed |
| picosoc | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | pcf_sdc_xdc_carry-n | passed |
| picosoc | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | pcf_sdc_xdc_carry-n | passed |
| picosoc | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | pcf_sdc_xdc_carry-n | passed |
| rsdecoder | quicklogic | eos | ql-eos-s3PD64 | chandalar | generic-all | 000 | pcf_carry-n | passed |
| rsdecoder | quicklogic | eos | ql-eos-s3PU64 | quickfeather | generic-all | 000 | pcf_carry-n | passed |
| vexriscv-smp | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| vexriscv-smp | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| vexriscv-smp | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| vexriscv-smp | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| vexriscv-smp | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| vexriscv-smp | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| vexriscv | nextpnr-xilinx-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | failed |
| vexriscv | nextpnr-xilinx-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| vexriscv | nextpnr-xilinx-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | failed |
| vexriscv | nextpnr-xilinx | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | failed |
| vexriscv | nextpnr-xilinx | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | failed |
| vexriscv | nextpnr-xilinx | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | failed |
| vexriscv | vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | vpr-fasm2bels | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | vpr-fasm2bels | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | vpr-fasm2bels | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | vpr | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | vpr | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | vpr | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | yosys-vivado | xc7 | a35tcpg236-1 | basys3 | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | yosys-vivado | xc7 | a35tcsg324-1 | arty | generic-all | 000 | xdc_carry-n | passed |
| vexriscv | yosys-vivado | xc7 | z010clg400-1 | zybo | generic-all | 000 | xdc_carry-n | passed |
+--------------------+--------------------------+---------+---------------+--------------+-------------+----------+---------------------+--------+
| Passed: | 143 | Failed: | 44 | | | | | 76% |
+--------------------+--------------------------+---------+---------------+--------------+-------------+----------+---------------------+--------+
Ok, makes sense.
https://github.com/antmicro/distant-bes