correctcomputation / checkedc-clang

This is the primary development repository for 3C, a tool for automatically converting legacy C code to the Checked C extension of C, which aims to enforce spatial memory safety. This repository is a fork of Checked C's.
14 stars 5 forks source link

Increase verification of 3C output in benchmark tests #428

Open mattmccutchen-cci opened 3 years ago

mattmccutchen-cci commented 3 years ago

Currently, the benchmark tests only check that 3C completes successfully (exit code 0). We should add more verification of the output. Ideas:

john-h-kastner commented 3 years ago

Since many of the tests depend on the convert-project.py, we'll probably want to handle at least part of #329 at the same time.

mattmccutchen-cci commented 3 years ago

Update:

Unfortunately, both of these tests are currently far from passing. There is a long tail of 3C issues affecting the benchmarks, and fixing them hasn't been our highest priority.