TrustInSoft / tis-interpreter

An interpreter for finding subtle bugs in programs written in standard C
565 stars 28 forks source link

Maybe related work #124

Open albertnetymk opened 8 years ago

albertnetymk commented 8 years ago

https://github.com/kframework/c-semantics

Curious to see a comparison with the two.

pascal-cuoq commented 8 years ago

Well it would be extremely unscientific for me, a developer of one of the two tools being compared, to do the comparison. I would be at risk of comparing an up-to-date version of my tool, on a benchmark I have just ensured my tool worked on appropriately in all cases, to a two-year old version of the other tool, that I would be in addition mis-using as I am unfamiliar with it.

Oh, wait, this is just the sort of thing that the authors of C-semantics do. I believe that this level of bad faith ought to one fired from one's university for misconduct. I would certainly expect it to in empirical sciences, but apparently CS is different.

tis-interpreter has found tens of bugs in open-source software (the links on http://trust-in-soft.com/tis-interpreter/ are only a small subset). I have not heard of any bug found by https://github.com/kframework/c-semantics in real software, but I do not follow closely what it does, and as I said, I would not want to be unscientific.