search

boogie-org / symbooglix

Symbolic Execution Engine for Boogie
MIT License
27 stars 4 forks source link

Fix performance regression on SVCOMP benchmark suite #15

Open delcypher opened 8 years ago

delcypher commented 8 years ago 
ldv-consumption/32_7a_cilled_false-unreach-call_linux-3.8-rc1-32_7a-fs--ecryptfs--ecryptfs.ko-ldv_main1_sequence_infinite_withcheck_stateful.cil.out.c_.bpl
snapshot-11-effctclone/merged.yml : FinalResultType.BUG_FOUND (/tmp/pbs.1346865.cx1b/wd/workdir-1270) (444.8166378069727 secs)
snapshot-12/merged.yml : FinalResultType.UNKNOWN (/tmp/pbs.1346866.cx1b/wd/workdir-1270) (900.0 secs)
delcypher commented 8 years ago

These "might" be regressions. Even though in both snapshots we didn't get an answer the "UNKNOWN" means we couldn't work out what happenend

ddv-machzwd/ddv_machzwd_outw_p_true-unreach-call.i_.bpl
snapshot-11-effctclone/merged.yml : FinalResultType.TIMED_OUT (/tmp/pbs.1346865.cx1b/wd/workdir-97) (900.0 secs)
snapshot-12/merged.yml : FinalResultType.UNKNOWN (/tmp/pbs.1346866.cx1b/wd/workdir-97) (900.0 secs)

ddv-machzwd/ddv_machzwd_inb_true-unreach-call.i_.bpl
snapshot-11-effctclone/merged.yml : FinalResultType.UNKNOWN (/tmp/pbs.1346865.cx1b/wd/workdir-88) (900.0 secs)
snapshot-12/merged.yml : FinalResultType.TIMED_OUT (/tmp/pbs.1346866.cx1b/wd/workdir-88) (900.0 secs)

ldv-linux-3.4-simple/32_1_cilled_true-unreach-call_ok_nondet_linux-3.4-32_1-drivers--net--team--team_mode_roundrobin.ko-ldv_main0_sequence_infinite_withcheck_stateful.cil.out.c_.bpl
snapshot-11-effctclone/merged.yml : FinalResultType.TIMED_OUT (/tmp/pbs.1346876.cx1b/wd/workdir-2042) (900.0 secs)
snapshot-12/merged.yml : FinalResultType.UNKNOWN (/tmp/pbs.1346866.cx1b/wd/workdir-2042) (900.0 secs)

ddv-machzwd/ddv_machzwd_inl_true-unreach-call.i_.bpl
snapshot-11-effctclone/merged.yml : FinalResultType.UNKNOWN (/tmp/pbs.1346865.cx1b/wd/workdir-90) (900.0 secs)
snapshot-12/merged.yml : FinalResultType.TIMED_OUT (/tmp/pbs.1346866.cx1b/wd/workdir-90) (900.0 secs)
delcypher commented 8 years ago

Definite regression

array-examples/sanfoundry_10_true-unreach-call_ground.i_.bpl
snapshot-9-mapconstidx/merged.yml : FinalResultType.BUG_FOUND (/tmp/pbs.1346863.cx1b/wd/workdir-4) (67.31660796823174 secs)
snapshot-12/merged.yml : FinalResultType.TIMED_OUT (/tmp/pbs.1346866.cx1b/wd/workdir-4) (900.0 secs)