EddyRivasLab / hmmer

HMMER: biological sequence analysis using profile HMMs
http://hmmer.org
Other
307 stars 69 forks source link

Segmentation fault during nhmmer search with binary (fm) database #257

Closed traviswheeler closed 2 years ago

traviswheeler commented 3 years ago

During testing on PR #253, @npcarter identified a scenario that causes nhmmer to seg fault while searching the binary target database format. The problem was observed in a branch used for the PR, but it reproduces in the develop branch. It's not universally reproducible - crashing only occurs with some combinations of (machine + --cpu value + --enable-debugging + flags to tighten or loosen the fm-index filter). It seems clear that this is a matter of an out-of-bounds memory access pattern that sometimes gets (un)lucky and stomps on an illegal address.

One way I've reproduced:

Next up: I'll start hunting for the source of the error

npcarter commented 2 years ago

Closing this because the work has been incorporated into issue #172.