sid-krish / rhometa

metagenome population recombination rate estimation pipeline
MIT License
12 stars 0 forks source link

In pair_parsing brach, if sufficient ram is not available, the program will crash under various memory related errors #30

Open sid-krish opened 2 years ago

sid-krish commented 2 years ago

Testing has shown that this is due to lack for memory. Different types of errors can be produced such as malloc and double free or corruption.

It's also possible parts of the new pairwise_table script uses more memory than the previous implementation, as memory related issues were not encountered for same datasets under the same work environment in the old implementation.

sid-krish commented 2 years ago

These cryptic errors might be related to low level numba code