search

nel-lab / mesmerize-core

High level pandas-based API for batch analysis of Calcium Imaging data using CaImAn
Other
58 stars 15 forks source link

CNMFE process dies silently without any error traceback #264

Closed X4ndri closed 7 months ago

X4ndri commented 7 months ago

While running CNMFE, after the memmap is made, and CNMFE starts, I can see all my CPUs in high gear for a few minutes which means cnmfe is running. Usually CNMFE is done soon after. However, sometimes all the processes turn to 'sleeping' and the cell is stuck forever with no error traceback. The issue seems specific to a few recordings that I have, and never appears for other recordings. I still have not found a way to analyze these recordings as the issue has persisted. Running Mesmerize-core Version: 0.3.0

See how all the processes' state goes to 'S'. However, the cell keeps running forever. image

X4ndri commented 7 months ago

@EricThomson

X4ndri commented 7 months ago

trying truncating these recordings solved the problem, so it probably was a memory issue (although I have 370gb of memory welp). An actual fix was to decrease the rf size.