search

21cmfast / 21cmFAST

Official repository for 21cmFAST: a code for generating fast simulations of the cosmological 21cm signal
MIT License
58 stars 37 forks source link

FFTW assertion failure #324

Closed qyx268 closed 1 year ago

qyx268 commented 1 year ago

Recently, a py21cmmc run keeps crashing because of fftw: planner.c:891: assertion failed: flags.u == u

This should be related to this FFTW open issue, which seems to conclude that the application is writing and reading concurrently. However, in py21cmfast, we only export wisdom file in CreateFFTWWisdoms and these crashes happened when I already had created the wisdom files in early steps (i.e. the crashes happen in the middle of a series of resubmitted jobs for ONE inference). I'm suspecting a system failure instead which prevents certain threads/nodes from accessing the file and fails if(fftwf_import_wisdom_from_filename(wisdom_filename)==0) in CreateFFTWWisdoms.

qyx268 commented 1 year ago

But I don't think we need to bother and solve this here as it is not a py21cmfast or fftw bug.