Occasionally you may get an Out of Memory error in both minsar (rsmas_insar) and miaplpy. This happens because the estimation of the required memory is not correct (the memory requirements for each run_step are indefaults/job_defaults.cfg). The job_submission.py script uses this file to estimate how many jobs can be simultaneously run on one node and creates the run_files accordingly. In this example it thinks that there is enough memory to run 15 jobs on this node:
If you can't reduce the memory requirement by changing parameters in the *template file (e.g. more looks for isce processing) or a smaller miaplpy.subset area for MiaplPy, recreate the job files using a higher value for numMemoryUnits:
Occasionally you may get an
Out of Memoryerror in both minsar (rsmas_insar) and miaplpy. This happens because the estimation of the required memory is not correct (the memory requirements for each run_step are indefaults/job_defaults.cfg). Thejob_submission.pyscript uses this file to estimate how many jobs can be simultaneously run on one node and creates the run_files accordingly. In this example it thinks that there is enough memory to run 15 jobs on this node:If you can't reduce the memory requirement by changing parameters in the *template file (e.g. more looks for isce processing) or a smaller
miaplpy.subsetarea for MiaplPy, recreate the job files using a higher value fornumMemoryUnits:The original
job_submission.pycommand is in thelogfile for minsar and displayed to the screen bymiaplpyApp.py --jobfiles.You can check memory usage on the compute node using
free -h.