pelkmanslab / iBRAIN_BRUTUS

A version of canonical iBRAIN (2015) deployed on BRUTUS cluster
0 stars 0 forks source link

create_jpgs_illumination_corrected did not process full plate #32

Open GitMotz opened 8 years ago

GitMotz commented 8 years ago

only half the plate was processed; ill core jpg creation stopped at well J05; should have processed full plate; project folder see below. thus error did not happen for other projects with the exact same image number! eg biol_uzh_pelkmans_s8/Data/Users/Doris/MOTC_screen_01/20151103_CN/20151103CN CP612-1aa was processed fully.

/BIOL/sonas/biol_uzh_pelkmans_s8/Data/Users/Doris/MOTC_screen_01/20151103_CN/20151103CN CP611-1aa/ILLCORJPG/20151103_CN_CP611-1aa_J05_RGB1.jpg {Error using double Out of memory. Type HELP MEMORY for your options.

Error in writejpg (line 105) data = uint8(maxval * double(data));

Error in imwrite (line 473) feval(fmt_s.write, data, map, filename, paramPairs{:});

Error in create_jpgs_illumination_corrected (line 326) imwrite(Overlay,strFileName,'jpg','Quality',intJpgQuality); } >> merge_jpgs_per_plate: processing /BIOL/sonas/biol_uzh_pelkmans_s8/Data/Users/Doris/MOTC_screen_01/20151103_CN/20151103_CN_CP611-1aa/ILLCORJPG merge_jpgs_per_plate: looking for *.jpg merge_jpgs_per_plate: found 314 matching files

tstoeger commented 8 years ago

since out-of-memory error occurred in MATLAB's inbuilt imwrite, during the middle of the looping through wells, and not on other comparable projects with same image number, this appears to be a problem that should be easily solved by resubmission (e.g.: if another job on same brutus node exceeds its requested memory and therefore causes out-of-memory of your job).

Would the error still appear after resubmission and does iBrain have automated resubmission of illcorrjpg jobs (as it has for the majority of its jobs)?

If error remains or illcorr jpg would require memory than has been requested by ibrain (see submission parameters and reports on used memory within .result files of completed illcorrjpg), it might be wise to increase the memory that is requested during submission.