Parmap drops to half # cores half way through processing

Hi I've been using parmap for over a year, but I noticed now that for very large memory tasks (e.g. >100GB) sometimes half the cores stop half way through processing.

I'm running on a dual-xeon workstation (8 physical cores x 2 processors).

Any suggestions for why this might happen? Any ways to diagnose such a problem?

Thanks!

**** CALLING CODE ** spike_trains = parmap.map(deconvolve_parallel_new, zip(idx_list,proc_indexes), params, processes=n_processors)

** OUTPUT *** (Cores 0,1,4,6 eventually stop running) ... ('# of chunks: ', 8, ' # cores: ', 8) ('Start time for deconvolution: ', 1520724614.860805) (0, 47000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (11750000, 11797000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (82250000, 82297000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (23500000, 23547000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (58750000, 58797000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) ('Processor: ', 1, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 0, ' in dot product loop ...') (35250000, 35297000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) ('Processor: ', 2, 'chunk: ', 0, ' in dot product loop ...') (47000000, 47047000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (70500000, 70547000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) ('Processor: ', 6, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 1, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 1, 'cleaned spikes: ', 28143) (11797000, 11844000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 1, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 30809) (47000, 94000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 0, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33734) (23547000, 23594000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 2, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 1, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 44277) (82297000, 82344000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 4, 'cleaned spikes: ', 33821) (47047000, 47094000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 7, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 1, 'cleaned spikes: ', 28213) (11844000, 11891000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 1, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37354) (35297000, 35344000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 1, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 34794) (94000, 141000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 5, 'cleaned spikes: ', 38211) (58797000, 58844000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 0, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33733) (23594000, 23641000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 2, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 6, 'cleaned spikes: ', 41285) (70547000, 70594000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 2, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 1, 'cleaned spikes: ', 28059) (11891000, 11938000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 7, 'cleaned spikes: ', 34761) (82344000, 82391000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 1, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 1, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 30164) (141000, 188000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 0, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 6, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33902) (23641000, 23688000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 2, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 1, 'cleaned spikes: ', 28371) (11938000, 11985000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 1, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 28222) (188000, 235000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 0, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 41564) (82391000, 82438000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 7, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33347) (23688000, 23735000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 2, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 26848) (235000, 282000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 0, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33229) (23735000, 23782000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 2, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 39721) (82438000, 82485000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 7, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 26138) (282000, 329000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 0, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 4, 'cleaned spikes: ', 32354) (47094000, 47141000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 4, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 25733) (329000, 376000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 0, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33537) (23782000, 23829000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 2, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37381) (35344000, 35391000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 4, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42143) (82485000, 82532000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 7, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 6, 'cleaned spikes: ', 39024) (70594000, 70641000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 7, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 43441) (58844000, 58891000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 24679) (376000, 423000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 6, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33029) (23829000, 23876000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 2, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36239) (35391000, 35438000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 24633) (423000, 470000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 0, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 35683) (82532000, 82579000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 7, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 4, 'cleaned spikes: ', 36150) (47141000, 47188000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 0, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33347) (23876000, 23923000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 2, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 24346) (470000, 517000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 0, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 6, 'cleaned spikes: ', 36645) (70641000, 70688000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 0, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36694) (35438000, 35485000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 3, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 39495) (58891000, 58938000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 6, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42581) (82579000, 82626000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 7, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23995) (517000, 564000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 0, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33645) (23923000, 23970000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 2, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23882) (564000, 611000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 0, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37543) (35485000, 35532000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 4, 'cleaned spikes: ', 37592) (47188000, 47235000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 3, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34124) (23970000, 24017000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 3, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 39159) (82626000, 82673000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 7, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 24011) (611000, 658000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 0, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 40356) (58938000, 58985000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 5, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 6, 'cleaned spikes: ', 50675) (70688000, 70735000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 37562) (35532000, 35579000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 6, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23655) (658000, 705000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 3, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33782) (24017000, 24064000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 2, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 41785) (82673000, 82720000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 7, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 4, 'cleaned spikes: ', 35244) (47235000, 47282000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 7, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23572) (705000, 752000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 0, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33803) (24064000, 24111000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 2, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36564) (35579000, 35626000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 3, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23916) (752000, 799000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 0, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 41868) (82720000, 82767000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 7, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33892) (24111000, 24158000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 2, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 6, 'cleaned spikes: ', 38188) (70735000, 70782000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 23726) (799000, 846000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 36734) (35626000, 35673000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 0, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 6, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 42797) (58985000, 59032000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 2, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 4, 'cleaned spikes: ', 37038) (47282000, 47329000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 23638) (846000, 893000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 0, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 43500) (82767000, 82814000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 4, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33747) (24158000, 24205000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 2, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36545) (35673000, 35720000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 3, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 22953) (893000, 940000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 3, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33721) (24205000, 24252000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 2, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 6, 'cleaned spikes: ', 36094) (70782000, 70829000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 7, 'cleaned spikes: ', 35595) (82814000, 82861000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 23794) (940000, 987000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 7, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 36168) (59032000, 59079000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 37143) (35720000, 35767000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 7, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 6, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23689) (987000, 1034000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 0, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 4, 'cleaned spikes: ', 40212) (47329000, 47376000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 33371) (24252000, 24299000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 2, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 44336) (82861000, 82908000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 37154) (35767000, 35814000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 7, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23613) (1034000, 1081000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 22, ' of ', 250) ('Processor: ', 3, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 22, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 22, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 6, 'cleaned spikes: ', 40275) (70829000, 70876000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 6, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33745) (24299000, 24346000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 2, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 39902) (59079000, 59126000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 23536) (1081000, 1128000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 23, ' of ', 250) ('Processor: ', 0, 'chunk: ', 23, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 23, ' in thresholding loop ...') ('Processor: ', 4, 'cleaned spikes: ', 35044) (47376000, 47423000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 5, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42459) (82908000, 82955000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 7, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23798) (1128000, 1175000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 24, ' of ', 250) ('Processor: ', 0, 'chunk: ', 24, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33405) (24346000, 24393000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 2, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37963) (35814000, 35861000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 0, 'chunk: ', 24, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23804) (1175000, 1222000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 25, ' of ', 250) ('Processor: ', 0, 'chunk: ', 25, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 25, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33620) (24393000, 24440000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 2, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 38697) (82955000, 83002000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 7, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 24238) (1222000, 1269000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 26, ' of ', 250) ('Processor: ', 0, 'chunk: ', 26, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 26, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23951) (1269000, 1316000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 27, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 33508) (24440000, 24487000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 0, 'chunk: ', 27, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 4, 'cleaned spikes: ', 37434) (47423000, 47470000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 2, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 42054) (59126000, 59173000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 7, 'cleaned spikes: ', 42837) (83002000, 83049000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 7, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37090) (35861000, 35908000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 3, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33851) (24487000, 24534000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 2, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 40524) (83049000, 83096000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 7, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 4, 'cleaned spikes: ', 37956) (47470000, 47517000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 34146) (24534000, 24581000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 22, ' of ', 250) ('Processor: ', 2, 'chunk: ', 22, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 22, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 41225) (59173000, 59220000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 5, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37287) (35908000, 35955000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 3, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 40758) (83096000, 83143000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 7, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34011) (24581000, 24628000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 23, ' of ', 250) ('Processor: ', 2, 'chunk: ', 23, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 23, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 39093) (59220000, 59267000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 5, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37200) (35955000, 36002000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 3, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33736) (24628000, 24675000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 24, ' of ', 250) ('Processor: ', 2, 'chunk: ', 24, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42525) (83143000, 83190000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 2, 'chunk: ', 24, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36865) (36002000, 36049000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 3, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33531) (24675000, 24722000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 25, ' of ', 250) ('Processor: ', 5, 'cleaned spikes: ', 40783) (59267000, 59314000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 2, 'chunk: ', 25, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 25, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 47975) (83190000, 83237000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 7, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33197) (24722000, 24769000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 26, ' of ', 250) ('Processor: ', 2, 'chunk: ', 26, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 35812) (59314000, 59361000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 5, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 26, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 45069) (36049000, 36096000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 3, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 38380) (83237000, 83284000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 33467) (24769000, 24816000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 27, ' of ', 250) ('Processor: ', 7, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 27, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 27, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 41816) (59361000, 59408000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 36041) (36096000, 36143000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 5, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34213) (24816000, 24863000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 28, ' of ', 250) ('Processor: ', 2, 'chunk: ', 28, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 34783) (83284000, 83331000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 22, ' of ', 250) ('Processor: ', 7, 'chunk: ', 22, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 28, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 22, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36062) (36143000, 36190000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 3, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 38813) (59408000, 59455000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 5, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34197) (24863000, 24910000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 29, ' of ', 250) ('Processor: ', 2, 'chunk: ', 29, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 29, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 47942) (83331000, 83378000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 23, ' of ', 250) ('Processor: ', 7, 'chunk: ', 23, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 34400) (36190000, 36237000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 3, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 23, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 39521) (59455000, 59502000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 5, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34706) (24910000, 24957000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 30, ' of ', 250) ('Processor: ', 2, 'chunk: ', 30, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 30, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 35234) (83378000, 83425000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 24, ' of ', 250) ('Processor: ', 7, 'chunk: ', 24, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 35514) (36237000, 36284000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 3, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 24, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34095) (24957000, 25004000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 31, ' of ', 250) ('Processor: ', 3, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 31, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 41911) (59502000, 59549000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 5, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 31, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37764) (36284000, 36331000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 22, ' of ', 250) ('Processor: ', 3, 'chunk: ', 22, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34068) (25004000, 25051000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 32, ' of ', 250) ('Processor: ', 2, 'chunk: ', 32, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 45370) (83425000, 83472000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 25, ' of ', 250) ('Processor: ', 7, 'chunk: ', 25, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 22, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 32, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 25, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 43003) (59549000, 59596000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 5, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 31876) (36331000, 36378000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 23, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 34136) (25051000, 25098000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 33, ' of ', 250) ('Processor: ', 3, 'chunk: ', 23, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 33, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 23, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 33, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 44092) (83472000, 83519000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 26, ' of ', 250) ('Processor: ', 7, 'chunk: ', 26, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 26, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33309) (25098000, 25145000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 34, ' of ', 250) ('Processor: ', 2, 'chunk: ', 34, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 44921) (59596000, 59643000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 5, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 38187) (36378000, 36425000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 24, ' of ', 250) ('Processor: ', 3, 'chunk: ', 24, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 34, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 24, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 43008) (83519000, 83566000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 27, ' of ', 250) ('Processor: ', 7, 'chunk: ', 27, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34192) (25145000, 25192000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 35, ' of ', 250) ('Processor: ', 2, 'chunk: ', 35, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 27, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 35, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36091) (36425000, 36472000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 25, ' of ', 250) ('Processor: ', 3, 'chunk: ', 25, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 43376) (59643000, 59690000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 5, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 25, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 31721) (83566000, 83613000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 28, ' of ', 250) ('Processor: ', 7, 'chunk: ', 28, ' in dot product loop ...')

('Processor: ', 2, 'cleaned spikes: ', 34201) (25192000, 25239000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 36, ' of ', 250) ('Processor: ', 7, 'chunk: ', 28, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 36, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 30913) (36472000, 36519000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 26, ' of ', 250) ('Processor: ', 3, 'chunk: ', 26, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 36, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 26, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 38935) (59690000, 59737000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 5, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33964) (25239000, 25286000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 37, ' of ', 250) ('Processor: ', 2, 'chunk: ', 37, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42433) (83613000, 83660000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 29, ' of ', 250) ('Processor: ', 7, 'chunk: ', 29, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 37, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 29, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 35592) (36519000, 36566000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 27, ' of ', 250) ('Processor: ', 3, 'chunk: ', 27, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 27, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 36710) (59737000, 59784000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 5, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34275) (25286000, 25333000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 38, ' of ', 250) ('Processor: ', 2, 'chunk: ', 38, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 38651) (83660000, 83707000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 30, ' of ', 250) ('Processor: ', 7, 'chunk: ', 30, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 38, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 33573) (36566000, 36613000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 28, ' of ', 250) ('Processor: ', 3, 'chunk: ', 28, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 30, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 28, ' in thresholding loop ...')

rdicosmo / parmap

Parmap drops to half # cores half way through processing #71

From https://caml.inria.fr/pub/docs/manual-ocaml/runtime.html

tells a subsequent ocamlrun to print backtraces for uncaught exceptions [...]