Closed catubc closed 6 years ago
Don't you see a stacktrace somewhere for the stopped processes? Try
export OCAMLRUNPARAM=b
before launching your program in the same terminal.
I guess you have some uncaught exception that was launched on some cores by the function that is being run in parallel.
Yes, you are absolutely correct, there was a bug in the code that I could only see in single-core runs.
I spent the day searching for a way to debug in multi-processing mode, but I couldn't find any good answers. So the command line statement helps with bugging?
Thanks very much for the module, glad to see it's still being monitored! catubc (You can close this also).
under bash the command
export OCAMLRUNPARAM='b'
@catubc you can close the issue yourself since your opened it. I cannot.
Thanks very much.
Thanks Francois!
On Sun, Mar 11, 2018 at 05:29:30PM -0700, Francois BERENGER wrote:
@catubc you can close the issue yourself since your opened it. I cannot.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.*
-- Roberto Di Cosmo
Computer Science Professor (on leave at INRIA from IRIF/University Paris Diderot)
Software Heritage E-mail : roberto@dicosmo.org
INRIA Web : http://www.dicosmo.org
Bureau C123 Twitter : http://twitter.com/rdicosmo
2, Rue Simone Iff Tel : +33 1 80 49 44 42
CS 42112
75589 Paris Cedex 12
GPG fingerprint 2931 20CE 3A5A 5390 98EC 8BFC FCCA C3BE 39CB 12D3
Hi I've been using parmap for over a year, but I noticed now that for very large memory tasks (e.g. >100GB) sometimes half the cores stop half way through processing.
I'm running on a dual-xeon workstation (8 physical cores x 2 processors).
Any suggestions for why this might happen? Any ways to diagnose such a problem?
Thanks!
**** CALLING CODE ** spike_trains = parmap.map(deconvolve_parallel_new, zip(idx_list,proc_indexes), params, processes=n_processors)
** OUTPUT *** (Cores 0,1,4,6 eventually stop running) ... ('# of chunks: ', 8, ' # cores: ', 8) ('Start time for deconvolution: ', 1520724614.860805) (0, 47000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (11750000, 11797000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (82250000, 82297000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (23500000, 23547000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (58750000, 58797000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) ('Processor: ', 1, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 0, ' in dot product loop ...') (35250000, 35297000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) ('Processor: ', 2, 'chunk: ', 0, ' in dot product loop ...') (47000000, 47047000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) (70500000, 70547000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 0, ' of ', 250) ('Processor: ', 6, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 1, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 0, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 0, ' in thresholding loop ...') ('Processor: ', 1, 'cleaned spikes: ', 28143) (11797000, 11844000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 1, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 30809) (47000, 94000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 0, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33734) (23547000, 23594000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 2, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 1, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 44277) (82297000, 82344000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 4, 'cleaned spikes: ', 33821) (47047000, 47094000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 7, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 1, 'cleaned spikes: ', 28213) (11844000, 11891000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 1, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37354) (35297000, 35344000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 1, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 34794) (94000, 141000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 5, 'cleaned spikes: ', 38211) (58797000, 58844000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 0, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33733) (23594000, 23641000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 2, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 6, 'cleaned spikes: ', 41285) (70547000, 70594000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 1, ' of ', 250) ('Processor: ', 2, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 1, ' in dot product loop ...') ('Processor: ', 1, 'cleaned spikes: ', 28059) (11891000, 11938000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 7, 'cleaned spikes: ', 34761) (82344000, 82391000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 1, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 1, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 30164) (141000, 188000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 0, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 6, 'chunk: ', 1, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33902) (23641000, 23688000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 2, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 1, 'cleaned spikes: ', 28371) (11938000, 11985000, 122) ('Processor: ', 1, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 1, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 28222) (188000, 235000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 0, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 41564) (82391000, 82438000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 7, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33347) (23688000, 23735000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 2, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 26848) (235000, 282000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 0, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33229) (23735000, 23782000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 2, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 39721) (82438000, 82485000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 7, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 26138) (282000, 329000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 0, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 4, 'cleaned spikes: ', 32354) (47094000, 47141000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 4, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 25733) (329000, 376000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 0, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33537) (23782000, 23829000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 2, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37381) (35344000, 35391000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 4, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42143) (82485000, 82532000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 7, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 6, 'cleaned spikes: ', 39024) (70594000, 70641000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 7, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 43441) (58844000, 58891000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 2, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 24679) (376000, 423000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 6, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 2, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33029) (23829000, 23876000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 2, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 2, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36239) (35391000, 35438000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 24633) (423000, 470000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 0, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 35683) (82532000, 82579000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 7, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 4, 'cleaned spikes: ', 36150) (47141000, 47188000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 0, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33347) (23876000, 23923000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 2, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 24346) (470000, 517000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 0, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 6, 'cleaned spikes: ', 36645) (70641000, 70688000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 0, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36694) (35438000, 35485000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 3, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 39495) (58891000, 58938000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 3, ' of ', 250) ('Processor: ', 6, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 3, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42581) (82579000, 82626000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 7, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23995) (517000, 564000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 0, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33645) (23923000, 23970000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 2, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 3, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23882) (564000, 611000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 0, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37543) (35485000, 35532000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 4, 'cleaned spikes: ', 37592) (47188000, 47235000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 3, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34124) (23970000, 24017000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 3, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 39159) (82626000, 82673000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 7, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 24011) (611000, 658000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 0, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 40356) (58938000, 58985000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 5, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 6, 'cleaned spikes: ', 50675) (70688000, 70735000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 4, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 37562) (35532000, 35579000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 6, 'chunk: ', 4, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23655) (658000, 705000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 3, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33782) (24017000, 24064000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 2, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 4, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 41785) (82673000, 82720000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 7, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 4, 'cleaned spikes: ', 35244) (47235000, 47282000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 7, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23572) (705000, 752000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 0, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33803) (24064000, 24111000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 2, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36564) (35579000, 35626000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 3, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23916) (752000, 799000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 0, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 41868) (82720000, 82767000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 7, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33892) (24111000, 24158000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 2, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 6, 'cleaned spikes: ', 38188) (70735000, 70782000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 23726) (799000, 846000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 36734) (35626000, 35673000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 0, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 6, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 42797) (58985000, 59032000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 5, ' of ', 250) ('Processor: ', 2, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 5, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 5, ' in thresholding loop ...') ('Processor: ', 4, 'cleaned spikes: ', 37038) (47282000, 47329000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 23638) (846000, 893000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 0, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 43500) (82767000, 82814000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 4, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33747) (24158000, 24205000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 2, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36545) (35673000, 35720000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 3, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 22953) (893000, 940000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 3, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33721) (24205000, 24252000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 2, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 6, 'cleaned spikes: ', 36094) (70782000, 70829000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 7, 'cleaned spikes: ', 35595) (82814000, 82861000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 23794) (940000, 987000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 7, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 6, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 36168) (59032000, 59079000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 6, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 37143) (35720000, 35767000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 7, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 6, ' in dot product loop ...') ('Processor: ', 6, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 6, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23689) (987000, 1034000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 0, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 4, 'cleaned spikes: ', 40212) (47329000, 47376000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 33371) (24252000, 24299000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 2, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 44336) (82861000, 82908000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 37154) (35767000, 35814000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 7, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23613) (1034000, 1081000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 22, ' of ', 250) ('Processor: ', 3, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 22, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 22, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 6, 'cleaned spikes: ', 40275) (70829000, 70876000, 122) ('Processor: ', 6, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 6, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33745) (24299000, 24346000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 2, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 39902) (59079000, 59126000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 7, ' of ', 250) ('Processor: ', 0, 'cleaned spikes: ', 23536) (1081000, 1128000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 23, ' of ', 250) ('Processor: ', 0, 'chunk: ', 23, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 7, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 23, ' in thresholding loop ...') ('Processor: ', 4, 'cleaned spikes: ', 35044) (47376000, 47423000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 5, 'chunk: ', 7, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42459) (82908000, 82955000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 7, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23798) (1128000, 1175000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 24, ' of ', 250) ('Processor: ', 0, 'chunk: ', 24, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33405) (24346000, 24393000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 2, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37963) (35814000, 35861000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 0, 'chunk: ', 24, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23804) (1175000, 1222000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 25, ' of ', 250) ('Processor: ', 0, 'chunk: ', 25, ' in dot product loop ...') ('Processor: ', 0, 'chunk: ', 25, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33620) (24393000, 24440000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 2, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 38697) (82955000, 83002000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 7, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 24238) (1222000, 1269000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 26, ' of ', 250) ('Processor: ', 0, 'chunk: ', 26, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 0, 'chunk: ', 26, ' in thresholding loop ...') ('Processor: ', 0, 'cleaned spikes: ', 23951) (1269000, 1316000, 122) ('Processor: ', 0, ' Loading : ', 96.256, 'MB, chunk: ', 27, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 33508) (24440000, 24487000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 0, 'chunk: ', 27, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 4, 'cleaned spikes: ', 37434) (47423000, 47470000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 2, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 4, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 42054) (59126000, 59173000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 8, ' of ', 250) ('Processor: ', 7, 'cleaned spikes: ', 42837) (83002000, 83049000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 7, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 8, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 8, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37090) (35861000, 35908000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 3, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33851) (24487000, 24534000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 2, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 40524) (83049000, 83096000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 7, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 4, 'cleaned spikes: ', 37956) (47470000, 47517000, 122) ('Processor: ', 4, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 34146) (24534000, 24581000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 22, ' of ', 250) ('Processor: ', 2, 'chunk: ', 22, ' in dot product loop ...') ('Processor: ', 4, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 22, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 41225) (59173000, 59220000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 9, ' of ', 250) ('Processor: ', 5, 'chunk: ', 9, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37287) (35908000, 35955000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 3, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 9, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 40758) (83096000, 83143000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 7, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34011) (24581000, 24628000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 23, ' of ', 250) ('Processor: ', 2, 'chunk: ', 23, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 23, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 39093) (59220000, 59267000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 10, ' of ', 250) ('Processor: ', 5, 'chunk: ', 10, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37200) (35955000, 36002000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 3, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 10, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33736) (24628000, 24675000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 24, ' of ', 250) ('Processor: ', 2, 'chunk: ', 24, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42525) (83143000, 83190000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 2, 'chunk: ', 24, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36865) (36002000, 36049000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 3, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33531) (24675000, 24722000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 25, ' of ', 250) ('Processor: ', 5, 'cleaned spikes: ', 40783) (59267000, 59314000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 11, ' of ', 250) ('Processor: ', 2, 'chunk: ', 25, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 11, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 11, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 25, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 47975) (83190000, 83237000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 7, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33197) (24722000, 24769000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 26, ' of ', 250) ('Processor: ', 2, 'chunk: ', 26, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 35812) (59314000, 59361000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 12, ' of ', 250) ('Processor: ', 5, 'chunk: ', 12, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 26, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 45069) (36049000, 36096000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 3, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 12, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 38380) (83237000, 83284000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 33467) (24769000, 24816000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 27, ' of ', 250) ('Processor: ', 7, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 27, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 27, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 41816) (59361000, 59408000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 13, ' of ', 250) ('Processor: ', 3, 'cleaned spikes: ', 36041) (36096000, 36143000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 5, 'chunk: ', 13, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 13, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34213) (24816000, 24863000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 28, ' of ', 250) ('Processor: ', 2, 'chunk: ', 28, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 34783) (83284000, 83331000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 22, ' of ', 250) ('Processor: ', 7, 'chunk: ', 22, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 28, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 22, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36062) (36143000, 36190000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 3, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 38813) (59408000, 59455000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 14, ' of ', 250) ('Processor: ', 5, 'chunk: ', 14, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 14, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34197) (24863000, 24910000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 29, ' of ', 250) ('Processor: ', 2, 'chunk: ', 29, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 29, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 47942) (83331000, 83378000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 23, ' of ', 250) ('Processor: ', 7, 'chunk: ', 23, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 34400) (36190000, 36237000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 3, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 23, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 39521) (59455000, 59502000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 15, ' of ', 250) ('Processor: ', 5, 'chunk: ', 15, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34706) (24910000, 24957000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 30, ' of ', 250) ('Processor: ', 2, 'chunk: ', 30, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 15, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 30, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 35234) (83378000, 83425000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 24, ' of ', 250) ('Processor: ', 7, 'chunk: ', 24, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 35514) (36237000, 36284000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 3, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 24, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34095) (24957000, 25004000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 31, ' of ', 250) ('Processor: ', 3, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 31, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 41911) (59502000, 59549000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 16, ' of ', 250) ('Processor: ', 5, 'chunk: ', 16, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 31, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 16, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 37764) (36284000, 36331000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 22, ' of ', 250) ('Processor: ', 3, 'chunk: ', 22, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34068) (25004000, 25051000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 32, ' of ', 250) ('Processor: ', 2, 'chunk: ', 32, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 45370) (83425000, 83472000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 25, ' of ', 250) ('Processor: ', 7, 'chunk: ', 25, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 22, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 32, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 25, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 43003) (59549000, 59596000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 17, ' of ', 250) ('Processor: ', 5, 'chunk: ', 17, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 17, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 31876) (36331000, 36378000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 23, ' of ', 250) ('Processor: ', 2, 'cleaned spikes: ', 34136) (25051000, 25098000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 33, ' of ', 250) ('Processor: ', 3, 'chunk: ', 23, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 33, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 23, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 33, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 44092) (83472000, 83519000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 26, ' of ', 250) ('Processor: ', 7, 'chunk: ', 26, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 26, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33309) (25098000, 25145000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 34, ' of ', 250) ('Processor: ', 2, 'chunk: ', 34, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 44921) (59596000, 59643000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 18, ' of ', 250) ('Processor: ', 5, 'chunk: ', 18, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 38187) (36378000, 36425000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 24, ' of ', 250) ('Processor: ', 3, 'chunk: ', 24, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 34, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 18, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 24, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 43008) (83519000, 83566000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 27, ' of ', 250) ('Processor: ', 7, 'chunk: ', 27, ' in dot product loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34192) (25145000, 25192000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 35, ' of ', 250) ('Processor: ', 2, 'chunk: ', 35, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 27, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 35, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 36091) (36425000, 36472000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 25, ' of ', 250) ('Processor: ', 3, 'chunk: ', 25, ' in dot product loop ...') ('Processor: ', 5, 'cleaned spikes: ', 43376) (59643000, 59690000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 19, ' of ', 250) ('Processor: ', 5, 'chunk: ', 19, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 25, ' in thresholding loop ...') ('Processor: ', 5, 'chunk: ', 19, ' in thresholding loop ...') ('Processor: ', 7, 'cleaned spikes: ', 31721) (83566000, 83613000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 28, ' of ', 250) ('Processor: ', 7, 'chunk: ', 28, ' in dot product loop ...')
('Processor: ', 2, 'cleaned spikes: ', 34201) (25192000, 25239000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 36, ' of ', 250) ('Processor: ', 7, 'chunk: ', 28, ' in thresholding loop ...') ('Processor: ', 2, 'chunk: ', 36, ' in dot product loop ...') ('Processor: ', 3, 'cleaned spikes: ', 30913) (36472000, 36519000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 26, ' of ', 250) ('Processor: ', 3, 'chunk: ', 26, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 36, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 26, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 38935) (59690000, 59737000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 20, ' of ', 250) ('Processor: ', 5, 'chunk: ', 20, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 20, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 33964) (25239000, 25286000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 37, ' of ', 250) ('Processor: ', 2, 'chunk: ', 37, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 42433) (83613000, 83660000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 29, ' of ', 250) ('Processor: ', 7, 'chunk: ', 29, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 37, ' in thresholding loop ...') ('Processor: ', 7, 'chunk: ', 29, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 35592) (36519000, 36566000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 27, ' of ', 250) ('Processor: ', 3, 'chunk: ', 27, ' in dot product loop ...') ('Processor: ', 3, 'chunk: ', 27, ' in thresholding loop ...') ('Processor: ', 5, 'cleaned spikes: ', 36710) (59737000, 59784000, 122) ('Processor: ', 5, ' Loading : ', 96.256, 'MB, chunk: ', 21, ' of ', 250) ('Processor: ', 5, 'chunk: ', 21, ' in dot product loop ...') ('Processor: ', 5, 'chunk: ', 21, ' in thresholding loop ...') ('Processor: ', 2, 'cleaned spikes: ', 34275) (25286000, 25333000, 122) ('Processor: ', 2, ' Loading : ', 96.256, 'MB, chunk: ', 38, ' of ', 250) ('Processor: ', 2, 'chunk: ', 38, ' in dot product loop ...') ('Processor: ', 7, 'cleaned spikes: ', 38651) (83660000, 83707000, 122) ('Processor: ', 7, ' Loading : ', 96.256, 'MB, chunk: ', 30, ' of ', 250) ('Processor: ', 7, 'chunk: ', 30, ' in dot product loop ...') ('Processor: ', 2, 'chunk: ', 38, ' in thresholding loop ...') ('Processor: ', 3, 'cleaned spikes: ', 33573) (36566000, 36613000, 122) ('Processor: ', 3, ' Loading : ', 96.256, 'MB, chunk: ', 28, ' of ', 250) ('Processor: ', 3, 'chunk: ', 28, ' in dot product loop ...') ('Processor: ', 7, 'chunk: ', 30, ' in thresholding loop ...') ('Processor: ', 3, 'chunk: ', 28, ' in thresholding loop ...')