seung-lab / znn-release

Multi-core CPU implementation of deep learning for 2D and 3D sliding window convolutional networks (ConvNets).
GNU General Public License v3.0
94 stars 33 forks source link

MALIS: IndexError: list index out of range #41

Closed petteriTeikari closed 8 years ago

petteriTeikari commented 8 years ago

When trying the segmentation for 2-PM data with MALIS weighing on, I get the following error:

znn-release/python/emirt/volume_util.py:160: RuntimeWarning: overflow encountered in double_scalars
  tsz[r1-1] = tsz[r1-1] + tsz[r2-1]

Traceback (most recent call last):
  File "train.py", line 192, in <module>
    main( sys.argv[1] )
  File "train.py", line 112, in main
    re += rand_errors.values()[0]
IndexError: list index out of range

The output for rand_errors indeed seems empty from that call in train.py:

malis_weights, rand_errors = cost_fn.malis_weight(pars, props, lbl_outs)

But how should that be defined then so that I get some rand errors? malis_weights and grdts contained values with the output key

xiuliren commented 8 years ago

are you using the master branch?

could you please try the malis branch?

petteriTeikari commented 8 years ago

Oh, well I cloned the malis branch and compiled both pymalis.cpp and pyznn.cpp, but still get the following then trying to train with the default config.cfg file:

znn-releaseMALIS/python$ python train.py config.cfg 
Traceback (most recent call last):
  File "train.py", line 9, in <module>
    import test
  File "znn-releaseMALIS/python/test.py", line 9, in <module>
    from core import pyznn
ImportError: No module named core
xiuliren commented 8 years ago

Oh, I did not add the __init__.py file. Please update the code and try again.

petteriTeikari commented 8 years ago

Thanks for that, so now I got pass that but had then:

start training...
start from  99401
Segmentation fault (core dumped)

Which may then be for several reasons I guess

petteriTeikari commented 8 years ago

Do you have any preferred way to get .crash file or core if there is something to be done for that?

xiuliren commented 8 years ago

There is a is_log flag to turn on the log recording system. This may provide some hints.

xiuliren commented 8 years ago

@petteriTeikari Here is a warning. Note that the malis function is still experimental. Whether it is effective is not quite clear.

hsseung commented 8 years ago

@petteriTeikari we recommend that you use the reorganize or master branch. Other branches are experimental with known bugs. MALIS is not working yet.

petteriTeikari commented 8 years ago

Okay for the MALIS issues @jingpengwu and @hsseung, and I keep using the master branch then