Stops on step 10 - empty array in kitti_loader.py?

[bw4sz]

Thanks for some amazing work in getting this started.

Any suggestions for a run that dies after step 10 on a single GPU?

Traceback (most recent call last):
  File "/home/b.weinstein/voxelnet/train.py", line 202, in <module>
    tf.app.run(main)
  File "/home/b.weinstein/miniconda3/envs/voxelnet/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 48, in run
    _sys.exit(main(_sys.argv[:1] + flags_passthrough))
  File "/home/b.weinstein/voxelnet/train.py", line 131, in main
    batch = sample_test_data(val_dir, args.single_batch_size * cfg.GPU_USE_COUNT, multi_gpu_sum=cfg.GPU_USE_COUNT)
  File "/home/b.weinstein/voxelnet/utils/kitti_loader.py", line 140, in sample_test_data
    _, per_vox_feature, per_vox_number, per_vox_coordinate = build_input(voxel[idx * single_batch_size:(idx + 1) * single_batch_size])
  File "/home/b.weinstein/voxelnet/utils/kitti_loader.py", line 172, in build_input
    feature = np.concatenate(feature_list)
ValueError: need at least one array to concatenate

'Default' (orange) is a CPU run (still going) The date (blue) was a Tesla K80 GPU run.

Because the CPU is slower, I don't know yet if it dies, i'll update if it makes it to step 15.

I'm going to start playing around with batch size? The error would suggest that its picking up an empty array?

May be similar to #21 and #11 , did anyone have success or a suspicion on what might have cause this?

[bw4sz]

For future users, be careful of the naming of the validation directory the fork for @jeasinema is testing, but the fork at @qianguih is validation. It was hardcoded in and looking for a dir.

Correcting this allows training to proceed.

[adioshun]

@bw4sz I got a "ValueError: need at least one array to concatenate" error. I solve the problem by generate validation folder with ln -s training validation . is this ok?