avanetten / simrdwn

Rapid satellite imagery object detection
214 stars 154 forks source link

Receiving just "Killed" after augmentation process. #69

Closed jacquesmats closed 5 years ago

jacquesmats commented 5 years ago

I keep receiving the message "Killed" after trying to test the model on COWC dataset. The following command:

python /simrdwn/simrdwn/core/simrdwn.py 
--framework yolt2 
--mode test 
--outname dense_cowc 
--label_map_path /simrdwn/data/train_data/class_labels_car.pbtxt 
--train_model_path /simrdwn/results/train_yolt2_dense_cars_reduced_2019_07_27_14-20-36 
--weight_file ave_dense_final.weights 
--yolt_cfg_file ave_dense.cfg 
--testims_dir /simrdwn/data/test_images/cowc/Utah_AGRC  
--keep_test_slices 0 
--test_slice_sep __ 
--test_make_legend_and_title 0 
--edge_buffer_test 1 
--test_box_rescale_frac 1 
--plot_thresh_str 0.2 
--slice_sizes_str 416 
--slice_overlap 0.2 
--alpha_scaling 1 
--show_labels 1

Results in:

10890000
10900000
10910000
10920000
10930000
  set image path, make sure the image exists...
Killed 

It seems like a loop insight the augment_df() function in post_process.py.

Did anyone go through this?

jacquesmats commented 5 years ago

I guess it was my GPU, I couldn't reproduce this in other machines with more recent GPUs.