weiliu89 / caffe

Caffe: a fast open framework for deep learning.
http://caffe.berkeleyvision.org/
Other
4.77k stars 1.68k forks source link

./data/VOC0712/create_list.sh , something wrong.... #326

Open Bonsen opened 7 years ago

Bonsen commented 7 years ago

When I input ./data/VOC0712/create_list.sh , I got some problems: Create list for VOC2007 trainval... sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_img.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_img.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_label.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_label.txt' Create list for VOC2012 trainval... sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_img.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_img.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_label.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_label.txt' Create list for VOC2007 test... sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/test_img.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/test_img.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/test_label.txt' sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/test_label.txt' I1204 21:47:14.832890 1894122240 get_image_size.cpp:61] A total of 4952 images. E1204 21:47:14.833708 1894122240 io.cpp:183] Could not open or find file /Users/bonsen/data/VOCdevkit/000001 E1204 21:47:14.834120 1894122240 io.cpp:183] Could not open or find file /Users/bonsen/data/VOCdevkit/000002 E1204 21:47:14.834144 1894122240 io.cpp:183] Could not open or find file /Users/bonsen/data/VOCdevkit/000003 E1204 21:47:14.834161 1894122240 io.cpp:183] Could not open or find file /Users/bonsen/data/VOCdevkit/000004 E1204 21:47:14.834177 1894122240 io.cpp:183] Could not open or find file /Users/bonsen/data/VOCdevkit/000006 ..... ......

pic:/Users/bonsen/data/ code: /Users/bonsen/caffe/

Sundrops commented 7 years ago

check data/VOC0712/labelmap_voc.prototxt

Bonsen commented 7 years ago

@Sundrops data/VOC0712/labelmap_voc.prototxt: item { name: "none_of_the_above" label: 0 display_name: "background" } item { name: "aeroplane" label: 1 display_name: "aeroplane" } item { name: "bicycle" label: 2 display_name: "bicycle" } item { name: "bird" label: 3 display_name: "bird" } item { name: "boat" label: 4 display_name: "boat" } item { name: "bottle" label: 5 display_name: "bottle" } item { name: "bus" label: 6 display_name: "bus" } item { name: "car" label: 7 display_name: "car" } item { name: "cat" label: 8 display_name: "cat" } item { name: "chair" label: 9 display_name: "chair" } item { name: "cow" label: 10 display_name: "cow" } item { name: "diningtable" label: 11 display_name: "diningtable" } item { name: "dog" label: 12 display_name: "dog" } item { name: "horse" label: 13 display_name: "horse" } item { name: "motorbike" label: 14 display_name: "motorbike" } item { name: "person" label: 15 display_name: "person" } item { name: "pottedplant" label: 16 display_name: "pottedplant" } item { name: "sheep" label: 17 display_name: "sheep" } item { name: "sofa" label: 18 display_name: "sofa" } item { name: "train" label: 19 display_name: "train" } item { name: "tvmonitor" label: 20 display_name: "tvmonitor" }

Sundrops commented 7 years ago

Maybe you should check data path and format according to log.

Bonsen commented 7 years ago

@Sundrops pic1:/Users/bonsen/data/VOCdevkit/VOC2007 /Users/bonsen/data/VOCdevkit/VOC2012 code: /Users/bonsen/caffe/* I followed the homepage' guidance.....everything was ok before I ran the create_list.sh.......

Bonsen commented 7 years ago

@Sundrops In centos : sed -i "s/^/VOC2007\/JPEGImages\//g" "/home/yingxiao/git/caffe-ssd/data/VOC0712/trainval_img.txt" ,it's ok.

IF in Mac: BH:~ bonsen$ sed -i "s/^/VOC2007\/JPEGImages\//g" "/Users/bonsen/caffe/data/VOC0712/trainval_img.txt" I got like this: sed: 1: "/Users/bonsen/caffe/dat ...": undefined label 'onsen/caffe/data/VOC0712/trainval_img.txt'

weiliu89 commented 7 years ago

The code is only tested on Linux (Ubuntu).

Bonsen commented 7 years ago

@weiliu89 I see....

Bonsen commented 7 years ago

@Sundrops @weiliu89 Thanks

igisav commented 7 years ago

For Mac I removed $HOME/ in _createlist.sh and _createdata.sh And in _createlist.sh instead of using sed command run simple python script python $bash_dir/change.py $name $img_file $label_file

where change.py:



name, img_file, label_file  = sys.argv[1:4]

lines = [name + '/JPEGImages/' + line.rstrip('\n') + '.jpg\n' for line in open(img_file)]

file = open(img_file, "w")
file.writelines(lines)

lines = [name + '/Annotations/' + line.rstrip('\n') + '.xml\n' for line in open(label_file)]

file = open(label_file, "w")
file.writelines(lines)```
yiakwy commented 7 years ago

@Bonsen I have the same problem in my mac os. Have you figure out what the hell it is in the two scripts?

yiakwy commented 7 years ago

@weiliu89 Could you tell me why this happened?

http://stackoverflow.com/questions/4247068/sed-command-with-i-option-failing-on-mac-but-works-on-linux ./data/VOC0712/create_list.sh > create_list.log 2>&1

1 [test-cmd] : test $dst_file '/Users/wangyi/GitHub/SSD/caffe/data/VOC0712/trainval.txt' existing 2 Create list for VOC2007 trainval... 3 [test-cmd] : editing image file /Users/wangyi/GitHub/SSD/caffe/data/VOC0712/trainval_img.txt 4 sed: angyi/GitHub/SSD/caffe/data/VOC0712/trainval_img.txt: No such file or directory 5 sed: angyi/GitHub/SSD/caffe/data/VOC0712/trainval_img.txt: No such file or directory 6 sed: angyi/GitHub/SSD/caffe/data/VOC0712/trainval_label.txt: No such file or directory 7 sed: angyi/GitHub/SSD/caffe/data/VOC0712/trainval_label.txt: No such file or directory 8 Create list for VOC2012 trainval... 9 [test-cmd] : editing image file /Users/wangyi/GitHub/SSD/caffe/data/VOC0712/trainval_img.txt 10 sed: angyi/GitHub/SSD/caffe/data/VOC0712/trainval_img.txt: No such file or directory 11 sed: angyi/GitHub/SSD/caffe/data/VOC0712/trainval_img.txt: No such file or directory 12 sed: angyi/GitHub/SSD/caffe/data/VOC0712/trainval_label.txt: No such file or directory 13 sed: angyi/GitHub/SSD/caffe/data/VOC0712/trainval_label.txt: No such file or directory 14 [test-cmd] : shuffle trainval file 15 [test-cmd] : target : /Users/wangyi/GitHub/SSD/caffe/data/VOC0712/trainval.txt 16 [test-cmd] : rand file : /Users/wangyi/GitHub/SSD/caffe/data/VOC0712/trainval.txt.random 17 [test-cmd] : test $dst_file '/Users/wangyi/GitHub/SSD/caffe/data/VOC0712/test.txt' existing 18 Create list for VOC2007 test... 19 [test-cmd] : editing image file /Users/wangyi/GitHub/SSD/caffe/data/VOC0712/test_img.txt 20 sed: angyi/GitHub/SSD/caffe/data/VOC0712/test_img.txt: No such file or directory 21 sed: angyi/GitHub/SSD/caffe/data/VOC0712/test_img.txt: No such file or directory 22 sed: angyi/GitHub/SSD/caffe/data/VOC0712/test_label.txt: No such file or directory 23 sed: angyi/GitHub/SSD/caffe/data/VOC0712/test_label.txt: No such file or directory 24 [test-cmd] : gen image name and size

prefix $bashdir should be "wangyi/GitHub/" not "angyi/GitHub"

Bonsen commented 7 years ago

@yiakwy I use centos later.

yiakwy commented 7 years ago

@Bonsen I have already solved the problem. You can refer to my solution.

sreevasu commented 7 years ago

iam also getting same problem in ubuntu, can any one clarify my problem sh create_list.sh create_list.sh: 5: create_list.sh: Bad substitution create_list.sh: 15: create_list.sh: [[: not found Create list for VOC2007 trainval... create_list.sh: 15: create_list.sh: [[: not found Create list for VOC2012 trainval... create_list.sh: 39: [: trainval: unexpected operator create_list.sh: 45: [: trainval: unexpected operator create_list.sh: 15: create_list.sh: [[: not found Create list for VOC2007 test... create_list.sh: 15: create_list.sh: [[: not found Create list for VOC2012 test... cp: cannot stat '/home/srinivas/data/VOCdevkit/VOC2012/ImageSets/Main/test.txt': No such file or directory sed: can't read /home/srinivas/srinivas/caffe/data/VOC0712/test_img.txt: No such file or directory sed: can't read /home/srinivas/srinivas/caffe/data/VOC0712/test_img.txt: No such file or directory cp: cannot stat '/home/srinivas/data/VOCdevkit/VOC2012/ImageSets/Main/test.txt': No such file or directory sed: can't read /home/srinivas/srinivas/caffe/data/VOC0712/test_label.txt: No such file or directory sed: can't read /home/srinivas/srinivas/caffe/data/VOC0712/test_label.txt: No such file or directory paste: /home/srinivas/srinivas/caffe/data/VOC0712/test_img.txt: No such file or directory create_list.sh: 39: [: test: unexpected operator create_list.sh: 45: [: test: unexpected operator

skathi1991 commented 7 years ago

I have the same problem can @yiakwy could you send me your solution ?