weiliu89 / caffe

Caffe: a fast open framework for deep learning.
http://caffe.berkeleyvision.org/
Other
4.77k stars 1.67k forks source link

Where can i download PASCAL VOC 07++12+coco dataset #335

Open David-Jin opened 7 years ago

David-Jin commented 7 years ago

Hi: I want to reproduce the result of SSD512 model in 07++12 and 07+12+COCO and 07++12+COCO but i can't find these datasets except PASCAL VOC 07+12 dataset. Are there any scripts to create the "trainval.txt, test.txt, test_name_size.txt and label_map.txt" files? if these data set (07++12 and 07+12+COCO and 07++12+COCO) is got. Anyone can help?

youngwanLEE commented 7 years ago

@David-Jin Did you solve this problem ? I want to solve this,too.

David-Jin commented 7 years ago

No,I didn't. No one respond to this problem.

???? iPhone

? 2016?12?10??12:02?youngwanLEE notifications@github.com<mailto:notifications@github.com> ???

@David-Jinhttps://github.com/David-Jin Did you solve this problem ? I want to solve this,too.

- You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/weiliu89/caffe/issues/335#issuecomment-266177267, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ANdv4FfPEpSs6R9o-xw56YOGbcRKNOACks5rGiQ6gaJpZM4LHScq.

weiliu89 commented 7 years ago

I trained from COCO first and then finetune on 07+12

David-Jin commented 7 years ago

@weiliu89 so is there no such datasheet named 07++12 ?

weiliu89 commented 7 years ago

07++12 includes 07 test in training as well. You can refer to VOC0712 and see how to create the lmdb for 07++12.

KevinYuk commented 7 years ago

Hi @weiliu89,

After carefully read the related issues, I found that you said:

  1. If there is overlap between your classes and VOC classes, you should extract the corresponding classification kernels from the SSD VOC model. (from #224 )
  2. If you try to fine-tune from an existing SSD model (e.g. SSD trained from ILSVRC DET or COCO), then you need to change the name for your confidence prediction layers (to not load the confidence predictions from an existing SSD model), and set a smaller learning rate. (from #120 )

But there is overlap classes between COCO and VOC(e.g.: class person, bicycle etc. I am trying fine-tune from COCO to VOC). If follow your advice 1, I should extract corresponding classification kernels from the COCO-SSD model; If follow your advice 2, I can directly change the name of all the confidence prediction layers, which means I drop the previous classification kernels weights even for the overlap classes.

Q1. My understanding is that both advices are OK. For simplicity, we can follow advice 2(But advice 1 here may reach higher mAP). We can let networks learn again for the overlap classes. Right? Q2. smaller learning rates are for all the confidence prediction layers(aka: mbox_conf sub string layers), right?

Thanks a lot.

ujsyehao commented 6 years ago

Hi, @KevinYuk Have you solved the problem?

ujsyehao commented 6 years ago

How to train 07+12+coco dataset?

KevinYuk commented 6 years ago

@ujsyehao Yes. I solved it. If you want to get higher accuracy without changing your SSD network topo, you should:

  1. train you SSD based on coco dataset firstly(should change channel num to fit coco object category);
  2. Drop extended layers weights(just simply rename layers names and change channel num) of your SSD;
  3. Fine tune from step2 based on voc07+12. Thanks.
ujsyehao commented 6 years ago

@KevinYuk Thank you for your reply! I have some problems listed below:

KevinYuk commented 6 years ago

I train SSD on coco dataset with the pretrain model(weiliu provides). A: I train base imagenet model(vgg or resnet) by myself. However, If you just use weiliu provided, I think it's ok.

It means that follow your advice 2, rename all confidence prediction layers. Do I need to remove location regression layers? A: I don't remove location regression layers, and still reach good acc boost. However, you can try to remove them to do comparison and tell me the result :) .

When I finetune trained SSD-COCO model on voc0712 dataset, Do I need to use smaller learning rate for all confidence layers? (That is your second question) A: I don't use smaller lr. However, you can try more lr.

ujsyehao commented 6 years ago

Thank you! @KevinYuk I will do experiments follow your advice, Let's keep in touch! This is my mail (rawk.vx@gmail.com).

ujsyehao commented 6 years ago

I follow your advice

remove confidence prediction layers, I use lr = 0.0005.

The result is 3 percentage points lower than author reports. I am trying to adjustment.

LiMengyang990726 commented 5 years ago

Hi, may I ask if I am able to obtain the config file for SSD512 model?