MasterBin-IIAU / Unicorn

[ECCV'22 Oral] Towards Grand Unification of Object Tracking
MIT License
953 stars 87 forks source link

关于找不到文件 About file not found:../Unicorn_outputs/unicorn_det_convnext_tiny_800x1280/best_ckpt.pth #11

Closed 972821054 closed 1 year ago

972821054 commented 2 years ago

Hello, you provided a good way to solve the exhibition. When I tried to carry out multi-target tracking training, I found that the pre training weight you provided could not be obtained. Have you modified the code, or is there any way to obtain it? image

MasterBin-IIAU commented 2 years ago

@972821054 Hi, as mentioned in the model_zoo.md, please download pre-trained weights and put it under the Unicorn_outputs folder.

972821054 commented 2 years ago

@MasterBin-IIAU OK, thank you very much! Another question is whether this method can be used in the data set designed by yourself. What should be paid attention to in the design process? I have made a data set about vehicle multi-target tracking, which I want to apply to your method.

MasterBin-IIAU commented 2 years ago

@972821054 Hi, according to the number of classes of tracked objects in your dataset, you may need to change self.num_classes in the experiment file. By default, self.num_classes=8 for BDD100K and self.num_classes=1 for MOT challenge. Then you may need to change here for loading the COCO-pretrained weights of classifiers. Besides, you need to write your own mot dataset for training on it.

972821054 commented 2 years ago

@MasterBin-IIAU Have you ever asked this question? I haven't solved this problem with online methods. Sorry for the inconvenience! image image

MasterBin-IIAU commented 2 years ago

@972821054 It seems the version of mmcv is not compatible with that of your cuda. Please refer to the official website of mmcv for a compatible version.

972821054 commented 2 years ago

@MasterBin-IIAU thank you very much!I still keep reporting errors. I'll try reinstalling virtual mirage. Thank you again.

972821054 commented 2 years ago

@MasterBin-IIAU Hello, is your Python version 3.7? When I run, I report an error and need to use version 3.8. image

The code I run is: image

MasterBin-IIAU commented 2 years ago

@972821054 Yes, we use python 3.7

972821054 commented 2 years ago

@MasterBin-IIAU Hello, if I want to do mot training, which pre training weight do I need? Can my {exp_name} be directly set as the example you give? image

MasterBin-IIAU commented 2 years ago

@972821054 if you want to train unicorn with convnext-tiny backbone for object tracking, use pretrained weights of unicorn_det_convnext_tiny_800x1280

972821054 commented 2 years ago

@MasterBin-IIAU Thank you for your valuable suggestions. I have three questions to ask you.

First: for motchallenge type training set (the organization is similar to mot16), but there is no thing det.txt(There is a det folder in the directory. There is a det.txt file in the folder, but the file has no content) in my data set . In this case, can I use the file convert_mot17_to_coco provided by you to Generate json file?

Second: if I use single classification here, does it need to be adjusted? In the case of single classification multi-target tracking, Do self.num_ classes need no adjustment? e7bf2fc2137c44b20f06f2fb98e504c

The third one: whether the data set is put correctly here, and in the last line of comment, for omni_dataset_mot is correct? 7db4c4bcf233bbb897ff47feed1d70f

Thank you again for your valuable comments!

972821054 commented 2 years ago

@MasterBin-IIAU Hello, if I want to use Unicorn track tiny mot Only, which configurations and parameters need to be changed?And if the test is carried out, which parameters need to be modified? image image

MasterBin-IIAU commented 2 years ago

@MasterBin-IIAU Thank you for your valuable suggestions. I have three questions to ask you.

First: for motchallenge type training set (the organization is similar to mot16), but there is no thing det.txt(There is a det folder in the directory. There is a det.txt file in the folder, but the file has no content) in my data set . In this case, can I use the file convert_mot17_to_coco provided by you to Generate json file?

Second: if I use single classification here, does it need to be adjusted? In the case of single classification multi-target tracking, Do self.num_ classes need no adjustment? e7bf2fc2137c44b20f06f2fb98e504c

The third one: whether the data set is put correctly here, and in the last line of comment, for omni_dataset_mot is correct? 7db4c4bcf233bbb897ff47feed1d70f

Thank you again for your valuable comments!

Answer to question 1: Yes, we do not need det.txt and only need gt.txt Answer to question 2: self.num_ classes should be equal to the number of classes of your mot dataset. Answer to question 3: Yes. That is right.

972821054 commented 2 years ago

@MasterBin-IIAU Hello, I modified the pre training weight according to what you said. My classification number is 1, but why do I still report an error? The error is as follows. e4fb0f20cb52adff7fc744cf940b280 image

MasterBin-IIAU commented 2 years ago

@972821054 There is no need to modify pre-trained weights. If there is only one class for your own dataset, please set self.num_classes to 1.

972821054 commented 2 years ago

@MasterBin-IIAU Thank you for sharing! Have you tried to use your algorithm (or bytetrack algorithm) in vehicle training? After my training, the detection result is very unsatisfactory.

MasterBin-IIAU commented 2 years ago

@972821054 Hi, we also trained and tested our method on the BDD100K dataset, a large-scale MOT benchmark on autonomous driving. The dataset contains 8 classes (pedestrian, rider, car, truck, bus, train, motorcycle, bicycle). Unicorn also achieves good performance on this dataset.

972821054 commented 2 years ago

@MasterBin-IIAU Did you modify any parameters?and what is your Mota value? thanks

MasterBin-IIAU commented 2 years ago

The result is shown here. The corresponding experiment and trained model are unicorn_track_large.py and latest_ckpt.pth respectively.

972821054 commented 2 years ago

@MasterBin-IIAU image Hello, may I ask you to modify num_ Classes is 1, does it mean here? After I modify it, the above mismatch error will appear.

972821054 commented 2 years ago

@ @MasterBin-IIAU hello if i want to save the video of track,what need ido?