VisionLearningGroup / R-C3D

code for R-C3D
MIT License
254 stars 94 forks source link

abnormal test result #23

Open timothy-wu opened 6 years ago

timothy-wu commented 6 years ago
firstly,thank you for your sharing the code.
when I test your released R-C3D model on activitynet dataset,the mAP and the proposal task 
performance are much lower than yours or the expected result.The results are as follows:

[INIT] Loaded annotations from validation subset. Number of ground truth instances: 7220 Number of predictions: 29 Fixed threshold for tiou score: [ 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95] [RESULTS] Performance on ActivityNet detection task. Average-mAP: 4.16666666667e-05 [INIT] Loaded annotations from validation subset. Number of ground truth instances: 7220 Number of proposals: 29 Fixed threshold for tiou score: [ 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95] [RESULTS] Performance on ActivityNet proposal task. Area Under the AR vs AN curve: 0.0164542936288% I don't know what lead to these abnormal results. could you give me some suggestions? I'm looking forward to your reply. Thank you very much!

fanw52 commented 6 years ago

and I come across the same question ,have you solve it?? @timothy-wu

huijuan88 commented 6 years ago

Please use the updated file “activitynet_log_analysis.py”.

On Apr 16, 2018, at 00:40, timothy-wu notifications@github.com<mailto:notifications@github.com> wrote:

firstly,thank you for your sharing the code. when I test your released R-C3D model on activitynet dataset,the mAP and the proposal task performance are much lower than yours or the expected result.The results are as follows:

[INIT] Loaded annotations from validation subset. Number of ground truth instances: 7220 Number of predictions: 29 Fixed threshold for tiou score: [ 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95] [RESULTS] Performance on ActivityNet detection task. Average-mAP: 4.16666666667e-05 [INIT] Loaded annotations from validation subset. Number of ground truth instances: 7220 Number of proposals: 29 Fixed threshold for tiou score: [ 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95] [RESULTS] Performance on ActivityNet proposal task. Area Under the AR vs AN curve: 0.0164542936288% I don't know what lead to these abnormal results. could you give me some suggestions? I'm looking forward to your reply. Thank you very much!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/VisionLearningGroup/R-C3D/issues/23, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AFOa_41_VT1mrqF43zKMV88q4VQi26gJks5tpCDVgaJpZM4TV3G4.

timothy-wu commented 6 years ago

@huijuan88 I have solved it by doing what you said,sincerely thanks again. Now I want to change the format of the test_log,but i don't know which file controls the output format.Could you tell me the file or the def about that question?Anyway,thanks a lot.