StrangerZhang / SiamFC-PyTorch

SiamFC PyTorch
MIT License
232 stars 63 forks source link

How to get the auc #7

Closed HelloRicky123 closed 5 years ago

HelloRicky123 commented 5 years ago

Hi Mr.Zhang, I trained the model 30 epoches and used the code in https://github.com/bilylee/tracker_benchmark you provide to produce the result on OTB100, and I got aveCoverage and aveErrCenter. The following is my result. But I don't know how to get the auc. I saved the predicted boxes and groundtruth boxes and calculate the auc myself and get 0.62+, but I think it's a little too high. So I wanna if the code you provide can produce auc? Thanks a lot! All.json {"name": "ALL", "desc": "All attributes", "tracker": "SiameseFC", "evalType": "OPE", "seqs": ["Basketball", "Biker", "Bird1", "Bird2", "BlurBody", "BlurCar1", "BlurCar2", "BlurCar3", "BlurCar4", "BlurFace", "BlurOwl", "Board", "Bolt", "Bolt2", "Box", "Boy", "Car1", "Car2", "Car24", "Car4", "CarDark", "CarScale", "ClifBar", "Coke", "Couple", "Coupon", "Crossing", "Crowds", "Dancer", "Dancer2", "David", "David2", "David3", "Deer", "Diving", "Dog", "Dog1", "Doll", "DragonBaby", "Dudek", "FaceOcc1", "FaceOcc2", "Fish", "FleetFace", "Football", "Football1", "Freeman1", "Freeman3", "Freeman4", "Girl", "Girl2", "Gym", "Human2", "Human3", "Human4-2", "Human5", "Human6", "Human7", "Human8", "Human9", "Ironman", "Jogging-1", "Jogging-2", "Jump", "Jumping", "KiteSurf", "Lemming", "Liquor", "Man", "Matrix", "Mhyang", "MotorRolling", "MountainBike", "Panda", "RedTeam", "Rubik", "Shaking", "Singer1", "Singer2", "Skater", "Skater2", "Skating1", "Skating2-1", "Skating2-2", "Skiing", "Soccer", "Subway", "Surfer", "Suv", "Sylvester", "Tiger1", "Tiger2", "Toy", "Trans", "Trellis", "Twinnings", "Vase", "Walking", "Walking2", "Woman"], "overlap": 66.20537032522891, "error": 2.833591675153366, "overlapScores": [0.5926672927432785, 0.6744523158948802, 0.4758998916413733, 0.7696486706086082, 0.6853726089480511, 0.8345670514668277, 0.844032160931591, 0.8213972449066869, 0.8405619493081518, 0.8062361033658137, 0.8204389268634588, 0.44990766176914604, 0.5834594717187838, 0.5628299575581555, 0.6798351199956547, 0.7882560429522064, 0.805657077100189, 0.866769542199004, 0.8205198622192008, 0.846973290787438, 0.8637282909664755, 0.6275478765070535, 0.5131748615738081, 0.5803322245017029, 0.7265976675636683, 0.7794657551593479, 0.739760754058129, 0.6790682336800818, 0.7631618448786447, 0.742207866456886, 0.6405737645381154, 0.7975168491398508, 0.5263560801177612, 0.7363679925157307, 0.2904404740180546, 0.46867412460127506, 0.8303155589968413, 0.752400038255508, 0.6498460887560017, 0.7986218254166496, 0.7542083477596558, 0.6784146701449878, 0.7368269421615777, 0.6891616611951438, 0.7760366223898383, 0.6501801447403859, 0.47673670854190947, 0.7006798567188974, 0.5828177138544047, 0.7290218543301457, 0.6550681776431247, 0.5288280893804834, 0.7346839910533725, 0.6836821045300154, 0.6572003238157712, 0.5220306511186218, 0.6867237389837799, 0.7921275938393707, 0.41105993190160506, 0.7373981448108902, 0.6432348524025262, 0.7242144985219909, 0.7201011901991452, 0.3321892925673771, 0.6123389674336884, 0.8006784428872289, 0.6324850519694831, 0.8158914906985878, 0.8364380255459771, 0.5259386992791598, 0.803522424177653, 0.5554464910640086, 0.7228794573578582, 0.6273276580504706, 0.6462245831256584, 0.6919191339772083, 0.7782396990217818, 0.7396258994334471, 0.4509718189024295, 0.6255163033100344, 0.6170985834230858, 0.5448690373978851, 0.44765854738988825, 0.44215251029207453, 0.5160523555364676, 0.3255587346427622, 0.7807546842787755, 0.5973884179473172, 0.8286922892630049, 0.7472081492641974, 0.5316698896855354, 0.4845309321917454, 0.5754776107639107, 0.574880852519549, 0.6305495126856653, 0.6732596158125619, 0.5628371975785968, 0.7222802154172178, 0.6133800988493966, 0.4453594267695019], "errorNum": [5.1448275862068975, 5.352112676056338, 8.480392156862745, 0.6060606060606061, 0.14970059880239522, 0.013477088948787063, 0.0, 0.0, 0.0, 0.0, 0.03169572107765452, 8.753581661891118, 9.857142857142858, 5.665529010238908, 1.8776916451335057, 0.016611295681063124, 0.0, 0.0, 0.06211180124223602, 0.0, 3.0279898218829517, 2.9365079365079367, 5.148305084745762, 2.027491408934708, 0.07142857142857142, 6.146788990825688, 0.08333333333333333, 1.1527377521613833, 0.0, 0.06666666666666667, 3.1210191082802545, 0.148975791433892, 5.515873015873016, 0.0, 8.883720930232558, 6.062992125984252, 0.0, 0.1472107438016529, 1.858407079646018, 0.7074235807860262, 0.0, 1.958128078817734, 0.14705882352941177, 2.446958981612447, 6.961325966850829, 1.891891891891892, 6.656441717791411, 0.0, 2.6148409893992937, 0.2, 1.7333333333333334, 4.445893089960887, 0.3102836879432624, 9.80565371024735, 2.39880059970015, 5.624123422159888, 1.1237373737373737, 0.0, 9.53125, 0.1639344262295082, 4.457831325301205, 0.32573289902280134, 0.19543973941368076, 9.262295081967213, 1.3418530351437699, 5.476190476190476, 3.727544910179641, 3.7851809304997133, 0.0, 5.300000000000001, 0.006711409395973154, 3.597560975609756, 0.0, 1.9500000000000002, 1.02711157455683, 1.3820731096644967, 0.0, 0.22792022792022792, 9.6448087431694, 1.0625, 2.1149425287356323, 3.65, 7.251585623678647, 5.856236786469344, 8.641975308641975, 8.316326530612244, 0.05714285714285714, 1.8882978723404256, 4.5396825396825395, 0.4684014869888476, 3.531073446327684, 4.986301369863014, 3.284132841328413, 4.274193548387097, 3.936731107205624, 1.843220338983051, 3.6162361623616235, 0.04854368932038834, 4.1, 7.051926298157454], "successRateList": [0.8595669326499507, 0.8495732291636107, 0.8434232708936849, 0.8385026946620563, 0.8311043763146222, 0.821872587672512, 0.8099617917635625, 0.796378620064285, 0.7772042551701906, 0.749087954064562, 0.7166408324846634, 0.6748470123776762, 0.6208589850543295, 0.5562877195214879, 0.4729130216766844, 0.37404198625994994, 0.2552092146084533, 0.14111520018622783, 0.05399497417744243, 0.010378141850024452, 0.0]}

StrangerZhang commented 5 years ago

Just caculate the mean of successRateList