rshaojimmy / MultiModal-DeepFake

[TPAMI 2024 & CVPR 2023] PyTorch code for DGM4: Detecting and Grounding Multi-Modal Media Manipulation and beyond
Other
367 stars 28 forks source link

请问为什么train时,IOU一直不变,一直是46.4069 #44

Open XinQ-Yu opened 1 week ago

XinQ-Yu commented 1 week ago

{"train_lr": "0.000024", "train_loss_MAC": "0.820411", "train_loss_BIC": "0.029477", "train_loss_bbox": "0.510005", "train_loss_giou": "1.335904", "train_loss_TMG": "0.009822", "train_loss_MLC": "0.022428", "train_loss": "0.328359", "val_AUC_cls": "84.7447", "val_ACC_cls": "79.4676", "val_EER_cls": "22.7619", "val_MAP": "75.0115", "val_OP": "67.0870", "val_OR": "72.9213", "val_OF1": "69.8826", "val_CP": "66.6385", "val_CR": "73.3242", "val_CF1": "69.8217", "val_OP_k": "67.0870", "val_OR_k": "72.9213", "val_OF1_k": "69.8826", "val_CP_k": "66.6385", "val_CR_k": "73.3242", "val_CF1_k": "69.8217", "val_IOU_score": "46.4069", "val_IOU_ACC_50": "46.4069", "val_IOU_ACC_75": "46.4069", "val_IOU_ACC_95": "46.4069", "val_ACC_tok": "89.5418", "val_Precision_tok": "63.9412", "val_Recall_tok": "58.8190", "val_F1_tok": "61.2732", "epoch": 34} {"train_lr": "0.000021", "train_loss_MAC": "0.814537", "train_loss_BIC": "0.026284", "train_loss_bbox": "0.509611", "train_loss_giou": "1.335644", "train_loss_TMG": "0.009643", "train_loss_MLC": "0.020297", "train_loss": "0.322203", "val_AUC_cls": "84.7855", "val_ACC_cls": "79.0292", "val_EER_cls": "23.0697", "val_MAP": "75.6787", "val_OP": "67.4471", "val_OR": "72.5056", "val_OF1": "69.8849", "val_CP": "66.3149", "val_CR": "73.3321", "val_CF1": "69.6472", "val_OP_k": "67.4471", "val_OR_k": "72.5056", "val_OF1_k": "69.8849", "val_CP_k": "66.3149", "val_CR_k": "73.3321", "val_CF1_k": "69.6472", "val_IOU_score": "46.4069", "val_IOU_ACC_50": "46.4069", "val_IOU_ACC_75": "46.4069", "val_IOU_ACC_95": "46.4069", "val_ACC_tok": "89.4145", "val_Precision_tok": "62.8026", "val_Recall_tok": "60.6912", "val_F1_tok": "61.7288", "epoch": 35} {"train_lr": "0.000019", "train_loss_MAC": "0.802474", "train_loss_BIC": "0.024060", "train_loss_bbox": "0.509922", "train_loss_giou": "1.335833", "train_loss_TMG": "0.008773", "train_loss_MLC": "0.018373", "train_loss": "0.316028", "val_AUC_cls": "85.8694", "val_ACC_cls": "79.0473", "val_EER_cls": "22.0126", "val_MAP": "75.8841", "val_OP": "69.3372", "val_OR": "71.2303", "val_OF1": "70.2710", "val_CP": "68.9308", "val_CR": "71.3345", "val_CF1": "70.1120", "val_OP_k": "69.3372", "val_OR_k": "71.2303", "val_OF1_k": "70.2710", "val_CP_k": "68.9308", "val_CR_k": "71.3345", "val_CF1_k": "70.1120", "val_IOU_score": "46.4069", "val_IOU_ACC_50": "46.4069", "val_IOU_ACC_75": "46.4069", "val_IOU_ACC_95": "46.4069", "val_ACC_tok": "89.7132", "val_Precision_tok": "65.4811", "val_Recall_tok": "56.8219", "val_F1_tok": "60.8450", "epoch": 36}

XinQ-Yu commented 1 week ago

batchsize设置的是4,到40个epoch时IOU才有变化,但是很低。 {"train_lr": "0.000010", "train_loss_MAC": "0.740192", "train_loss_BIC": "0.017146", "train_loss_bbox": "0.303868", "train_loss_giou": "1.140282", "train_loss_TMG": "0.007342", "train_loss_MLC": "0.012468", "train_loss": "0.255390", "val_AUC_cls": "86.1196", "val_ACC_cls": "79.9467", "val_EER_cls": "21.6647", "val_MAP": "76.5372", "val_OP": "68.5588", "val_OR": "74.0281", "val_OF1": "71.1885", "val_CP": "67.8199", "val_CR": "74.1095", "val_CF1": "70.8253", "val_OP_k": "68.5588", "val_OR_k": "74.0281", "val_OF1_k": "71.1885", "val_CP_k": "67.8199", "val_CR_k": "74.1095", "val_CF1_k": "70.8253", "val_IOU_score": "46.9165", "val_IOU_ACC_50": "43.7494", "val_IOU_ACC_75": "35.3476", "val_IOU_ACC_95": "34.4617", "val_ACC_tok": "89.4492", "val_Precision_tok": "62.8567", "val_Recall_tok": "61.0899", "val_F1_tok": "61.9607", "epoch": 40} {"train_lr": "0.000009", "train_loss_MAC": "0.742690", "train_loss_BIC": "0.015670", "train_loss_bbox": "0.144927", "train_loss_giou": "0.940256", "train_loss_TMG": "0.006887", "train_loss_MLC": "0.011236", "train_loss": "0.216580", "val_AUC_cls": "85.8486", "val_ACC_cls": "79.8608", "val_EER_cls": "22.0774", "val_MAP": "75.8325", "val_OP": "68.7925", "val_OR": "73.3258", "val_OF1": "70.9869", "val_CP": "68.2425", "val_CR": "73.4672", "val_CF1": "70.7586", "val_OP_k": "68.7925", "val_OR_k": "73.3258", "val_OF1_k": "70.9869", "val_CP_k": "68.2425", "val_CR_k": "73.4672", "val_CF1_k": "70.7586", "val_IOU_score": "53.8276", "val_IOU_ACC_50": "54.3297", "val_IOU_ACC_75": "38.1949", "val_IOU_ACC_95": "34.1679", "val_ACC_tok": "89.5812", "val_Precision_tok": "63.3925", "val_Recall_tok": "61.3671", "val_F1_tok": "62.3634", "epoch": 41} {"train_lr": "0.000007", "train_loss_MAC": "0.730067", "train_loss_BIC": "0.014839", "train_loss_bbox": "0.104486", "train_loss_giou": "0.875755", "train_loss_TMG": "0.006647", "train_loss_MLC": "0.010555", "train_loss": "0.203072", "val_AUC_cls": "85.4978", "val_ACC_cls": "79.7388", "val_EER_cls": "21.9750", "val_MAP": "75.7348", "val_OP": "67.2839", "val_OR": "74.9157", "val_OF1": "70.8950", "val_CP": "66.8391", "val_CR": "74.9208", "val_CF1": "70.6496", "val_OP_k": "67.2839", "val_OR_k": "74.9157", "val_OF1_k": "70.8950", "val_CP_k": "66.8391", "val_CR_k": "74.9208", "val_CF1_k": "70.6496", "val_IOU_score": "58.3202", "val_IOU_ACC_50": "62.3927", "val_IOU_ACC_75": "42.8726", "val_IOU_ACC_95": "34.5431", "val_ACC_tok": "89.4982", "val_Precision_tok": "63.1965", "val_Recall_tok": "60.6734", "val_F1_tok": "61.9092", "epoch": 42} {"train_lr": "0.000006", "train_loss_MAC": "0.692185", "train_loss_BIC": "0.014024", "train_loss_bbox": "0.087759", "train_loss_giou": "0.841184", "train_loss_TMG": "0.006358", "train_loss_MLC": "0.009705", "train_loss": "0.192199", "val_AUC_cls": "86.4554", "val_ACC_cls": "80.4574", "val_EER_cls": "21.5314", "val_MAP": "76.6038", "val_OP": "68.8032", "val_OR": "74.0562", "val_OF1": "71.3331", "val_CP": "67.8885", "val_CR": "74.2178", "val_CF1": "70.9122", "val_OP_k": "68.8032", "val_OR_k": "74.0562", "val_OF1_k": "71.3331", "val_CP_k": "67.8885", "val_CR_k": "74.2178", "val_CF1_k": "70.9122", "val_IOU_score": "60.3447", "val_IOU_ACC_50": "66.6682", "val_IOU_ACC_75": "46.1312", "val_IOU_ACC_95": "34.5160", "val_ACC_tok": "89.6024", "val_Precision_tok": "63.6549", "val_Recall_tok": "60.7884", "val_F1_tok": "62.1887", "epoch": 43} {"train_lr": "0.000004", "train_loss_MAC": "0.699418", "train_loss_BIC": "0.013396", "train_loss_bbox": "0.080447", "train_loss_giou": "0.822016", "train_loss_TMG": "0.006178", "train_loss_MLC": "0.009255", "train_loss": "0.189017", "val_AUC_cls": "86.6396", "val_ACC_cls": "80.2630", "val_EER_cls": "21.2900", "val_MAP": "76.3229", "val_OP": "69.5486", "val_OR": "73.3933", "val_OF1": "71.4192", "val_CP": "69.0020", "val_CR": "73.2037", "val_CF1": "71.0408", "val_OP_k": "69.5486", "val_OR_k": "73.3933", "val_OF1_k": "71.4192", "val_CP_k": "69.0020", "val_CR_k": "73.2037", "val_CF1_k": "71.0408", "val_IOU_score": "61.9814", "val_IOU_ACC_50": "69.1991", "val_IOU_ACC_75": "49.3221", "val_IOU_ACC_95": "34.0414", "val_ACC_tok": "89.7287", "val_Precision_tok": "64.8310", "val_Recall_tok": "58.9648", "val_F1_tok": "61.7589", "epoch": 44} {"train_lr": "0.000003", "train_loss_MAC": "0.693303", "train_loss_BIC": "0.012710", "train_loss_bbox": "0.075201", "train_loss_giou": "0.809054", "train_loss_TMG": "0.005934", "train_loss_MLC": "0.008633", "train_loss": "0.185032", "val_AUC_cls": "86.5404", "val_ACC_cls": "80.3851", "val_EER_cls": "21.4238", "val_MAP": "75.7062", "val_OP": "68.6407", "val_OR": "74.1011", "val_OF1": "71.2665", "val_CP": "67.7518", "val_CR": "74.2423", "val_CF1": "70.8487", "val_OP_k": "68.6407", "val_OR_k": "74.1011", "val_OF1_k": "71.2665", "val_CP_k": "67.7518", "val_CR_k": "74.2423", "val_CF1_k": "70.8487", "val_IOU_score": "62.6283", "val_IOU_ACC_50": "69.9855", "val_IOU_ACC_75": "51.2745", "val_IOU_ACC_95": "33.9284", "val_ACC_tok": "89.6081", "val_Precision_tok": "63.5035", "val_Recall_tok": "61.4190", "val_F1_tok": "62.4439", "epoch": 45} {"train_lr": "0.000003", "train_loss_MAC": "0.704632", "train_loss_BIC": "0.011962", "train_loss_bbox": "0.071672", "train_loss_giou": "0.800242", "train_loss_TMG": "0.005592", "train_loss_MLC": "0.008250", "train_loss": "0.183459", "val_AUC_cls": "86.4405", "val_ACC_cls": "80.3128", "val_EER_cls": "21.3703", "val_MAP": "75.9504", "val_OP": "68.3239", "val_OR": "74.6573", "val_OF1": "71.3503", "val_CP": "67.3291", "val_CR": "74.8259", "val_CF1": "70.8798", "val_OP_k": "68.3239", "val_OR_k": "74.6573", "val_OF1_k": "71.3503", "val_CP_k": "67.3291", "val_CR_k": "74.8259", "val_CF1_k": "70.8798", "val_IOU_score": "63.6678", "val_IOU_ACC_50": "71.3188", "val_IOU_ACC_75": "52.5897", "val_IOU_ACC_95": "34.5114", "val_ACC_tok": "89.7613", "val_Precision_tok": "64.6041", "val_Recall_tok": "60.1838", "val_F1_tok": "62.3157", "epoch": 46}

hysjlzn commented 4 days ago

我的也是这样,iou在46左右训练不上去了,解决了吗