ifzhang / ByteTrack

[ECCV 2022] ByteTrack: Multi-Object Tracking by Associating Every Detection Box
MIT License
4.8k stars 905 forks source link

The loss value of my training has been fluctuating around a high value, there is no obvious downward trend #355

Open hust-zXX opened 1 year ago

hust-zXX commented 1 year ago

as recorded in the following log:

2023-08-09 13:52:17 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2060/2658, mem: 18923Mb, iter_time: 0.446s, data_time: 0.028s, total_loss: 2.688, iou_loss: 1.596, l1_loss: 0.000, conf_loss: 0.636, cls_loss: 0.456, lr: 3.055e-05, size: 960, ETA: 18:51:43 2023-08-09 13:52:25 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2080/2658, mem: 18923Mb, iter_time: 0.409s, data_time: 0.002s, total_loss: 2.730, iou_loss: 1.647, l1_loss: 0.000, conf_loss: 0.621, cls_loss: 0.462, lr: 3.055e-05, size: 832, ETA: 18:51:46 2023-08-09 13:52:33 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2100/2658, mem: 18923Mb, iter_time: 0.388s, data_time: 0.021s, total_loss: 2.768, iou_loss: 1.581, l1_loss: 0.000, conf_loss: 0.740, cls_loss: 0.447, lr: 3.055e-05, size: 960, ETA: 18:51:46 2023-08-09 13:52:42 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2120/2658, mem: 18923Mb, iter_time: 0.457s, data_time: 0.025s, total_loss: 2.347, iou_loss: 1.389, l1_loss: 0.000, conf_loss: 0.541, cls_loss: 0.417, lr: 3.054e-05, size: 896, ETA: 18:51:57 2023-08-09 13:52:51 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2140/2658, mem: 18923Mb, iter_time: 0.428s, data_time: 0.003s, total_loss: 2.666, iou_loss: 1.550, l1_loss: 0.000, conf_loss: 0.674, cls_loss: 0.442, lr: 3.054e-05, size: 640, ETA: 18:52:04 2023-08-09 13:52:59 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2160/2658, mem: 18923Mb, iter_time: 0.405s, data_time: 0.041s, total_loss: 3.193, iou_loss: 1.842, l1_loss: 0.000, conf_loss: 0.847, cls_loss: 0.503, lr: 3.054e-05, size: 832, ETA: 18:52:06 2023-08-09 13:53:07 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2180/2658, mem: 18923Mb, iter_time: 0.388s, data_time: 0.030s, total_loss: 2.713, iou_loss: 1.597, l1_loss: 0.000, conf_loss: 0.660, cls_loss: 0.455, lr: 3.054e-05, size: 672, ETA: 18:52:06 2023-08-09 13:53:13 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2200/2658, mem: 18923Mb, iter_time: 0.331s, data_time: 0.036s, total_loss: 3.392, iou_loss: 1.999, l1_loss: 0.000, conf_loss: 0.870, cls_loss: 0.524, lr: 3.054e-05, size: 768, ETA: 18:51:54 2023-08-09 13:53:22 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2220/2658, mem: 18923Mb, iter_time: 0.414s, data_time: 0.056s, total_loss: 2.897, iou_loss: 1.637, l1_loss: 0.000, conf_loss: 0.799, cls_loss: 0.461, lr: 3.054e-05, size: 736, ETA: 18:51:58 2023-08-09 13:53:30 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2240/2658, mem: 18923Mb, iter_time: 0.418s, data_time: 0.032s, total_loss: 3.193, iou_loss: 1.761, l1_loss: 0.000, conf_loss: 0.943, cls_loss: 0.488, lr: 3.054e-05, size: 736, ETA: 18:52:03 2023-08-09 13:53:39 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2260/2658, mem: 18923Mb, iter_time: 0.427s, data_time: 0.053s, total_loss: 3.262, iou_loss: 1.814, l1_loss: 0.000, conf_loss: 0.956, cls_loss: 0.492, lr: 3.053e-05, size: 736, ETA: 18:52:09 2023-08-09 13:53:45 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2280/2658, mem: 18923Mb, iter_time: 0.341s, data_time: 0.002s, total_loss: 3.361, iou_loss: 1.903, l1_loss: 0.000, conf_loss: 0.935, cls_loss: 0.522, lr: 3.053e-05, size: 928, ETA: 18:52:00 2023-08-09 13:53:54 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2300/2658, mem: 18923Mb, iter_time: 0.436s, data_time: 0.030s, total_loss: 2.615, iou_loss: 1.502, l1_loss: 0.000, conf_loss: 0.667, cls_loss: 0.447, lr: 3.053e-05, size: 1024, ETA: 18:52:07 2023-08-09 13:54:03 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2320/2658, mem: 18923Mb, iter_time: 0.455s, data_time: 0.020s, total_loss: 2.488, iou_loss: 1.513, l1_loss: 0.000, conf_loss: 0.542, cls_loss: 0.434, lr: 3.053e-05, size: 832, ETA: 18:52:19 2023-08-09 13:54:12 | INFO | yolox.core.trainer:244 - epoch: 8/80, iter: 2340/2658, mem: 18923Mb, iter_time: 0.453s, data_time: 0.047s, total_loss: 2.895, iou_loss: 1.611, l1_loss: 0.000, conf_loss: 0.815, cls_loss: 0.468, lr: 3.053e-05, size: 864, ETA: 18:52:30