search

AlexeyAB / darknet

YOLOv4 / Scaled-YOLOv4 / YOLO - Neural Networks for Object Detection (Windows and Linux version of Darknet )
http://pjreddie.com/darknet/
Other
21.68k stars 7.96k forks source link

darknet terminated: *** buffer overflow detected *** during training with multi-gpu #6792

Open vamsiduranc opened 4 years ago

vamsiduranc commented 4 years ago

Dear Alexey @AlexeyAB

Greetings!

We are trying to run training on multi-GPU with 4-K80 cards on Linux machine. We are receiving below error message when we switch the training to multi-gpu after 1000 iterations

*** buffer overflow detected ***: ./darknet terminated
Aborted (core dumped)

Training command used:

./darknet detector train cfg/duranc_all_tiny_3l_lnx_Az_alphanum_2.data cfg/duranc_all_tiny_3l_lnx_Az_alphanum_2.cfg backup/duranc_all_tiny_3l_lnx_Az_alphanum_2_1000.weights -gpus 0,1,2,3 -dont_show

As per the your suggestion in this comment: https://github.com/AlexeyAB/Yolo_mark/issues/123#issuecomment-480100551 (The referred link might be for Yolo_mark) but I verified char buff and that is alredy set to 1000 as shown below (Line 1327 in src/data.c file)

if (show_imgs && i_mixup == use_mixup)   // delete i_mixup
            {
                image tmp_ai = copy_image(ai);
                char buff[1000];
                //sprintf(buff, "aug_%d_%d_%s_%d", random_index, i, basecfg((char*)filename), random_gen());
                sprintf(buff, "aug_%d_%d_%d", random_index, i, random_gen());
                int t;
                for (t = 0; t < boxes; ++t) {
                    box b = float_to_box_stride(d.y.vals[i] + t*truth_size, 1);
                    if (!b.x) break;
                    int left = (b.x - b.w / 2.)*ai.w;
                    int right = (b.x + b.w / 2.)*ai.w;
                    int top = (b.y - b.h / 2.)*ai.h;
                    int bot = (b.y + b.h / 2.)*ai.h;
                    draw_box_width(tmp_ai, left, top, right, bot, 1, 150, 100, 50); // 3 channels RGB
                }

                save_image(tmp_ai, buff);
                if (show_imgs == 1) {
                    //char buff_src[1000];
                    //sprintf(buff_src, "src_%d_%d_%s_%d", random_index, i, basecfg((char*)filename), random_gen());
                    //show_image_mat(src, buff_src);
                    show_image(tmp_ai, buff);
                    wait_until_press_key_cv();
                }
                printf("\nYou use flag -show_imgs, so will be saved aug_...jpg images. Click on window and press ESC button \n");
                free_image(tmp_ai);
            }

Also, we see very large values in avg loss as shown below:

 1024: 11965363200.000000, 1196590976.000000 avg loss, 0.004000 rate, 6.143387 seconds, 262144 images, 20.376241 hours left
Loaded: 0.000073 seconds
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.938144, Obj: 0.020619, No Obj: 0.275335, .5R: 0.000000, .75R: 0.000000, count: 97, class_loss = 506.687500, iou_loss = 9427260688034953166848.000000, total_loss = 9427260688034953166848.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.679389, Obj: 0.267176, No Obj: 0.266851, .5R: 0.000000, .75R: 0.000000, count: 131, class_loss = 496.733765, iou_loss = 77682950260483875143680.000000, total_loss = 77682950260483875143680.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.817391, Obj: 0.104348, No Obj: 0.302170, .5R: 0.000000, .75R: 0.000000, count: 115, class_loss = 548.063538, iou_loss = 10458094673293366788096.000000, total_loss = 10458094673293366788096.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.896907, Obj: 0.061856, No Obj: 0.262292, .5R: 0.000000, .75R: 0.000000, count: 97, class_loss = 475.187500, iou_loss = 21851053312635742191616.000000, total_loss = 21851053312635742191616.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.216429, GIOU: -nan), Class: 0.292528, Obj: 0.020168, No Obj: 0.014900, .5R: 0.164706, .75R: 0.011765, count: 170, class_loss = 81.083847, iou_loss = 8868.448242, total_loss = 8949.532227
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.210672, GIOU: -nan), Class: 0.307356, Obj: 0.013852, No Obj: 0.014380, .5R: 0.131313, .75R: 0.025253, count: 198, class_loss = 91.850471, iou_loss = 34458.664062, total_loss = 34550.515625
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.293455, GIOU: -0.108132), Class: 0.294003, Obj: 0.025571, No Obj: 0.026571, .5R: 0.287805, .75R: 0.053659, count: 205, class_loss = 121.096619, iou_loss = 5313.546387, total_loss = 5434.643066
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.366695, GIOU: -nan), Class: 0.338722, Obj: 0.006237, No Obj: 0.019297, .5R: 0.314050, .75R: 0.045455, count: 242, class_loss = 122.816254, iou_loss = 7858.476562, total_loss = 7981.292969
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.328408, GIOU: 0.141042), Class: 0.121412, Obj: 0.014310, No Obj: 0.085302, .5R: 0.187500, .75R: 0.000000, count: 48, class_loss = 1624.021362, iou_loss = 10.663818, total_loss = 1634.685181
 total_bbox = 9970, rewritten_bbox = 0.070211 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.443978, GIOU: 0.367955), Class: 0.313864, Obj: 0.017316, No Obj: 0.055723, .5R: 0.428571, .75R: 0.000000, count: 28, class_loss = 976.360718, iou_loss = 2.831665, total_loss = 979.192383
 total_bbox = 10001, rewritten_bbox = 0.039996 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.398780, GIOU: 0.244267), Class: 0.248281, Obj: 0.002208, No Obj: 0.118041, .5R: 0.274510, .75R: 0.000000, count: 51, class_loss = 1911.307373, iou_loss = 8.177979, total_loss = 1919.485352
 total_bbox = 9527, rewritten_bbox = 0.031489 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.245343, GIOU: 0.112707), Class: 0.143874, Obj: 0.008358, No Obj: 0.081453, .5R: 0.070707, .75R: 0.010101, count: 99, class_loss = 1419.118774, iou_loss = 26.908447, total_loss = 1446.027222
 total_bbox = 9844, rewritten_bbox = 0.010158 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.836973, Obj: 0.068027, No Obj: 0.269333, .5R: 0.000000, .75R: 0.000000, count: 147, class_loss = 578.183228, iou_loss = 23477870591632276979712.000000, total_loss = 23477870591632276979712.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.743243, Obj: 0.189189, No Obj: 0.256290, .5R: 0.000000, .75R: 0.000000, count: 148, class_loss = 531.435852, iou_loss = 94105776661653125857280.000000, total_loss = 94105776661653125857280.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.794643, Obj: 0.151786, No Obj: 0.247576, .5R: 0.000000, .75R: 0.000000, count: 112, class_loss = 461.374969, iou_loss = 58455435133775610118144.000000, total_loss = 58455435133775610118144.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.194636, GIOU: -nan), Class: 0.291594, Obj: 0.017568, No Obj: 0.020815, .5R: 0.139896, .75R: 0.010363, count: 193, class_loss = 102.226479, iou_loss = 16196.043945, total_loss = 16298.270508
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.815126, Obj: 0.126050, No Obj: 0.314462, .5R: 0.000000, .75R: 0.000000, count: 119, class_loss = 561.437439, iou_loss = 3771773413647068430336.000000, total_loss = 3771773413647068430336.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.258799, GIOU: -nan), Class: 0.330574, Obj: 0.013435, No Obj: 0.013510, .5R: 0.251429, .75R: 0.040000, count: 175, class_loss = 80.974525, iou_loss = 15892.350586, total_loss = 15973.325195
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.194832, GIOU: -nan), Class: 0.292623, Obj: 0.014206, No Obj: 0.016343, .5R: 0.150485, .75R: 0.004854, count: 206, class_loss = 95.294334, iou_loss = 38925.886719, total_loss = 39021.179688
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.263251, GIOU: -nan), Class: 0.304310, Obj: 0.019941, No Obj: 0.015342, .5R: 0.226804, .75R: 0.010309, count: 194, class_loss = 93.413773, iou_loss = 10255.270508, total_loss = 10348.684570
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.487414, GIOU: 0.400976), Class: 0.286989, Obj: 0.132807, No Obj: 0.117818, .5R: 0.567568, .75R: 0.027027, count: 37, class_loss = 2176.308350, iou_loss = 4.515869, total_loss = 2180.824219
 total_bbox = 10347, rewritten_bbox = 0.067652 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.301674, GIOU: 0.117738), Class: 0.134164, Obj: 0.005127, No Obj: 0.061794, .5R: 0.103774, .75R: 0.000000, count: 106, class_loss = 1187.255737, iou_loss = 22.349609, total_loss = 1209.605347
 total_bbox = 9920, rewritten_bbox = 0.030242 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.328883, GIOU: 0.175685), Class: 0.224785, Obj: 0.207585, No Obj: 0.106429, .5R: 0.181818, .75R: 0.000000, count: 88, class_loss = 1975.234619, iou_loss = 18.807007, total_loss = 1994.041626
 total_bbox = 10443, rewritten_bbox = 0.038303 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.214168, GIOU: -0.044454), Class: 0.110926, Obj: 0.024908, No Obj: 0.118655, .5R: 0.030769, .75R: 0.000000, count: 130, class_loss = 2051.078369, iou_loss = 44.056152, total_loss = 2095.134521
 total_bbox = 10287, rewritten_bbox = 0.009721 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.777778, Obj: 0.158730, No Obj: 0.304767, .5R: 0.000000, .75R: 0.000000, count: 126, class_loss = 559.561951, iou_loss = 53885587555886494121984.000000, total_loss = 53885587555886494121984.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.781955, Obj: 0.120301, No Obj: 0.302228, .5R: 0.000000, .75R: 0.000000, count: 133, class_loss = 576.057495, iou_loss = 5427149425255643086848.000000, total_loss = 5427149425255643086848.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.666667, Obj: 0.297619, No Obj: 0.329755, .5R: 0.000000, .75R: 0.000000, count: 84, class_loss = 480.500031, iou_loss = 33205231455586830254080.000000, total_loss = 33205231455586830254080.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.267045, GIOU: -0.195228), Class: 0.323699, Obj: 0.019002, No Obj: 0.027244, .5R: 0.253521, .75R: 0.000000, count: 213, class_loss = 128.713745, iou_loss = 15627.747070, total_loss = 15756.460938
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.214685, GIOU: -0.293550), Class: 0.292612, Obj: 0.017649, No Obj: 0.020708, .5R: 0.160194, .75R: 0.004854, count: 206, class_loss = 105.988144, iou_loss = 4326.362793, total_loss = 4432.351074
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.338693, GIOU: -0.024694), Class: 0.328175, Obj: 0.035657, No Obj: 0.023651, .5R: 0.368687, .75R: 0.025253, count: 198, class_loss = 120.284775, iou_loss = 6335.506348, total_loss = 6455.791016
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.900000, Obj: 0.026667, No Obj: 0.303901, .5R: 0.000000, .75R: 0.000000, count: 150, class_loss = 635.557312, iou_loss = 8615203691374850342912.000000, total_loss = 8615203691374850342912.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.246650, GIOU: -0.270551), Class: 0.298793, Obj: 0.021858, No Obj: 0.017437, .5R: 0.236453, .75R: 0.024631, count: 203, class_loss = 103.019318, iou_loss = 5738.369141, total_loss = 5841.388672
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.358184, GIOU: 0.229869), Class: 0.181827, Obj: 0.021136, No Obj: 0.121532, .5R: 0.258621, .75R: 0.051724, count: 116, class_loss = 1964.994507, iou_loss = 25.130859, total_loss = 1990.125366
 total_bbox = 10802, rewritten_bbox = 0.064803 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.346932, GIOU: 0.153392), Class: 0.133438, Obj: 0.006437, No Obj: 0.109729, .5R: 0.250000, .75R: 0.000000, count: 12, class_loss = 1789.299927, iou_loss = 2.305664, total_loss = 1791.605591
 total_bbox = 10271, rewritten_bbox = 0.029208 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.222904, GIOU: 0.081647), Class: 0.115751, Obj: 0.017422, No Obj: 0.160574, .5R: 0.068493, .75R: 0.000000, count: 73, class_loss = 2428.032227, iou_loss = 23.414062, total_loss = 2451.446289
 total_bbox = 10798, rewritten_bbox = 0.037044 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.250923, GIOU: 0.021961), Class: 0.148758, Obj: 0.014119, No Obj: 0.106252, .5R: 0.088608, .75R: 0.000000, count: 79, class_loss = 1659.311646, iou_loss = 23.721558, total_loss = 1683.033203
 total_bbox = 10719, rewritten_bbox = 0.009329 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.806723, Obj: 0.176471, No Obj: 0.297438, .5R: 0.000000, .75R: 0.000000, count: 119, class_loss = 536.187561, iou_loss = 64412013094526139760640.000000, total_loss = 64412013094526139760640.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.774194, Obj: 0.177419, No Obj: 0.296687, .5R: 0.000000, .75R: 0.000000, count: 124, class_loss = 537.110718, iou_loss = 35151268379771013169152.000000, total_loss = 35151268379771013169152.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.850816, Obj: 0.108333, No Obj: 0.274181, .5R: 0.000000, .75R: 0.000000, count: 120, class_loss = 522.925903, iou_loss = 35091620454506304634880.000000, total_loss = 35091620454506304634880.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.311953, GIOU: -nan), Class: 0.324998, Obj: 0.025421, No Obj: 0.021315, .5R: 0.311024, .75R: 0.027559, count: 254, class_loss = 125.900627, iou_loss = 15733.250977, total_loss = 15859.151367
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.266693, GIOU: -0.182185), Class: 0.312305, Obj: 0.019362, No Obj: 0.017631, .5R: 0.216981, .75R: 0.000000, count: 212, class_loss = 101.642601, iou_loss = 7927.420898, total_loss = 8029.063477
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.259124, GIOU: -nan), Class: 0.301224, Obj: 0.010390, No Obj: 0.015711, .5R: 0.175610, .75R: 0.004878, count: 205, class_loss = 98.168007, iou_loss = 11248.900391, total_loss = 11347.068359
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: -nan), Class: 0.770833, Obj: 0.173611, No Obj: 0.243133, .5R: 0.000000, .75R: 0.000000, count: 144, class_loss = 506.062042, iou_loss = 40942534960799467700224.000000, total_loss = 40942534960799467700224.000000
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 23 Avg (IOU: 0.262063, GIOU: -nan), Class: 0.320931, Obj: 0.011506, No Obj: 0.017985, .5R: 0.182692, .75R: 0.000000, count: 208, class_loss = 104.199509, iou_loss = 13230.896484, total_loss = 13335.095703
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.302901, GIOU: 0.170309), Class: 0.166045, Obj: 0.050509, No Obj: 0.106627, .5R: 0.131148, .75R: 0.008197, count: 122, class_loss = 1881.471680, iou_loss = 29.723389, total_loss = 1911.195068
 total_bbox = 11297, rewritten_bbox = 0.070815 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.224794, GIOU: -0.025993), Class: 0.112497, Obj: 0.017086, No Obj: 0.132566, .5R: 0.056338, .75R: 0.000000, count: 71, class_loss = 2344.679932, iou_loss = 25.010498, total_loss = 2369.690430
 total_bbox = 10678, rewritten_bbox = 0.028095 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.241047, GIOU: -0.011486), Class: 0.096446, Obj: 0.000000, No Obj: 0.097204, .5R: 0.060606, .75R: 0.015152, count: 66, class_loss = 1833.471313, iou_loss = 20.395386, total_loss = 1853.866699
 total_bbox = 11189, rewritten_bbox = 0.035749 %
v3 (mse loss, Normalizer: (iou: 0.75, cls: 1.00) Region 30 Avg (IOU: 0.378889, GIOU: 0.165486), Class: 0.227430, Obj: 0.199630, No Obj: 0.087959, .5R: 0.253968, .75R: 0.031746, count: 63, class_loss = 1674.754028, iou_loss = 13.983032, total_loss = 1688.737061
 total_bbox = 11134, rewritten_bbox = 0.008981 %
Syncing... Done!

 1028: 11999183681583090499584.000000, 1199918396305806721024.000000 avg loss, 0.004000 rate, 6.049332 seconds, 263168 images, 20.381427 hours left
*** buffer overflow detected ***: ./darknet terminated
Aborted (core dumped)

Can you please let us know how can we fix this issue? Thank you in advance!

vamsiduranc commented 4 years ago

@AlexeyAB Can you please look into this issue and let us know a resolution? Thank You!

vamsiduranc commented 3 years ago

@AlexeyAB Dear Alexey, Can you please help us in resolving this issue? We are unable to start training with multi gpu. Request you to look into this ticket and let us know if you need more information. Thank You!

huanxiangyin commented 3 years ago

@vamsiduranc I have a similar issue ! duranc_all_tiny_3l_lnx_Az_alphanum_2.cfg I modify subdivisions=32 and it works...........

vamsiduranc commented 3 years ago

@huanxiangyin Thank you for your reply. Update the cfg as per your suggestion but when we switch to multi-gpu we are getting nan. Here is the cfg for your reference: duranc_all_tiny_3l_lnx_Az_alphanum_2.zip

1032: 6.644746, 6.746361 avg loss, 0.004000 rate, 4.936033 seconds, 264192 images, 35.568191 hours left
Loaded: 0.000079 seconds
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7121, rewritten_bbox = 0.056172 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7047, rewritten_bbox = 0.056762 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7125, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 6980, rewritten_bbox = 0.028653 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 8, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7147, rewritten_bbox = 0.055968 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7087, rewritten_bbox = 0.056441 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 11, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7158, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7012, rewritten_bbox = 0.028523 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7173, rewritten_bbox = 0.055765 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7116, rewritten_bbox = 0.056211 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7026, rewritten_bbox = 0.028466 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7182, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 29, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7192, rewritten_bbox = 0.055617 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 30, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7164, rewritten_bbox = 0.055835 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7064, rewritten_bbox = 0.028313 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 13, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7221, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 8, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7225, rewritten_bbox = 0.055363 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7193, rewritten_bbox = 0.055610 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7092, rewritten_bbox = 0.028201 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7242, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7253, rewritten_bbox = 0.055150 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7217, rewritten_bbox = 0.055425 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7121, rewritten_bbox = 0.028086 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7266, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 27, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 11, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7285, rewritten_bbox = 0.054907 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7228, rewritten_bbox = 0.055340 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 28, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7145, rewritten_bbox = 0.027992 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7298, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7310, rewritten_bbox = 0.054720 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 40, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7280, rewritten_bbox = 0.054945 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7186, rewritten_bbox = 0.027832 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7324, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7327, rewritten_bbox = 0.054593 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7300, rewritten_bbox = 0.054795 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7212, rewritten_bbox = 0.027732 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7350, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 25, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7369, rewritten_bbox = 0.054281 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7322, rewritten_bbox = 0.054630 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 13, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7237, rewritten_bbox = 0.027636 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7370, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 10, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7395, rewritten_bbox = 0.054091 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7350, rewritten_bbox = 0.054422 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7264, rewritten_bbox = 0.027533 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 27, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7416, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7418, rewritten_bbox = 0.053923 %
total_bbox = 7374, rewritten_bbox = 0.054245 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7278, rewritten_bbox = 0.027480 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 11, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 8, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 15, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7450, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 11, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7412, rewritten_bbox = 0.053967 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7458, rewritten_bbox = 0.053634 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7292, rewritten_bbox = 0.027427 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 8, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7480, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 8, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 10, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7430, rewritten_bbox = 0.053836 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7480, rewritten_bbox = 0.053476 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7327, rewritten_bbox = 0.027296 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7508, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 13, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 10, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7469, rewritten_bbox = 0.053555 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7514, rewritten_bbox = 0.053234 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7362, rewritten_bbox = 0.027167 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 30, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7538, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 30, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7493, rewritten_bbox = 0.053383 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7552, rewritten_bbox = 0.052966 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7399, rewritten_bbox = 0.027031 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 27, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7570, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 13, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7529, rewritten_bbox = 0.053128 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7578, rewritten_bbox = 0.052784 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7432, rewritten_bbox = 0.026911 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7551, rewritten_bbox = 0.052973 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7609, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 28, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 8, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7602, rewritten_bbox = 0.052618 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7466, rewritten_bbox = 0.026788 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7570, rewritten_bbox = 0.052840 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 11, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7633, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7648, rewritten_bbox = 0.052301 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 15, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7507, rewritten_bbox = 0.026642 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 25, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7600, rewritten_bbox = 0.052632 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 15, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7655, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 9, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7676, rewritten_bbox = 0.052110 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7553, rewritten_bbox = 0.026480 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7618, rewritten_bbox = 0.052507 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 10, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 15, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7688, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7707, rewritten_bbox = 0.051901 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7575, rewritten_bbox = 0.026403 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 9, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 10, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7642, rewritten_bbox = 0.052342 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7712, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7729, rewritten_bbox = 0.051753 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 9, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7599, rewritten_bbox = 0.026319 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7670, rewritten_bbox = 0.052151 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7738, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7753, rewritten_bbox = 0.051593 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7629, rewritten_bbox = 0.026216 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7692, rewritten_bbox = 0.052002 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 8, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7763, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 30, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7807, rewritten_bbox = 0.051236 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7714, rewritten_bbox = 0.051854 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7675, rewritten_bbox = 0.026059 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 28, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7791, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7740, rewritten_bbox = 0.051680 %
total_bbox = 7837, rewritten_bbox = 0.051040 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 15, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7704, rewritten_bbox = 0.025961 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7813, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7764, rewritten_bbox = 0.051520 %
total_bbox = 7852, rewritten_bbox = 0.050942 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7745, rewritten_bbox = 0.025823 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 18, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7834, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 26, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7874, rewritten_bbox = 0.050800 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7793, rewritten_bbox = 0.051328 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7771, rewritten_bbox = 0.025737 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 21, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7812, rewritten_bbox = 0.051203 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 5, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7897, rewritten_bbox = 0.050652 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 36, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7893, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7799, rewritten_bbox = 0.025644 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 25, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7840, rewritten_bbox = 0.051020 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7928, rewritten_bbox = 0.050454 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 7, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7915, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7829, rewritten_bbox = 0.025546 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 13, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 9, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 10, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 12, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7855, rewritten_bbox = 0.050923 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 6, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7951, rewritten_bbox = 0.050308 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7938, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7863, rewritten_bbox = 0.025436 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 23, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 25, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7880, rewritten_bbox = 0.050761 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7981, rewritten_bbox = 0.050119 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7958, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7891, rewritten_bbox = 0.025345 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 20, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 4, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 13, class_loss = -nan, iou_loss = nan, total_loss = nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 17, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 22, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 8005, rewritten_bbox = 0.049969 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = nan, total_loss = nan
total_bbox = 7990, rewritten_bbox = 0.000000 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 7915, rewritten_bbox = 0.025268 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 14, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 8025, rewritten_bbox = 0.000000 %
Syncing... Done!

1036: -nan, -nan avg loss, 0.004000 rate, 4.387763 seconds, 265216 images, 35.551759 hours left
Loaded: 0.000061 seconds
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 15, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 24, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 16, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 16 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 19, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 2, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 3, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 23 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 9, class_loss = -nan, iou_loss = -nan, total_loss = -nan
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: 0.000000, Obj: 0.000000, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 8022, rewritten_bbox = 0.049863 %
v3 (giou loss, Normalizer: (iou: 0.50, cls: 1.00) Region 30 Avg (IOU: 0.000000, GIOU: 0.000000), Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, .75R: 0.000000, count: 1, class_loss = -nan, iou_loss = -nan, total_loss = -nan
total_bbox = 8048, rewritten_bbox = 0.000000 %
huanxiangyin commented 3 years ago

@vamsiduranc Class: nan, Obj: nan, No Obj: nan, .5R: 0.000000, Does this mean that the image cannot be read?

Maybe you can check the image format of the training set.

vamsiduranc commented 3 years ago

@huanxiangyin

We have one more training server which runs on windows with 2 GPU cards. When we use the same dataset on windows, we are able to train using multi-gpu. We are facing this issue only when we use dataset on Linux server with multi-gpu...

When we train on windows server, it is taking lot of time, so we need this linux training to work.