训练时，加载之前的best.pt或者last.pt, 会出现WARNING:root:NaN or Inf found in input tensor.且损失全部为nan是为什么呢？

argusswift / YOLOv4-pytorch

This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO

1.68k stars 329 forks source link

训练时，加载之前的best.pt或者last.pt, 会出现WARNING:root:NaN or Inf found in input tensor.且损失全部为nan是为什么呢？ #197

Closed traveling121 closed 3 years ago

traveling121 commented 3 years ago

[2021-05-25 10:06:07,050]-[train.py line:160]: ======= start training ======

[2021-05-25 10:06:09,024]-[train.py line:234]: === Epoch:[ 0/20],step:[ 0/200],img_size:[416],total_loss:nan|loss_ciou:nan|loss_conf:nan|loss_cls:nan|lr:0.0000 WARNING:root:NaN or Inf found in input tensor. WARNING:root:NaN or Inf found in input tensor. WARNING:root:NaN or Inf found in input tensor. WARNING:root:NaN or Inf found in input tensor.

traveling121 commented 3 years ago

Set resume=True