Open DJT777 opened 3 years ago
I got the same error when I trained CenterNet.
@rabbitme
I was able to somehow get these models to train when using a modified version of AbdelRahman's Tf2 API training tutorial scripts. I simply modified his bash file to redirect to my configs and alternate directores and such.
Still does not answer why Tf2's scripts are not training properly. I also recommend placing "PATH TO BE CONFIGURED"/ckpt-0 for some of these detection models. It may be confusing for new people how to configure a model checkpoint in the pipeline when it is just "PATH TO BE CONFIGURED" in the config.
@DJT777 I got the same error as wel. Thanks for pointing us to AbdelRahman's code. All I changed was from classifiation to detection and mentioned the checkpoint steps. And it worked.
@devloper13 You're welcome!
@rabbitme where you able to train the centernet? I'm getting the same error when training a centernet_hg_104. Unfortunately for me, none of @DJT777 or @devloper13 tricks worked for me.
Does any colaborator here have something to say or help with?
Prerequisites
Please answer the following questions for yourself before submitting an issue.
1. The entire URL of the file you are using
http://download.tensorflow.org/models/object_detection/tf2/20200711/ssd_resnet101_v1_fpn_640x640_coco17_tpu-8.tar.gz and http://download.tensorflow.org/models/object_detection/tf2/20200711/faster_rcnn_resnet101_v1_640x640_coco17_tpu-8.tar.gz
2. Describe the bug
I am getting this output when training with a customized dataset and modified config file: Streaming output truncated to the last 5000 lines.
REDACTED FOR LINE SPACE
REDACTED FOR LINE SPACE
REDACTED FOR LINESPACE
3. Steps to reproduce
Pipeline Config:
4. Expected behavior
Train model succesfully. Line 1 of .txt of files :
335 500 001.Black_footed_Albatross Black_Footed_Albatross_0046_18.jpg jpeg 60.0 27.0 325.0 304.0 001 Black_footed_Albatross
H, W, subdir, filename, bbox x, bbox y, bbox width, bbox height, class integer, and class name.
With this script:
That script creates my records based on the CUB-2011 dataset.
5. Additional context
I am using this kind of dataset:
TFRecord .txt
335 500 001.Black_footed_Albatross Black_Footed_Albatross_0046_18.jpg jpeg 60.0 27.0 325.0 304.0 001 Black_footed_Albatross
6. System information
Google Colab defaults with this repository's dependencies.