Open liujunzhuo opened 8 months ago
Hello, I encountered the same error, have you solved the problem?
Hello, I encountered the same error, have you solved the problem?
No, I cannot solve the dataset issue.
Hello, I encountered the same error, have you solved the problem?
No, I cannot solve the dataset issue.
Thanks!
Description: I have encountered an issue while training Mdetr model on the RefEgo dataset, using the provided training script and checkpoints from the MDETR repository. The training process exhibits abnormal behavior, as evidenced by unusual losses and accuracy metrics. I have thoroughly investigated and think the problem may related to the RefEgo dataset, as documented in issue #3.
Reproducible Steps:
Clone the RefEgo repository.
Download the datasets, annotations, and checkpoints.
Execute the following training command:
Observe abnormal training logs, including high losses and inaccuracies over multiple epochs.
Training Log Example (Last Epoch):
Custom RefEgoEvaluator: I have implemented a custom
RefEgoEvaluator
to evaluate the model's performance on the RefEgo dataset. This evaluator has been tested with the Refcoco checkpoint and produces expected results.Issue with RefEgo Dataset: Upon inspecting the training process on the RefEgo dataset, I observed that the model trained on RefEgo does not perform as expected, unlike on RefCOCO. I suspect a potential issue with the RefEgo dataset.
Validation and Train datasets evaluation Results: The following are the results of the val set, and I have omitted some of the results:
I even conducted an evaluation on the training set:
Conclusion: It may be a problem with the training code or the refego dataset. The code has successfully yielded normal results on the RefCOCOg dataset, implying a possible anomaly with the RefEgo dataset. I've raised a corresponding issue (#3) titled "Extracted images do not match provided bounding box annotations," I kindly request your expertise and assistance in resolving this matter. Thank you for your attention and support.