search

ultralytics / hub

Ultralytics HUB tutorials and support
https://hub.ultralytics.com
GNU Affero General Public License v3.0
138 stars 14 forks source link

Training Progress Stuck at 2% Despite Completion; Unable to Deploy Model #876

Closed jayong-sv closed 1 week ago

jayong-sv commented 1 month ago

Search before asking

HUB Component

Training

Bug

image image

Describe the bug

I'm experiencing the same issue as described in issue #843. The training process runs and completes, but the progress remains stuck at 2% throughout. Even after training is completed, the progress indicator still shows 2%, and I am unable to deploy the model. I've tried retraining the model four times, but the progress remains at 2% each time.

Environment

Minimal Reproducible Example

  1. Start training a model using the own agent method.
  2. Observe that the progress remains at 2% during the entire training process.
  3. After training completes, the progress still shows 2%, preventing deployment of the model.

Additional

I've tried retraining the model four times, but the progress remains at 2% each time. The training completes successfully, but since the progress indicator doesn't update, I cannot proceed to deploy the model.

UltralyticsAssistant commented 1 month ago

👋 Hello @jayong-sv, thank you for raising an issue about Ultralytics HUB 🚀! Please check out our HUB Docs for detailed guidance:

If this is a 🐛 Bug Report, please provide screenshots and steps to create a minimum reproducible example to help us investigate the issue 🕵️‍♂️.

Our team tries to respond to all issues as quickly as possible. This is an automated response, but an Ultralytics engineer will also assist you soon. Thank you for your patience! 🙌

sergiuwaxmann commented 1 month ago

@jayong-sv Can you make sure you have a stable internet connection? This issue occurs only when the agent doesn't successfully send metrics data over the internet to HUB.

jayong-sv commented 1 month ago

@sergiuwaxmann I believe my internet connection is stable. I've been using the Ultralytics HUB on the same machine without any issues up until August, and I'm connected via wired LAN. Additionally, only the progress indicator is stuck at 2%, but other metrics and loss plots are syncing correctly.

image
sergiuwaxmann commented 1 month ago

@jayong-sv Can you share your model ID (present in the URL) with me so that we can investigate this further? CC @yogendrasinghx

jayong-sv commented 1 month ago

@sergiuwaxmann
It is https://hub.ultralytics.com/models/jhdTes1en2DZnD4tqh19 Thank you for the quick reply.

sergiuwaxmann commented 1 month ago

@jayong-sv No worries. Apologies for the inconvenience. I will keep you updated.

yogendrasinghx commented 1 week ago

@jayong-sv Thank you for your patience. We've implemented several fixes in the latest version, so could you please try training your model again? Let us know if the issue persists, and we'll be here to assist you further.

jayong-sv commented 1 week ago

@yogendrasinghx It works fine! Thank you so much for support :)