Uploading datasets from Roboflow seem to have 0 validation images

CropWatchDevelopment commented 4 months ago

Search before asking

[X] I have searched the HUB issues and discussions and found no similar questions.

Question

I have uploaded an export of my project from Roboflow. ultralytics can't find any validation images, Here is my roboflow export: And here is what I see in Ultralytics:

Additional

Not sure if i should add this as a bug, let me know and It can be changed :)

github-actions[bot] commented 4 months ago

👋 Hello @CropWatchDevelopment, thank you for raising an issue about Ultralytics HUB 🚀! Please visit our HUB Docs to learn more:

Quickstart. Start training and deploying YOLO models with HUB in seconds.
Datasets: Preparing and Uploading. Learn how to prepare and upload your datasets to HUB in YOLO format.
Projects: Creating and Managing. Group your models into projects for improved organization.
Models: Training and Exporting. Train YOLOv5 and YOLOv8 models on your custom datasets and export them to various formats for deployment.
Integrations. Explore different integration options for your trained models, such as TensorFlow, ONNX, OpenVINO, CoreML, and PaddlePaddle.
Ultralytics HUB App. Learn about the Ultralytics App for iOS and Android, which allows you to run models directly on your mobile device.
- iOS. Learn about YOLO CoreML models accelerated on Apple's Neural Engine on iPhones and iPads.
- Android. Explore TFLite acceleration on mobile devices.
Inference API. Understand how to use the Inference API for running your trained models in the cloud to generate predictions.

If this is a 🐛 Bug Report, please provide screenshots and steps to reproduce your problem to help us get started working on a fix.

If this is a ❓ Question, please provide as much information as possible, including dataset, model, environment details etc. so that we might provide the most helpful response.

We try to respond to all issues as promptly as possible. Thank you for your patience!

pderrenger commented 4 months ago

@CropWatchDevelopment hi there,

Thank you for reaching out and providing detailed screenshots of your issue. It’s very helpful!

To better assist you, could you please provide a minimum reproducible example of your dataset upload process? This will help us diagnose the issue more effectively. You can find guidance on how to create a reproducible example here.

Additionally, please ensure that you are using the latest versions of the Ultralytics packages. Sometimes, issues like these are resolved in newer releases.

If the problem persists after following the above steps, please let us know, and we’ll be happy to investigate further.

CropWatchDevelopment commented 4 months ago

Thanks for the fast response! I apologise for not adding more detail. Here are the steps you can take to re-create the same issue that I am seeing.

Navigate to Roboflow.com, Signin and create a new classification project using the "Create New Project" Button, it may be a multi-label or standard classification type. (see image)
Upload images, via the upload section OR use their API
Be sure to have uploaded enough for a split (3 at minimum), visit the "Health Check" section and re-balance your project images making sure you have an image in each of the 3 categories:
Visit the "Generate" section, after generating a new set, Select Download data set, once the folder is on your computer, verifiy there are fiels in each of the folders.
Visit Ultralytics and upload the dataset and view the items in each category:

Let me know if there is anything else I can do to help track down the root of the issue. one thing I would like to note is that the example directory structure shows the train, validate and test sub dirs in a classify folder. doing this causes the upload dataset to be invalid. the train and test folder will be populated in ultralytics however:

pderrenger commented 4 months ago

Hi @CropWatchDevelopment,

Thank you for providing the detailed steps to reproduce the issue and the additional screenshots. This is very helpful!

Based on your description, it seems like the validation images are not being recognized correctly after uploading the dataset to Ultralytics HUB. Here are a few steps to help troubleshoot and potentially resolve the issue:

Directory Structure: Ensure that the directory structure of your dataset matches the expected format. Typically, the dataset should have separate folders for train, val, and test images. It seems like you mentioned an issue with the classify folder. Make sure the structure is as follows:
```
dataset/
├── train/
├── val/
└── test/
```
File Verification: Double-check that the val folder contains images and annotations if applicable. Sometimes, files might be missing or incorrectly placed.
Latest Version: Ensure you are using the latest version of the Ultralytics HUB and related packages. Updates often include bug fixes and improvements that might resolve your issue.
Re-upload: Try re-uploading the dataset after verifying the structure and contents. Sometimes, re-uploading can resolve unexpected issues.

If the issue persists, could you please share a minimal reproducible example of your dataset? This will help us diagnose the problem more effectively. You can find guidance on creating a reproducible example here.

Thank you for your patience and cooperation. If you have any further questions or need additional assistance, feel free to ask. We're here to help!

sergiuwaxmann commented 4 months ago

@CropWatchDevelopment It looks like the dataset downloaded from Roboflow doesn't have the correct directory structure as pointed out by @pderrenger. Please make sure your directory structure is correct. You can read more about this on our docs.

ultralytics / hub