search

Particle1904 / DatasetHelpers

Dataset Helper program to automatically select, re scale and tag Datasets (composed of image and text) for Machine Learning training.
MIT License
170 stars 9 forks source link

Hi, I am having a lot of trouble with the auto model downloading for tag generation, I always get timed out. #18

Closed FozeAhmad9999 closed 7 months ago

FozeAhmad9999 commented 7 months ago

I am not really tech savy , so this probably an issue with settings on my pc rather than, the application, but the inclusion of the models with the app would be really solve this problem even tho it will require more disk space, i tried downloading and renaming the models but that didnt work for me either

Particle1904 commented 7 months ago

Wait, really? I did not expect that to be a problem. Did the application save a log file? Do you have a slow internet connection? I opted for making it automatically download to make it easier for me and for users; some people complained that the download sizes were getting too big. I don't have to upload 2gb+ for each release and users don't need to download 2gb+ for each release. The files are all publicly available in this HuggingFace repository that I made for the automatic download feature: https://huggingface.co/Crowlley/DatasetToolsModels/tree/main

In order to properly integrate the .onnx model files (and the .csv files) into the application, please ensure that you place them inside the "models" folder. The "models" folder should be located in the root directory of the application, which is where the "DatasetProcessorDesktop.exe" file is located. If the "models" folder does not exist, please create it manually in the same directory as the "DatasetProcessorDesktop.exe" file. Make sure to maintain the original file names and extensions when placing the .onnx model files (and the .csv file) into the "models" folder. This will enable the application to access and utilize the models seamlessly.

FozeAhmad9999 commented 7 months ago

thank you, heres error_2024-03-17_11-49-43.txt a log file

Particle1904 commented 7 months ago

Looks like it timed out, not sure what I can do about it other than increasing the timeout from 100 seconds (the default value) to 5 minutes. I imagine its something to do with your internet speed. The app started the download and then it stopped or it didn't even started the download? Did it create a file in the models folder at all?

FozeAhmad9999 commented 7 months ago

download never started, I had a friend install on his pc, he does have very good internet it worked fine for him

Particle1904 commented 7 months ago

I'm not sure what I can do about it. I'll try to get more information from the exception when it happens so I can understand better what is the problem. For now I'll increase the timeout to 5 minutes. I hope having access to the HuggingFace repository is enough of a temporary solution for now. Also found out that the Generator Page lets you select the Yolo model but the Yolo model isn't for generating tags; I'll fix that too.

FozeAhmad9999 commented 7 months ago

oh and the excel files with the tags download with out a hitch, and yes i have down loaded the models, thank you