Open faizankshaikh opened 2 years ago
Hi! The imagefolder
script is already quite complex, so a standalone script sounds better. Also, I suggest we create an org on the Hub (e.g. hf-loaders
) and store such scripts there for easier maintenance rather than having them as packaged modules (IMO only very generic loaders should be packaged). WDYT @lhoestq @albertvillanova @polinaeterna?
@mariosasko sounds good to me!
Thank you for the suggestion @mariosasko . I agree with the point, but I have a few doubts
load_dataset("hf-loaders/yolo", data_files=...)
hf-community-loaders
(IMO a better name than "hf-loaders") and add me (as an admin)yolo
and add the loading script to it (yolo.py
)yolo
loader.
Is your feature request related to a problem? Please describe. At the moment, HF datasets loads image classification datasets out-of-the-box. There could be a data loader for loading standard object detection datasets (original discussion here)
Describe the solution you'd like I wrote a custom script to load dataset which has YOLO data format.
Describe alternatives you've considered The script can either be a standalone dataset builder, or a modified version of
ImageFolder
Additional context I would be happy to contribute to this, but I would do it at a very slow pace (maybe a month or two) as I have my exams approaching 😄