Closed SangbumChoi closed 7 months ago
Hi @SangbumChoi thanks for this amazing draft!
Is the YOLOv6 model trained from scratch or are you using any pre-trained weights?
Regarding the design, that looks great already, however we would need to include the preparation of the targets inside the image processor, such that users can pass images + targets to it, such that the image processor then outputs a BatchFeature
containing both pixel_values
and labels
.
Same goes for the postprocessing, we would need to make it conform our existing models, meaning that a post_process_object_detection
method would need to be implemented. This would also allow the model to be compatible with the pipeline API, making sure it will work with the inference widgets on the hub, etc.
I'll discuss with team regarding the addition of the model :)
Hi @NielsRogge!
Current pipeline of model yolov6n and yolov6s is all public pre-trained weights and I also tested tolerence (1e-3 rather than 1e-4). You may check [convert_yolov6_to_pytorch.py] (https://github.com/SangbumChoi/transformers/blob/yolov6/src/transformers/models/yolov6/convert_yolov6_to_pytorch.py) however you might need to install YOLOv6 and unwrap the model.pt and store pure stated_dict since it is wrapped with the python class yolo.
https://github.com/meituan/YOLOv6/releases/download/0.4.0/yolov6n.pt
Also I think understand more than 90% of whole pipeline in transformers. So currently i'm working on training pipeline and also including minority features for BatchFeature
, post_process_object_detection
, and etc...
I think perfect or PR-ready version might take some more time but feel free to discuss with your team and happy to get feedbacks of mandatory requirements 😄
Model description
Hi, transformers team my question is very simple. Does team is interested in implementing YOLOv6?
I have finished making inference pipeline and working on training pipeline. https://github.com/SangbumChoi/transformers/tree/yolov6 Currently, it might occur little bug and unpretty but it works. I will continue to make it regardless of whether it is goint to be officially implemented or not.
Open source status
Provide useful links for the implementation
https://huggingface.co/superb-ai/yolov6n