open-mmlab / mmsegmentation

OpenMMLab Semantic Segmentation Toolbox and Benchmark.
https://mmsegmentation.readthedocs.io/en/main/
Apache License 2.0
7.94k stars 2.57k forks source link

HuggingFace integration #2424

Open NielsRogge opened 1 year ago

NielsRogge commented 1 year ago

Hi OpenMMLab folks!

At HuggingFace we're in the process of making it easy for people to use frameworks for image segmentation and object detection. One way to do this is by making it possible to easily load and fine-tune frameworks like UperNet on custom data. OpenMMLab provides excellent implementations of several frameworks, so we try to make the move from research to easy accessibility for people.

As I'm currently adding support for the UperNet framework (which is used in a lot of papers, like ConvNeXt, Swin Transformer, MAE, ...) I'm converting checkpoints from mmsegmentation to 🤗 Transformers. However the checkpoints themselves are hosted on the hub, as part of an organization like microsoft or facebook.

However the convnext + upernet and swin + upernet checkpoints seem to be trained by the OpenMMLab members themselves rather than being ported from the original repos, so I was wondering whether you are interested in creating an OpenMMLab organization on the 🤗 hub where I could upload checkpoints like upernet-convnext-tiny, upernet-swin-large etc (I'm currently hosting them under my own username).

Let me know what you think!

Kind regards,

Niels ML Engineer @ HuggingFace

MeowZheng commented 1 year ago

Thanks for your invitation. We will create an organization of OpenMMLab asap :)

NielsRogge commented 1 year ago

Awesome :) let me know when it is available, then I'll transfer the checkpoints.