NielsRogge / Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.
MIT License
8.48k stars 1.33k forks source link

recipe for finetuning OneFormer #330

Open werner-rammer opened 1 year ago

werner-rammer commented 1 year ago

For Mask2Former there is a fantastic tutorial for finetuning (e.g., https://github.com/NielsRogge/Transformers-Tutorials/blob/master/MaskFormer/Fine-tuning/Fine_tuning_MaskFormer_on_a_panoptic_dataset.ipynb).

It would be very useful to have a similar tutorial for OneFormer. Specific questions are:

A step by step tutorial such as the one mentioned above would be very welcome!

nickponline commented 8 months ago

I'm also looking for an example. The text said it was the same as MaskFormer and Mask2Former by in reality it seems very different.

NielsRogge commented 7 months ago

A notebook has now been uploaded here: https://github.com/NielsRogge/Transformers-Tutorials/blob/master/OneFormer/Fine_tune_OneFormer_for_semantic_segmentation.ipynb.