search

jsbroks / coco-annotator

:pencil2: Web-based image segmentation tool for object detection, localization, and keypoints
MIT License
2.12k stars 463 forks source link

Adding Panoptic Segmenation #460

Open trs96 opened 3 years ago

trs96 commented 3 years ago

Hey, I'm trying to connect your tool with my system to import images, label them, do a panoptic segmentation an then export it back again to my system.

Could you please help me out with the panoptic segmentation?

  1. I don't know exactly, where in the code I can add the button.
  2. How would you recommend to do the panoptic segmentation?
bijayaniSMishra commented 3 years ago

Hey, I have the same doubt.. I have annotated using the polygon tool but not sure how to export it in panoptic format? If you have solved it.. please help.

simonwibberley commented 3 years ago

I found a script to convert to panoptic format https://github.com/cocodataset/panopticapi However, when trying to train detectron2 with the result I get an error about a missing id in the JSON. I don't understand enough about the panoptic approach to get much further. I'm guessing semantic and instance annotations need to be distinguished in some way?

bijayaniSMishra commented 3 years ago

I used coco annotator json directly and before training the models i just added MetadataCatalog.get("my_dataset_train_2").stuff_classes = ["Class1", "Class2","Class3"] after that i was able to train and inference the panoptic model.