search

pmeletis / panoptic_parts

This repository contains code and tools for reading, processing, evaluating on, and visualizing Panoptic Parts datasets. Moreover, it contains code for reproducing our CVPR 2021 paper results.
https://panoptic-parts.readthedocs.io/en/stable
Apache License 2.0
100 stars 16 forks source link

How to merge Semantic segmentation and Part segmentation? #17

Closed moddent closed 3 years ago

moddent commented 3 years ago

Hi, there:

I want to merge Semantic segmentation and Part segmentation to generate the new label in .png format.

Can you give me some suggestion or some references.

Thx.

pmeletis commented 3 years ago

Hello moddent, Currently, there is documentation to merge semantic and instance segmentation, and panoptic and part segmentation, but not semantic and part segmentation. We are planning to provide a script for that as well, so the semantic-part ids (_sidspids) can be generated and evaluated. For now, you can use the docs here by encoding your semantic segmentation as panoptic segmentation. @DdeGeus other suggestions?

DdeGeus commented 3 years ago

Hi @moddent, thanks for your interest in our work!

For what purpose do you want to use this exactly? If you want to generate just the semantic segmentation (stuff) and part segmentation (part) labels from our ground-truth, you can just use the sids and pids only when decoding the ground-truth as described here.

If you wish to merge semantic segmentation and part segmentation predictions as a 3-channel PNG as described here, you can simply treat all scene classes as stuff classes, as @pmeletis suggested, and follow the entire merging procedure. For merging to the 3-channel format, you just have to change the stuff class definition in the EvalSpec described here.

Does this answer your question?

moddent commented 3 years ago

Okay, I see. Thanks for your reply. Since I saw this and I'm just curious!