About segmentation results

[songyuri]

Hello, thanks to your help, I was able to successfully use the GUI to check the segmentation. However, I'm not sure how to review the segmentation results, so I'm posting another issue.

Currently, in the GUI, I've selected objects using the multiclick mode, and they are highlighted in red. I wanted to segment these objects, so I clicked segment3D, but nothing changed. Is this normal? Then, I clicked save as to save the results in segmentation_res as a .pt file.

Additionally, I ran the command: python render.py -m output/squirrel/ --precomputed_mask segmentation_res/precomputed_mask.pt --target scene --segment

and it generated images in the train/ours_30000/ directory, but these images are of the entire scene, not the segmented results. There are no results in the mask. A new folder named test was also created, but it doesn't contain any results.

this is train folder

And this is test/gt/, but there is nothing in. mask and renders are same state.

I want to view the segmented results in 3D, but I'm not sure how to proceed. I thought I might need to use Jupyter, but when I tried, I encountered the following error in the first cell: ModuleNotFoundError: No module named 'utils.contrastive_decoder_utils'.

Could you tell me what I have to do? Thank you so much!

[Jumpat]

Hi, if you want to conduct 3D segmentation, you need to adjust the hyper parameters first, i.e., the scale and score thresh. In default, the score thresh is 0.0, where all 3D Gaussians will be reserved, that's why it looks like nothing happened.

For the utils.contrastive_decoder_utils, you can just remove it.

[songyuri]

Hi I removed that code but another error was occur Could you explain about this?

[Jumpat]

The clip_features is used for language-driven segmentation. Check the section of Data and Model Preparation and make dataset.need_features = True.