search

weijielyu / Gaga

Gaga: Group Any Gaussians via 3D-aware Memory Bank
https://www.gaga.gallery
MIT License
69 stars 2 forks source link

How to visualize instance images ？ #1

Open wuyingxiong opened 3 months ago

wuyingxiong commented 3 months ago

Thanks for your work！ In the experimental results, it can be seen the visualized instance images. Do you obtain continuous instance images after concatenation through trajectory or other methods like SIBR_viewer?

weijielyu commented 3 months ago

Thanks for your interest in our work! Our rendered segmentation results are multi-view consistent, which means one instance will have the same mask label in all views. We just need to select the instance mask with the target label and multiply it with the RGB image for all views. Hope this answers your question.

wuyingxiong commented 2 months ago

Dear author！ I still have some questions about the visualization part. In the project homepage, we can see some semantic videos. How to implement the visualization of semantic roaming?

weijielyu commented 1 month ago

Hi, sorry, but I do not completely understand your questions, so feel free to follow up.

As class-agnostic segmentation methods, SAM and EntitySeg do not produce semantic labels for masks, so our results also do not have semantic labels.

If you are referring to the videos, we adopted codes from https://github.com/VITA-Group/FSGS to render videos. Please let me know if that answers your question!