lkeab / gaussian-grouping

[ECCV'2024] Gaussian Grouping for open-world Anything reconstruction, segmentation and editing.
https://arxiv.org/abs/2312.00732
Apache License 2.0
679 stars 42 forks source link

Editting with prompts #26

Open LaFeuilleMorte opened 8 months ago

LaFeuilleMorte commented 8 months ago

Thanks for your brilliant work first. In the official repo, there're no demos on how to editting the gaussians with text-prompts. (Only an object id for removal/inpainting tasks), However, this would sometimes be hard to utilize cause one cannot know what exactly the object is given an id of that object. Thus I did a small change in the "prepare pseudo label" stage. By using gaussian-grouping/Tracking-Anything-with-DEVA/demo/demo_with_text.py, we can input text prompts to get object masks as you want. With this mask accuired by prompts, we can then do the training, removal/inpainting , any downstream tasks.