buaacyw / GaussianEditor

[CVPR 2024] GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting
https://buaacyw.github.io/gaussian-editor/
Other
1k stars 47 forks source link

Parameter settings when deleting an object #20

Closed hollow1123 closed 4 months ago

hollow1123 commented 7 months ago

I tried this example of deleting bicycle given in the paper. 图片

The paper said: when deleting the bike directly, there are still Gaussian points around the bike which are not deleted, resulting in the creation of artifacts, so 2D inpainting optimization is needed.

Then after the optimization of deleting the bike, just like below, the optimized scene is not ideal due to the bad 2D inpainting result. (the text I used for inpainting model is "bench",which is the background description).Is this due to the fact that the results in your paper were only optimized in fewer steps?The parameter of my optimization step is the program default value. QQ截图20231224144656

buaacyw commented 7 months ago

Hi! The poor 2D inpainting result is caused by a too large masked. The quality of 2D mask sent to 2D inpainting models is essential for getting a nice result. The default setting in WebUI works nice for the removing something on tables since we dilate the mask a lot by Mask Dilate and Fix Holes. For this bike scene, we disabled Fix Holes and set Mask Dilate and Inpaint Scale to a small value.

For more details please read hyperparameter guide