lkeab / gaussian-grouping

[ECCV'2024] Gaussian Grouping for open-world Anything reconstruction, segmentation and editing.
https://arxiv.org/abs/2312.00732
Apache License 2.0
500 stars 37 forks source link

How to change the object encoding dimension for rendering #6

Open David-Dou opened 6 months ago

David-Dou commented 6 months ago

Hi, could you please share how to extend the object identity encoding rendering by enlarging the encoding dimension. I have tried directly changing the macros NUM_OBJECTS in submodules/diff-feature-gaussian-rasterization/cuda_rasterizer/config.h from 16 to 64. However, such error occurs during setting up this changed rasterization package. $TCML1@250N%2I8JMJ3%4W5 So could you please share what else should I to enlarge the object encoding dimension for rendering, thx!

ymq2017 commented 6 months ago

Hi, this problem comes from too much shared data for rasterization. You can reduce the block size to avoid this problem. Note that you also need to change the corresponding dim in this line.

In cuda rasterization, every channel is operated in a for-loop. So increasing the dimension may reduce speed for rendering a lot. We use 16 to balance performance and speed. You can choose a suitable dimension to experiment with.

David-Dou commented 6 months ago

Thank you for your reply. I'll have a try on it.