search

chungmin99 / garfield

[CVPR'24] Group Anything with Radiance Fields
https://www.garfield.studio/
MIT License
390 stars 31 forks source link

Pre-trained models on LERF dataset #22

Closed weijielyu closed 8 months ago

weijielyu commented 8 months ago

Thanks for this exciting work. I wonder if you could release pre-trained models on LERF dataset, or just the rendered segmentations?

chungmin99 commented 8 months ago

Hi! Thanks for your interest in this project :)

I wonder if you could release pre-trained models on LERF dataset, or just the rendered segmentations?

The results should be reproducible with the current codebase -- on a 4090, it takes around ~30 minutes to optimize GARField for a given scene (~5-10 min to generate the SAM masks for the training images, and ~15 min for 30k steps).

At the moment, I'm not sure if there exists a standard on releasing nerfstudio models. It's an actively changing codebase, which could break compatibility with past checkpoints. If you have any suggestions on this front, let us know.

Also, not really sure about what you mean about "the rendered segmentations" -- the segmentation/grouping can vary a lot per scale.

weijielyu commented 8 months ago

I appreciate the information you provide! Thanks again for this great work!