search

Pointcept / SAMPart3D

SAMPart3D: Segment Any Part in 3D Objects
MIT License
187 stars 5 forks source link

Fine-tuning on an uncolored labeled dataset #3

Open accoumar12 opened 1 week ago

accoumar12 commented 1 week ago

Hello, Thanks for your amazing work! I have a custom uncolored labeled dataset, with precise labels for the instances. It seems that it does not really fit the SAM pipeline, where the SAM segmentation does not bring any value... Do you have any guideline for fine tuning ? I thought to totally change the pipeline and introduce directly the labels, modifying the loss for example. Thanks for any tip!

miscal commented 1 week ago

I am not the author, but maybe you could use normal map for segmentation?

yhyang-myron commented 3 days ago

Hi, thanks for your interest in our work! Perhaps you could directly use this data to train a 3D network by adopting SAM's training method and loss configuration? Or conditioned on a 3D scale value?

yhyang-myron commented 3 days ago

For our design, we directly set the color value (after rgb augmentation) to (0,0,0) for uncolored data.