facebookresearch / pytorch3d

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
https://pytorch3d.org/
Other
8.7k stars 1.3k forks source link

Generating Multi-Colored Screenshots of VTK Teeth Model for Future 2D and 3D Teeth Segmentation #1616

Closed mohamed-seyam closed 1 year ago

mohamed-seyam commented 1 year ago

Issue Description: I am currently working with a VTK teeth model, where each tooth is assigned a unique scalar value within the range of 1 to 16. My intention is to leverage the PyTorch3D rendering capabilities to create a series of screenshots showcasing the teeth model from different viewing angles. These screenshots will serve as the foundation for future 2D and 3D teeth segmentation tasks, conducted under 2D supervision.

Steps Taken:

Imported the teeth model in VTK format. Utilized PyTorch3D rendering functionality to generate a collection of screenshots, capturing varying perspectives of the teeth model. Challenge: The primary challenge I'm encountering revolves around effectively differentiating each tooth within the rendered screenshots. I seek to apply distinct colors to individual teeth, based on their corresponding scalar values, without relying on texture data. This differentiation will aid in the clarity of 2D and 3D segmentation tasks to be performed later.

Future Use: The generated screenshots are integral to my planned 2D and 3D teeth segmentation work, which will involve 2D supervision techniques. These images will serve as reference points for training and validating segmentation algorithms.

Expected Outcome: I aspire to produce a set of multi-colored screenshots that uniquely represent each tooth in the VTK model. These images will facilitate accurate and precise 2D and 3D segmentation processes and contribute to the overall success of the project.

I appreciate any insights, guidance, or suggestions you can provide to address this challenge effectively.

bottler commented 1 year ago

We can't provide advice on your research.