CompVis / stable-diffusion

A latent text-to-image diffusion model
https://ommer-lab.com/research/latent-diffusion-models/
Other
66.51k stars 9.97k forks source link

Training/Fine-tuning model with custom medical images. #834

Open khanhpham3799 opened 4 months ago

khanhpham3799 commented 4 months ago

Hi, I want to use Stable Diffusion for my custom MRI images with 4 channels input (size: 4,256,256), my dataset includes 2 types: "tumor" or "non-tumor" images. I'm wondering whether it is better to fine-tune the pre-trained model or train it from the scratch? In case of fine-tuning, is there any code for the direction? Thanks in advance!