search

duyhominhnguyen / LVM-Med

[NeurIPS 2023] Release LMV-Med pre-trained models
188 stars 24 forks source link

Can this model fine-tuning with coco dataset? #13

Open skyfallsss opened 9 months ago

skyfallsss commented 9 months ago

The medical dataset I use is coco fornat.I cannot find the guidance on it.

ngctnnnn commented 9 months ago

Hi,

Can you demonstrate your problem more detailedly ?

skyfallsss commented 9 months ago

I want to know the format of the dataset llvm-med use. My dataset's format is the coco format of object instances. Can I use my dataset without converting to finetune llvm-med model?

skyfallsss commented 9 months ago
  1. Prompt-based Segmentation with ViT-B a. Prompt-based segmentation with fine-tuned decoder of SAM (MedSAM). about this method training ,what is the dataset format? coco format or others.
ngctnnnn commented 9 months ago

On the prompt-based segmentation, bounding boxes that serve as the prompt are in the format of x_min, y_min, x_max, y_max.

Hope it might help.

ngctnnnn commented 9 months ago

You could discover more or adjust for your best suit by observing the dataloader/dataset.py file.