ArminMoghimi / Fine-tune-the-Segment-Anything-Model-SAM-

A. Moghimi, M. Welzel, T. Celik, and T. Schlurmann, "A Comparative Performance Analysis of Popular Deep Learning Models and Segment Anything Model (SAM) for River Water Segmentation in Close-Range Remote Sensing Imagery,"
https://doi.org/10.1109/ACCESS.2024.3385425
16 stars 4 forks source link

Questions about the produced masks #1

Open imneonizer opened 2 months ago

imneonizer commented 2 months ago

My goal is to do field delineation, I already got success with default weights using computer vision post processing, but I wanted to improve it further, training sam on domain data seems like a perfect solution to me. Only issue is it segments everything including roads water bodies etc, I want it to focus only on the fields.

Single produced mask on a 1024x1024 window: image

Produced masks interpolated over a large area: image

Converted to boundaries: output

ArminMoghimi commented 2 months ago
  • Does it output instance segmentation masks?
  • Can we use the trained weights with automatic mask generator?

My goal is to do field delineation, I already got success with default weights using computer vision post processing, but I wanted to improve it further, training sam on domain data seems like a perfect solution to me. Only issue is it segments everything including roads water bodies etc, I want it to focus only on the fields.

Single produced mask on a 1024x1024 window: image

Produced masks interpolated over a large area: image

Converted to boundaries: output

This can be extended to instance segmentation. We use this for water segmentation from the background, and it can be. Please try to use this fine-tuning for more than one class. The results you provided are already good, as well.