ocean-data-factory-sweden / kso

Notebooks to upload/download marine footage, connect to a citizen science project, train machine learning models and publish marine biological observations.
GNU General Public License v3.0
4 stars 12 forks source link

Developed a point-based segmentation approach #189

Open victor-wildlife opened 1 year ago

victor-wildlife commented 1 year ago

Integrate a ML approach to segment areas of interest from the SGU point-based photo labels. Maybe using Taglab or CVAT?

Relevant literature: General segmentation: https://arxiv.org/pdf/2003.06148.pdf https://colab.research.google.com/github/roboflow-ai/notebooks/blob/main/notebooks/how-to-segment-anything-with-sam.ipynb

Segment Anything Meets Point Tracking: Repo on a joint model of point tracking and Segmentation

Ocean-related: On Improving the Training of Models for the Semantic Segmentation of Benthic Communities from Orthographic Imagery Automatic Semantic Segmentation of Benthic Habitats Using Images from Towed Underwater Camera in a Complex Shallow Water Environment

@jannesgg @biomobst from our last conversation with SGU it's clear to me we should have different ML model approaches and human-in-the-loop annotation labelling (whether CVAT, Taglab,...)

victor-wildlife commented 1 year ago

@jannesgg and @Diewertje11 here is the post on the use of "segment anything"