Open rohanbanerjee opened 6 months ago
Uploading the QC for the held-out test set qc_held_out_test.zip
I went through the QC and below is the report 20240305_held_out_qc_report-RB.zip
Update:
Currently using a small subset of the held-out
test data. Below is the list of the subjects:
participant_held-out.tsv
This dataset which includes the manual corrections can be found at: https://drive.google.com/file/d/18SiXA8RWzCo6TBovC8umZxWcsZW1soIV/view?usp=sharing
The QC for the above data can be found below:
Description
I've been thinking a ways to evaluate out active learning training phases (mentioned in #29). We have currently trained a baseline model based on the good quality (✅ ) segmentations and we are using this model for predicting the SC on other images and then manually correct them on need basis.
Our overall goal to do active learning was to see if the model is able to adapt on not-great quality images and we expect performance improvement after each active learning phase. For this imo, we should have a separate held-out test set that we can test out trained models on.
How do we build this test set:
Figure: Creation of held-out test set for testing active learning phases
Ref: SCIseg paper
Tasks:
duke/temp/rohan/fmri_sc_seg/datasets/