naamiinepal / xrayto3D-benchmark

GNU General Public License v3.0
9 stars 3 forks source link

relationship between DICE and clinical metrics #30

Open msrepo opened 1 year ago

msrepo commented 1 year ago

Since, our clinical metrics evaluation has lot of outliers (due to difficulty in automatic evaluation of these metrics), we need to filter outliers when line fitting to obtain relationship between DICE and clinical metrics, or else use L1 Regression.

Before outlier removal image with 90% quantile outlier removal image

msrepo commented 1 year ago

This relationship is more or less similar for other generalized metrics such as ['DSC','NSD','ASD','HD95',] image

msrepo commented 1 year ago

The above figure is for a single architecture. Do this for all the architecture in a single figure. Also, show the comparison between methods for relationship between dice and clinical metrics.

msrepo commented 1 year ago

i) femur head center seem to be consistently well located as dice score improves. ii) vertebral body seem to be well reconstructed even for comparatively low dice(0.8 vs 0.9), any improvement in dice score is correlated with better reconstruction of spinous process.

The first part of statement ii) looks obvious since such a large part of the vertebra volume consists of vertebra body. Even when any peculiarities in the vertebral body such as osteophytes are not reconstructed, dice score is not affected much. For a interesting work on osteophyte reconstruction see Ambellan where region of low variability and high variability is obtained from Statistical Shape Model(SSM) to regularize the shape