MrTomRod / scoary-2

Calculate assocations between genes and traits
MIT License
19 stars 1 forks source link

Sensitivity&Specificity #12

Closed Ultramancc closed 4 months ago

Ultramancc commented 5 months ago

Hi,

I'm currently using scoary2 and it's a useful tool. I have a question about sensitivity&specificity May I know the calculation way for those two values? As I have found there may be some conflicts with sensitivity and specificity, those genes were lowly detected in trait-positive but the results indicate they have a high sensitivity.

image

MrTomRod commented 4 months ago

Dear @Ultramancc

Sorry for responding so slowly, I was on holiday.

Good question, the cause is a recent change that was made to Scoary2 in response to this issue/pull request:

The original behaviour (Scoary1 and Scoary2 up until 0.0.4):

The current behaviour (Socary2 starting with 0.0.5):

If gene and trait are positively correlated (original behaviour):

If gene and trait are negatively correlated:

Your data

I made a simple Excel that may make it easier to understand what is happening: SensSpecPlayground.xlsx

Ultramancc commented 4 months ago

Thank you so much for your detailed and helpful answer!

MrTomRod commented 4 months ago

No worries! 👍