calico / solo

software to detect doublets
MIT License
85 stars 13 forks source link

Performance testing #58

Closed njbernstein closed 3 years ago

njbernstein commented 3 years ago

Results from calculate_performance.py:

(solo-sc) nicholas@sci-pvm-nicholas:~/repos/solo/testdata$ python calculate_performance.py 
Mean AUROC has changed by for kidney: 0.01169807650179644
P value for metric change AUROC in experiment kidney: 0.10564977366685535
Mean average_precision has changed by for kidney: 0.0035119695536394158
P value for metric change average_precision in experiment kidney: 0.4012936743170763
Mean AUROC has changed by for pbmc: -0.01620667696324163
P value for metric change AUROC in experiment pbmc: 0.10564977366685535
Mean average_precision has changed by for pbmc: 0.008576634166130193
P value for metric change average_precision in experiment pbmc: 0.2266273523768682