search

cytomining / cytominer-eval

[Deprecated] Common Evaluation Metrics for DataFrames
BSD 3-Clause "New" or "Revised" License
7 stars 11 forks source link

Figure out why percent replicating is apparently insensitive to number of replicates #60

Open shntnu opened 3 years ago

shntnu commented 3 years ago

@gwaygenomics reported this in https://github.com/broadinstitute/lincs-profiling-complementarity

Additionally, because we had 5 replicates of Cell Painting and 3 replicates of L1000 per treatment, we performed a subsampling experiment with Cell Painting to match the number of L1000 replicates. We actually observed slightly increased percent replicating scores in the subsampled Cell Painting data with fewer replicates indicating that the two additional Cell Painting replicates did not artificially inflate percent replicating scores (Supplementary Figure 3).

supfigure3

shntnu commented 3 years ago

cc'ing @AnneCarpenter to keep her posted on the thread whenever we get to it