search

kkyamada / bert-rbp

29 stars 10 forks source link

How to compute AUROC of those benchmarking Binding Sites prediction Models? #9

Closed Leo-T-Zang closed 4 months ago

Leo-T-Zang commented 8 months ago

Hi @kkyamada ,

Thanks for sharing this great work!

I am curious how you computed AUROC scores of those benchmarking Binding Sites prediction Models. I assume your AUROC score is for bound or not (whole sequence), yet those models predict bound or not for each site.

Thanks!

kkyamada commented 8 months ago

Hi @Leo-T-Zang,

Thank you for your question. We also computed AUROC based on the predictions for each site, but not for the whole sequence. Our model is not capable of taking the whole RNA sequence due to the computational complexity (O(N^2) with respect to the sequence length N).

Best,