bioinfomaticsCSU / deepsignal

Detecting methylation using signal-level features from Nanopore sequencing reads
GNU General Public License v3.0
109 stars 21 forks source link

Expected results for example data set? #5

Closed eexwhyzee closed 5 years ago

eexwhyzee commented 5 years ago

Hi,

Running deepsignal locally, i used the example data/model located here and getting these results: screen shot 2019-02-21 at 12 36 32 pm

and I was wondering if the accuracy is supposed to be this low for the example dataset?

PengNi commented 5 years ago

Hi @eexwhyzee ,

Sorry for the delay. The results may be a little bit misleading. During the mods-calling, deepsignal takes all samples as methylated (i.e. the True labels of all samples are 1) by default when calculating the accuracy. This is not the truth for the example data. Beacuse the example data is sequenced from a native sample.

Also, the accuracy is just for an estimation, it won't effect the prediction results.

We are considering change the example data soon, and revise the code for stdout too.

Best, Peng

eexwhyzee commented 5 years ago

Thanks for the reply @PengNi! btw great work so far!