davidpng / FCS_Database

Program to scrape an FCS directory of metadata
GNU General Public License v3.0
3 stars 2 forks source link

[low priority] Why are samples failings stats extraction? #64

Open hermands opened 9 years ago

hermands commented 9 years ago

Is it appropriate?

sqlite> select flag, count(*) as count from TubeCases group by flag; flag|count GOOD|226926 empty|397 meta_tube_export_fail|25 stats_extraction_fail|1087

davidpng commented 9 years ago

stats_extraction_fail|1087 seems a little high but percentage-wise we are talking <0.5%

Could you give me a list of the tubes that have this flag?

On Mon, Jan 26, 2015 at 10:15 PM, Daniel Herman notifications@github.com wrote:

Is it appropriate?

sqlite> select flag, count(*) as count from TubeCases group by flag; flag|count GOOD|226926 empty|397 meta_tube_export_fail|25 stats_extraction_fail|1087

— Reply to this email directly or view it on GitHub https://github.com/davidpng/FCS_Database/issues/64.

hermands commented 9 years ago

sqlite> select tube_type, count(*) as count from TubeTypesInstances INNER JOIN TubeCases using (tube_type_instance) where flag = 'stats_extraction_fail' group by tube_type having count > 5 order by count desc; B Cells New|162 Myeloid 1|147 Myeloid 2|141 B ALL MRD|94 Plasma Cell NEW|84 Myeloid 4|82 BAL COUNT|72 T Cells New|69 T Cell|43 T-ALL 2|12 addon|12 Other B cell|11 PURITY|10 Hodgkin|8 WBC|8 MASTO rpt|7

sqlite> select tube_type, count(*) as count from TubeTypesInstances INNER JOIN TubeCases using (tube_type_instance) where flag != 'stats_extraction_fail' group by tube_type order by count desc limit 10; B Cells New|52602 Myeloid 1|34561 Myeloid 2|33006 T Cells New|27339 Myeloid 4|18843 B ALL MRD|11095 Plasma Cell NEW|10993 T Cell|10432 WBC|4448 T4|2222

sqlite> select strftime('%Y-%m', date) as Month, count(*) as count from TubeCases where flag == 'stats_extraction_fail' group by strftime('%Y-%m', date) order by Month;
2005-11|2 2005-12|5 2006-01|1 2006-02|11 2006-03|4 2006-04|6 2006-05|18 2006-06|14 2006-07|6 2006-08|3 2006-09|3 2006-10|14 2006-11|5 2006-12|20 2007-01|14 2007-02|21 2007-03|19 2007-04|12 2007-05|13 2007-06|16 2007-07|16 2007-08|23 2007-09|20 2007-10|22 2007-11|12 2007-12|7 2008-01|17 2008-02|12 12008-03|29 2008-04|33 2008-05|30 2008-06|22 2008-07|25 2008-08|7 2008-09|13 2008-10|8 2008-11|18 2008-12|12 2009-01|4 2009-02|12 2009-03|7 2009-04|5 2009-05|9 2009-06|5 2009-07|2 2009-08|2 2009-09|10 2009-10|6 2009-11|1 2009-12|3 2010-01|5 2010-02|4 2010-03|9 2010-04|12 2010-05|10 2010-06|16 2010-07|7 2011-01|10 2011-02|3 2011-03|14 2011-04|5 2011-05|22 2011-06|12 2011-07|9 2011-08|4 2011-09|7 2011-10|5 2011-11|8 2011-12|10 2012-01|2 2012-02|4 2012-04|6 2012-05|6 2012-06|1 2012-07|19 2012-09|2 2012-10|8 2012-12|5 2013-01|16 2013-02|9 2013-03|4 2013-04|4 2013-05|3 2013-06|14 2013-07|15 2013-08|10 2013-09|16 2013-10|3 2013-11|10 2013-12|18 2014-01|6 2014-02|4 2014-03|5 2014-04|2 2014-05|13 2014-06|13 2014-07|11 2014-08|15 2014-09|14 2014-10|22 2014-11|14 2014-12|22