moontreegy / scseq_data_formatting

0 stars 0 forks source link

31915294_Drosophila_Gut #36

Closed liuyifang closed 1 year ago

liuyifang commented 4 years ago

PMID: 31915294

Species: Drosophila

Tissue: Gut

Paper title: A cell atlas of the adult Drosophila midgut

Paper link: https://www-pnas-org.ezp-prod1.hul.harvard.edu/content/117/3/1514.long

GEO link: https://www-ncbi-nlm-nih-gov.ezp-prod1.hul.harvard.edu/geo/query/acc.cgi?acc=GSE120537

Merge different single-cell technology data into one dataset.

liuyifang commented 4 years ago

@drsc-user Aram,

Below is the gene2cluster data for Ruei-Jiun's data:

/n/groups/flyrnai/yifang/Projects/With/Yue_Aram/scseq_data_formatting/processing_data/31915294_Drosophila_Gut

liuyifang commented 4 years ago

Issue report from Aram:

Importing went very well,
but for this problem there were 1864 import errors from 373693 rows.   (0.5 %)

The avg_exp colum seems to be the problem.

The Max value for a float in mysql the database is about xxx e35. 

Some values are "Inf" and some are > e35. 

Can I bump these values up to the max?

The files used to import are here:
/n/groups/flyrnai/yifang/Projects/With/Yue_Aram/scseq_data_formatting/processing_data/31915294_Drosophila_Gut

GSE120537_combine_gene2clusterTable_Drosophila_Gut.csv

[snip]

[ERROR in row 569] Out of range value for column 'avg_exp' at row 1
3.21761695747373E+050 91.3691821057388 'Jon99Ciii' 0 NULL

[ERROR in row 661] Out of range value for column 'avg_exp' at row 1
5.67914826162928E+101 97.1531857207411 'alphaTry' 0 NULL

[ERROR in row 1060] Out of range value for column 'avg_exp' at row 1
2.85920998967717E+057 95.4812471757795 'betaTry' 0 NULL

[ERROR in row 1365] Data truncated for column 'avg_exp' at row 1
'Inf' 100 'mt:lrRNA' 0 NULL

any advice on how to deal with that
liuyifang commented 4 years ago

@drsc-user Aram,

The newer version of the result fixed the inf for avg_exp issue:

/n/groups/flyrnai/yifang/Projects/With/Yue_Aram/scseq_data_formatting/processing_data/31915294_Drosophila_Gut