WGLab / PennCNV

Copy number vaiation detection from SNP arrays
http://penncnv.openbioinformatics.org
Other
88 stars 53 forks source link

segmentation fault running PennCNV 2010May version #65

Open QidiFeng opened 3 years ago

QidiFeng commented 3 years ago

Hi Kai,

I was trying to do cnv comparison with a previous paper which used PennCNV v2010May. So I got package from the author and tried to install this older PennCNV version. I used perl 5.14.2 and gcc 8.3.0 (Debian 8.3.0-6). There is no error when "make" under ./kext file. But it shows "Segmentation fault" when running the example data. I am wonder do you have any suggestions? Pls feel free to ask if you need more information.

perl: warning: Setting locale failed. perl: warning: Please check that your locale settings: LANGUAGE = (unset), LC_ALL = (unset), LC_CTYPE = "UTF-8", LANG = "C.UTF-8" are supported and installed on your system. perl: warning: Falling back to the standard locale ("C"). perl: warning: Setting locale failed. perl: warning: Please check that your locale settings: LANGUAGE = (unset), LC_ALL = (unset), LC_CTYPE = "UTF-8", LANG = "C.UTF-8" are supported and installed on your system. perl: warning: Falling back to the standard locale ("C"). NOTICE: All program notification/warning messages that appear in STDERR will be also written to log file ex1.log NOTICE: Reading marker coordinates and population frequency of B allele (PFB) from example.pfb ... Done with 93129 records NOTICE: Reading LRR and BAF values for from father.txt ... Done with 93129 records in 4 chromosomes NOTICE: Data from chromosome X will not be used in analysis NOTICE: Median-adjusting LRR values for all autosome markers from father.txt by 0.0221 NOTICE: Median-adjusting BAF values for all autosome markers from father.txt by 0.0029 NOTICE: quality summary for father.txt: LRR_mean=0.0027 LRR_median=0.0000 LRR_SD=0.1335 BAF_mean=0.5063 BAF_median=0.5000 BAF_SD=0.0390 BAF_DRIFT=0.000037 WF=0.0184 GCWF=0.0136 Segmentation fault

Best regards, Qidi

kaichop commented 3 years ago

It is likely a memory issue (at least 8G required for modern arrays with

500K markers). I will make another docker image that it is best that you just run in docker instead.

On Tue, Jan 19, 2021 at 9:24 PM Qidi Feng notifications@github.com wrote:

Hi Kai,

I was trying to do cnv comparison with a previous paper which used PennCNV v2010May. So I got package from the author and tried to install this older PennCNV version. I used perl 5.14.2 and gcc 8.3.0 (Debian 8.3.0-6). There is no error when "make" under ./kext file. But it shows "Segmentation fault" when running the example data. I am wonder do you have any suggestions? Pls feel free to ask if you need more information.

perl: warning: Setting locale failed. perl: warning: Please check that your locale settings: LANGUAGE = (unset), LC_ALL = (unset), LC_CTYPE = "UTF-8", LANG = "C.UTF-8" are supported and installed on your system. perl: warning: Falling back to the standard locale ("C"). perl: warning: Setting locale failed. perl: warning: Please check that your locale settings: LANGUAGE = (unset), LC_ALL = (unset), LC_CTYPE = "UTF-8", LANG = "C.UTF-8" are supported and installed on your system. perl: warning: Falling back to the standard locale ("C"). NOTICE: All program notification/warning messages that appear in STDERR will be also written to log file ex1.log NOTICE: Reading marker coordinates and population frequency of B allele (PFB) from example.pfb ... Done with 93129 records NOTICE: Reading LRR and BAF values for from father.txt ... Done with 93129 records in 4 chromosomes NOTICE: Data from chromosome X will not be used in analysis NOTICE: Median-adjusting LRR values for all autosome markers from father.txt by 0.0221 NOTICE: Median-adjusting BAF values for all autosome markers from father.txt by 0.0029 NOTICE: quality summary for father.txt: LRR_mean=0.0027 LRR_median=0.0000 LRR_SD=0.1335 BAF_mean=0.5063 BAF_median=0.5000 BAF_SD=0.0390 BAF_DRIFT=0.000037 WF=0.0184 GCWF=0.0136 Segmentation fault

Best regards, Qidi

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/WGLab/PennCNV/issues/65, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABNG3OELNYM5FMRJ4UIUDHTS2Y5GXANCNFSM4WJ6XYHQ .

QidiFeng commented 3 years ago

Hi Kai,

Thank you very much for your help! I will try the docker when it is ready. Besides, do you need the PennCNV 2010May01 package for making the docker image? I can send you if you need it. By the way, I tried to increase memory size to 100GB for the VM I am running PennCNV. But it reported the same error. Below shows the results I checked memory. Is there a possibility that gcc version incompatibility cause this error?

(base) fengqidi@qdfcnv:~/penncnv/example$ cat /proc/meminfo MemTotal: 103132936 kB MemFree: 102685448 kB MemAvailable: 102086180 kB Buffers: 18312 kB Cached: 124336 kB SwapCached: 0 kB Active: 97680 kB Inactive: 92948 kB Active(anon): 43776 kB Inactive(anon): 8392 kB Active(file): 53904 kB Inactive(file): 84556 kB Unevictable: 0 kB Mlocked: 0 kB SwapTotal: 0 kB SwapFree: 0 kB Dirty: 8 kB Writeback: 0 kB AnonPages: 48040 kB Mapped: 53160 kB Shmem: 8520 kB Slab: 59652 kB SReclaimable: 23704 kB SUnreclaim: 35948 kB KernelStack: 2176 kB PageTables: 1032 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 51566468 kB Committed_AS: 292540 kB VmallocTotal: 34359738367 kB VmallocUsed: 0 kB VmallocChunk: 0 kB Percpu: 2848 kB AnonHugePages: 8192 kB ShmemHugePages: 0 kB ShmemPmdMapped: 0 kB HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB Hugetlb: 0 kB DirectMap4k: 93416 kB DirectMap2M: 5148672 kB DirectMap1G: 101711872 kB

kaichop commented 3 years ago

Actually if you do not mind, just install a lower version of gcc and see if it works. Perl 5.14 should be fine. I cannot tell what's wrong since you have a lot of memory in system, but each program's memory is set by limits.conf, not the system total memory. You could also simply spin up a docker (with say for example centos 6 or 7), and then install perl/gcc (if it is not already there), and then compile penncnv within it. This will probably be easiest to diagnose what is the problem.

On Tue, Jan 19, 2021 at 10:39 PM Qidi Feng notifications@github.com wrote:

Hi Kai,

Thank you very much for your help! I will try the docker when it is ready. Besides, do you need the PennCNV 2010May01 package for making the docker image? I can send you if you need it. By the way, I tried to increase memory size to 100GB for the VM I am running PennCNV. But it reported the same error. Below shows the results I checked memory. Is there a possibility that gcc version incompatibility cause this error?

(base) fengqidi@qdfcnv:~/penncnv/example$ cat /proc/meminfo MemTotal: 103132936 kB MemFree: 102685448 kB MemAvailable: 102086180 kB Buffers: 18312 kB Cached: 124336 kB SwapCached: 0 kB Active: 97680 kB Inactive: 92948 kB Active(anon): 43776 kB Inactive(anon): 8392 kB Active(file): 53904 kB Inactive(file): 84556 kB Unevictable: 0 kB Mlocked: 0 kB SwapTotal: 0 kB SwapFree: 0 kB Dirty: 8 kB Writeback: 0 kB AnonPages: 48040 kB Mapped: 53160 kB Shmem: 8520 kB Slab: 59652 kB SReclaimable: 23704 kB SUnreclaim: 35948 kB KernelStack: 2176 kB PageTables: 1032 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 51566468 kB Committed_AS: 292540 kB VmallocTotal: 34359738367 kB VmallocUsed: 0 kB VmallocChunk: 0 kB Percpu: 2848 kB AnonHugePages: 8192 kB ShmemHugePages: 0 kB ShmemPmdMapped: 0 kB HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB Hugetlb: 0 kB DirectMap4k: 93416 kB DirectMap2M: 5148672 kB DirectMap1G: 101711872 kB

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/WGLab/PennCNV/issues/65#issuecomment-763307424, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABNG3OCEIIIVUUIZ3FV3UKLS2ZF6HANCNFSM4WJ6XYHQ .

QidiFeng commented 3 years ago

Hi Kai,

I tried gcc4.9 but it still shows the same error. I used to run the latest version of PennCNV of ~200 samples successfully on this VM. Does that suggest this is not a memory issue?

Best regards, Qidi

QidiFeng commented 3 years ago

Hi Kai,

It finally works under gcc4.9 and perl5.8.7. Thank you very much for your help!

Best regards, Qidi