mahulchak / svmu

A program to call variants from genome alignment
GNU General Public License v3.0
76 stars 18 forks source link

Segmentation fault (core dumped) - lastz issues? #15

Open MattHuff opened 4 years ago

MattHuff commented 4 years ago

I am running an analysis on two genomes - one with a pseudochromosome level assembly, the other with a scaffold level assembly. Using the provided command for lastz took several days for the program to complete, ultimately providing me with an empty file. Adding the following options to the lastz command fixed this, and I was able to get lastz output files in a reasonable timeframe:

--notransition --step=20 --nogapped 

However, when I attempt to run SVMU using the output of this lastz run, I get a Segmentation fault (core dumped) error. Based on the documentation for this tool, I removed any whitespace from the input fasta files, but still got this error. As a sanity check - when the original lastz command no longer worked - I chose to take only a subsection of the input sequences and run lastz on them, which gave me output files - and used that on svmu; this provided me with results, and did not produce the Segmentation fault error. Once I saw this error, I reran this limited analysis using the new options from above, and attempting to run SVMU gave me the same Segmentation fault error.

Due to how long lastz took to run on the whole genomes without these options - and the ultimately fruitless results - I am unsure if there is another way to optimize lastz to run with these genomes. However, from my observations, it would seem as if these options are incompatible with SVMU, resulting in a Seg fault error. These commands lower the seeding sensitivity of lastz, and ignore gapped alignments; perhaps this plays some role in why it has been failing?

Do you have any recommendations for running lastz that does not prevent SVMU from completing?

mahulchak commented 4 years ago

Hi Matt, I will need more time to integrate lastz well into SVMU than my bandwidth is permitting me. I'd turn off LASTZ for now. Give me a couple of days to update the code.

On Mon, Aug 3, 2020 at 11:59 AM MattHuff notifications@github.com wrote:

I am running an analysis on two genomes - one with a pseudochromosome level assembly, the other with a scaffold level assembly. Using the provided command for lastz took several days for the program to complete, ultimately providing me with an empty file. Adding the following options to the lastz command fixed this, and I was able to get lastz output files in a reasonable timeframe:

--notransition --step=20 --nogapped

However, when I attempt to run SVMU using the output of this lastz run, I get a Segmentation fault (core dumped) error. Based on the documentation for this tool, I removed any whitespace from the input fasta files, but still got this error. As a sanity check - when the original lastz command no longer worked - I chose to take only a subsection of the input sequences and run lastz on them, which gave me output files - and used that on svmu; this provided me with results, and did not produce the Segmentation fault error. Once I saw this error, I reran this limited analysis using the new options from above, and attempting to run SVMU gave me the same Segmentation fault error.

Due to how long lastz took to run on the whole genomes without these options - and the ultimately fruitless results - I am unsure if there is another way to optimize lastz to run with these genomes. However, from my observations, it would seem as if these options are incompatible with SVMU, resulting in a Seg fault error. These commands lower the seeding sensitivity of lastz, and ignore gapped alignments; perhaps this plays some role in why it has been failing?

Do you have any recommendations for running lastz without breaking SVMU?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/mahulchak/svmu/issues/15, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABZQH2EPPR7VN44RYY6NWODR64CCZANCNFSM4PTT4M2A .

-- Mahul Chakraborty Department of Ecology and Evolutionary Biology University of California-Irvine Phone: 949 824 9559 Fax: 949 824 9559 Website: https://mahulchakraborty.wordpress.com/ Github: https://github.com/mahulchak

mahulchak commented 4 years ago

I updated the code. If you are interested, you can update and run svmu. The updated version works with delta files created with nucmer mumreference (the default option) and does not require -maxmatch.

MattHuff commented 4 years ago

Thank you for the response. I have tried the updated version of SVMU with my lastz results, but I am not getting results, or a "segmentation fault" message to go with it.

mahulchak commented 4 years ago

Will you be able to share the nucmer delta file?

On Mon, Aug 17, 2020 at 6:06 AM MattHuff notifications@github.com wrote:

Thank you for the response. I have tried the updated version of SVMU with my lastz results, but I am not getting results, or a "segmentation fault" message to go with it.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/mahulchak/svmu/issues/15#issuecomment-674868684, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABZQH2FOU4J7ARTPAF7OPSDSBETGXANCNFSM4PTT4M2A .

-- Mahul Chakraborty Department of Ecology and Evolutionary Biology University of California-Irvine Phone: 949 824 9559 Fax: 949 824 9559 Website: https://mahulchakraborty.wordpress.com/ Github: https://github.com/mahulchak

lipingfangs commented 4 years ago

Hello I am running an analysis on two genomes and also got the problem of Segmentation fault randomly . It may happen randomly at the running of the same data...Do you have any recommendations for running lastz that does not prevent SVMU from completing?

mahulchak commented 4 years ago

Hi, lastz integration is in beta so it may be unstable. You can provide an empty file as a fake lastz file and run the latest version. If you still encounter problem, let me know.

On Wed, Sep 9, 2020 at 8:32 PM pingping notifications@github.com wrote:

Hello I am running an analysis on two genomes and also got the problem of Segmentation fault randomly . It may happen randomly at the running of the same data...Do you have any recommendations for running lastz that does not prevent SVMU from completing?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/mahulchak/svmu/issues/15#issuecomment-689955638, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABZQH2GKIG63MYWZYBMDPYLSFBCB7ANCNFSM4PTT4M2A .

-- Mahul Chakraborty Department of Ecology and Evolutionary Biology University of California-Irvine Phone: 949 824 9559 Fax: 949 824 9559 Website: https://mahulchakraborty.wordpress.com/ Github: https://github.com/mahulchak

peanut-nu commented 11 months ago

Hi, lastz integration is in beta so it may be unstable. You can provide an empty file as a fake lastz file and run the latest version. If you still encounter problem, let me know. On Wed, Sep 9, 2020 at 8:32 PM pingping @.***> wrote: Hello I am running an analysis on two genomes and also got the problem of Segmentation fault randomly . It may happen randomly at the running of the same data...Do you have any recommendations for running lastz that does not prevent SVMU from completing? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#15 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABZQH2GKIG63MYWZYBMDPYLSFBCB7ANCNFSM4PTT4M2A . -- Mahul Chakraborty Department of Ecology and Evolutionary Biology University of California-Irvine Phone: 949 824 9559 Fax: 949 824 9559 Website: https://mahulchakraborty.wordpress.com/ Github: https://github.com/mahulchak

Hello,I already provide an empty lastz file as a input file and svmu create output file without abnormalities,but when i use the lastz file ,there still got the problem of Segmentation fault.Do you have any recommendations for adjustment the lastz file to be correct?Thank you so much.

mahulchak commented 10 months ago

Hi, Sorry for the inconvenience, but the lastz functionality is still not supported. So a lastz output file is likely to lead to errors and segfaults.

On Tue, Dec 12, 2023 at 12:54 AM peanut @.***> wrote:

Hi, lastz integration is in beta so it may be unstable. You can provide an empty file as a fake lastz file and run the latest version. If you still encounter problem, let me know. … <#m8504869566294159708> On Wed, Sep 9, 2020 at 8:32 PM pingping @.**> wrote: Hello I am running an analysis on two genomes and also got the problem of Segmentation fault randomly . It may happen randomly at the running of the same data...Do you have any recommendations for running lastz that does not prevent SVMU from completing? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#15 (comment) <https://urldefense.com/v3/__https://github.com/mahulchak/svmu/issues/15issuecomment-689955638;Iw!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabOO1CYYO$>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABZQH2GKIG63MYWZYBMDPYLSFBCB7ANCNFSM4PTT4M2A https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/ABZQH2GKIG63MYWZYBMDPYLSFBCB7ANCNFSM4PTT4M2A__;!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabKNaJU80$ . -- Mahul Chakraborty Department of Ecology and Evolutionary Biology University of California-Irvine Phone: 949 824 9559 Fax: 949 824 9559 Website: https://mahulchakraborty.wordpress.com/ <https://urldefense.com/v3/https://mahulchakraborty.wordpress.com/__;!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabGKGWJ-i$> Github: https://github.com/mahulchak https://urldefense.com/v3/__https://github.com/mahulchak__;!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabEc331CD$

Hello,I already provide an empty lastz file as a input file and svmu create output file without abnormalities,but when i use the lastz file ,there still got the problem of Segmentation fault.Do you have any recommendations for adjustment the lastz file to be correct?Thank you so much.

— Reply to this email directly, view it on GitHub https://urldefense.com/v3/__https://github.com/mahulchak/svmu/issues/15*issuecomment-1851404342__;Iw!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabPFQfxR4$, or unsubscribe https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/ABZQH2ENF7TRYRLNU5VWSETYI75T5AVCNFSM4PTT4M2KU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBVGE2DANBTGQZA__;!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabHCeWOe6$ . You are receiving this because you commented.Message ID: @.***>

-- Mahul Chakraborty Assistant Professor Department of Biology Texas A&M University Phone: 979 458 7291 Fax: 979-845-2891 Website: https://chakrabortylab.org/ https://mahulchakraborty.wordpress.com/ Github: https://github.com/mahulchak

peanut-nu commented 10 months ago

Hi, Sorry for the inconvenience, but the lastz functionality is still not supported. So a lastz output file is likely to lead to errors and segfaults. On Tue, Dec 12, 2023 at 12:54 AM peanut @.> wrote: Hi, lastz integration is in beta so it may be unstable. You can provide an empty file as a fake lastz file and run the latest version. If you still encounter problem, let me know. … <#m8504869566294159708> On Wed, Sep 9, 2020 at 8:32 PM pingping @.> wrote: Hello I am running an analysis on two genomes and also got the problem of Segmentation fault randomly . It may happen randomly at the running of the same data...Do you have any recommendations for running lastz that does not prevent SVMU from completing? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#15 (comment) https://urldefense.com/v3/__https://github.com/mahulchak/svmu/issues/15*issuecomment-689955638__;Iw!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabOO1CYYO$>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABZQH2GKIG63MYWZYBMDPYLSFBCB7ANCNFSM4PTT4M2A https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/ABZQH2GKIG63MYWZYBMDPYLSFBCB7ANCNFSM4PTT4M2A__;!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabKNaJU80$ . -- Mahul Chakraborty Department of Ecology and Evolutionary Biology University of California-Irvine Phone: 949 824 9559 Fax: 949 824 9559 Website: https://mahulchakraborty.wordpress.com/ https://urldefense.com/v3/__https://mahulchakraborty.wordpress.com/__;!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabGKGWJ-i$ Github: https://github.com/mahulchak https://urldefense.com/v3/__https://github.com/mahulchak__;!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabEc331CD$ Hello,I already provide an empty lastz file as a input file and svmu create output file without abnormalities,but when i use the lastz file ,there still got the problem of Segmentation fault.Do you have any recommendations for adjustment the lastz file to be correct?Thank you so much. — Reply to this email directly, view it on GitHub https://urldefense.com/v3/__https://github.com/mahulchak/svmu/issues/15*issuecomment-1851404342__;Iw!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabPFQfxR4$, or unsubscribe https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/ABZQH2ENF7TRYRLNU5VWSETYI75T5AVCNFSM4PTT4M2KU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBVGE2DANBTGQZA__;!!CzAuKJ42GuquVTTmVmPViYEvSg!LT3fJr87kXsz37RPT6VqFURhyqxHMhiE_xlQJ1wmpxW97OKwUo8ZD_w1vsZMqshGDdlRi_0tVRzQE1GabHCeWOe6$ . You are receiving this because you commented.Message ID: @.***> -- Mahul Chakraborty Assistant Professor Department of Biology Texas A&M University Phone: 979 458 7291 Fax: 979-845-2891 Website: https://chakrabortylab.org/ https://mahulchakraborty.wordpress.com/ Github: https://github.com/mahulchak

Thank you for your reply, I apologize for the inconvenience, but I would like to ask, if not using lastz and relying on MUMmer for genome alignment, how can we obtain more accurate CNV variation results?