cnobles / iGUIDE

Bioinformatic pipeline for identifying dsDNA breaks by marker based incorporation, such as breaks induced by designer nucleases like Cas9.
https://iguide.readthedocs.io/en/latest/
GNU General Public License v3.0
20 stars 9 forks source link

A failure in the middle of the run #74

Closed iditbuch closed 3 years ago

iditbuch commented 4 years ago

Hi Chris,

Screen Shot 2020-06-30 at 16 51 37

The attached file shows some error in the middle of the run. Please help.

Thanks

Idit

NOTE: This run was done using the umi_alt method that you added just recently. So I just discovered that iguide works and completed the run when the parameter R1_Leading_Trim_ODN = "." However, when set to R1_Leading_Trim_ODN = "ACGCGA" (that's our case), the run fails ... Many thanks for your help !!

cnobles commented 4 years ago

Hi Idit,

That's interesting, as the point where it failed is all the way at the evaluation. Could you post the eval.log file? Additionally, if you look at your unique sites data object, do you see many genomic locations identified?

Sorry it has taken me some time to respond, Definitely a lot going on these days.

Best, Chris

iditbuch commented 4 years ago

Dear Chris,

Thanks so much for your answer. I retried the whole run, this time with R1_Leading_Trim_ODN=” "GCGAAC" and this time it worked perfectly. Just few notes:

  1. I had to remove the .snakemake directory each time before any rerun.
  2. One iguide run needs a machine with at least 96GB RAM to complete successfully

One last question: In your umi_alt_example.supp.csv file there are only two columns – specimen & comment. Is there a way to add a control (non-treated) sample such that its results will be deducted from the treated samples results ?

Many thanks,

Idit

From: Chris Nobles notifications@github.com Reply-To: cnobles/iGUIDE reply@reply.github.com Date: Thursday, 9 July 2020 at 5:55 To: cnobles/iGUIDE iGUIDE@noreply.github.com Cc: Idit Buch iditb@emendobio.com, Author author@noreply.github.com Subject: Re: [cnobles/iGUIDE] A failure in the middle of the run (#74)

Hi Idit,

That's interesting, as the point where it failed is all the way at the evaluation. Could you post the eval.log file? Additionally, if you look at your unique sites data object, do you see many genomic locations identified?

Sorry it has taken me some time to respond, Definitely a lot going on these days.

Best, Chris

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/cnobles/iGUIDE/issues/74#issuecomment-655866270, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AMDRUTSM77RHTRDMZOVYHLDR2UWRTANCNFSM4OMISXAQ.

magic2077 commented 3 years ago

Hi Idit,

I installed iguide and it worked for simulation data. However when I run my real data (umi_alt method) I always got errors:

$ iguide run configs/run2.config.yml ValueError in line 89 of /home/ubuntu/iGUIDE/Snakefile: 'sampleName' is not in list File "/home/ubuntu/iGUIDE/Snakefile", line 89, in File "/home/ubuntu/miniconda3/envs/iguide/lib/python3.6/site-packages/iguidelib/init.py", line 12, in import_sample_info

You mentioned that for each run you had to remove the .snakemake directory. Could you explain the reason? I am wondering if my run failed because I did not remove the .snakemake directory.

Thanks a lot!

Magic2077

iditbuch commented 3 years ago

Hi Magic2077,

A .snakefile directory preserves the data accumulated in the previous run trial that failed. So, obviously, it would be best to delete it before trying to run again. As for the sampleName, I recommend reading the tutorial pages carefully.

Best of luck

Idit

magic2077 commented 3 years ago

Hi Idit,

Thanks a lot for your explanation! That makes sense!

I am still working on figuring out sampleName not in list problem.

Best Magic2077

Sent from my iPhone

On Oct 15, 2020, at 7:20 AM, iditbuch notifications@github.com wrote:

 Hi Magic2077,

A .snakefile directory preserves the data accumulated in the previous run trial that failed. So, obviously, it would be best to delete it before trying to run again. As for the sampleName, I recommend reading the tutorial pages carefully.

Best of luck

Idit

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

magic2077 commented 3 years ago

Hi Idit,

I run IGUIDE umi_alt pipleline but always got the following errors.

image

Erros logs:

Versioning: [1] run_set soft.version build.version

<0 rows> (or 0-length row.names) Error in mutate_impl(.data, dots) : Evaluation error: must be type logical, not double. Calls: %>% ... -> -> mutate.tbl_df -> mutate_impl Execution halted I saw you had the same problem previously. Could you please give me some suggestion? Thanks a lot! magic2077
iditbuch commented 3 years ago

Hi, I'm currently on vacation. Will check it at the end of next week. Idit

On Oct 20, 2020 11:15 PM, magic2077 notifications@github.com wrote:

Hi Idit,

I run IGUIDE umi_alt pipleline but always got the following errors.

[image]https://user-images.githubusercontent.com/72854293/96639018-e983e000-12d5-11eb-8c30-429a6c02bf39.png

Erros logs:

Versioning: [1] run_set soft.version build.version

<0 rows> (or 0-length row.names) Error in mutate_impl(.data, dots) : Evaluation error: must be type logical, not double. Calls: %>% ... -> -> mutate.tbl_df -> mutate_impl Execution halted I saw you had the same problem previously. Could you please give me some suggestion? Thanks a lot! magic2077 — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.
magic2077 commented 3 years ago

Hi Idit,

After carefully evaluatomg my sequencing data I found my read2 has very low quality. Only 90 reads contain the UMI sequences. I guess this is the reason for the failed run.

Enjoy your vacation!

Magic2077

Sent from my iPhone

On Oct 21, 2020, at 1:54 AM, iditbuch notifications@github.com wrote:

 Hi, I'm currently on vacation. Will check it at the end of next week. Idit

On Oct 20, 2020 11:15 PM, magic2077 notifications@github.com wrote:

Hi Idit,

I run IGUIDE umi_alt pipleline but always got the following errors.

[image]https://user-images.githubusercontent.com/72854293/96639018-e983e000-12d5-11eb-8c30-429a6c02bf39.png

Erros logs:

Versioning: [1] run_set soft.version build.version

<0 rows> (or 0-length row.names) Error in mutate_impl(.data, dots) : Evaluation error: must be type logical, not double. Calls: %>% ... -> -> mutate.tbl_df -> mutate_impl Execution halted I saw you had the same problem previously. Could you please give me some suggestion? Thanks a lot! magic2077 — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.
ShanSabri commented 3 years ago

@cnobles + @iditbuch -- I have the exact same issue. How would you suggest correcting? I'm on a 128Gb instance and clear out my .snakemake before reruns.

EDIT: I've created another issues thread.

cnobles commented 3 years ago

Just checking, @iditbuch, @magic2077, @ShanSabri, are these issues resolved or being handled in other threads?

iditbuch commented 3 years ago

resolved from my point of view. Thanks

ShanSabri commented 3 years ago

Resolved on my end - Thank you!