Kinggerm / GetOrganelle

Organelle Genome Assembly Toolkit (Chloroplast/Mitocondrial/ITS)
GNU General Public License v3.0
267 stars 51 forks source link

get_organelle_from_assembly.py: no slimmed_assembly_graph found #48

Open LucaD91 opened 4 years ago

LucaD91 commented 4 years ago

hi everyone, i'm trying to evaluate the mithocondrial DNA of my sample (fusarium sp.); i performed the assembly with flye tool on galaxy.eu and use the fastg file produced by the tool. i always get this error and i can't go on, can you help me? what i'm doing wrong?

HERE THE LOG.TXT FILE: GetOrganelle v1.7.1a

get_organelle_from_assembly.py isolates organelle genomes from assembly graph. Find updates in https://github.com/Kinggerm/GetOrganelle and see README.md for more information.

Python 3.8.2 (default, Mar 13 2020, 10:14:16) [GCC 9.3.0] PYTHON LIBS: GetOrganelleLib 1.7.1a; numpy 1.17.4; sympy 1.5.1; scipy 1.3.3 DEPENDENCIES: Blast 2.9.0 LABEL DB: fungus_mt 0.0.0 WORKING DIR: /home/luca/GetOrganelle get_organelle_from_assembly.py -F fungus_mt -g seitu.fastg -o risultati/mitoF31

2020-08-07 09:00:50,485 - INFO: Processing assembly graph ... 2020-08-07 09:00:51,011 - INFO: Processing assembly graph finished.

2020-08-07 09:00:51,011 - INFO: Slimming assembly graph ... 2020-08-07 09:00:51,053 - INFO: Slimming risultati/mitoF31/initial_assembly_graph.fastg finished! 2020-08-07 09:00:51,053 - ERROR: Traceback (most recent call last): File "get_organelle_from_assembly.py", line 988, in main if os.path.getsize(slimmed_graph_file) == 0: File "/usr/lib/python3.8/genericpath.py", line 50, in getsize return os.stat(filename).st_size FileNotFoundError: [Errno 2] No such file or directory: 'risultati/mitoF31/slimmed_assembly_graph.fastg'

Total cost 3.71 s Please email jinjianjun@mail.kib.ac.cn or jianjun.jin@columbia.edu if you find bugs! Please provide me with the get_org.log.txt file!

THANK'S EVERYONE

Kinggerm commented 3 years ago

Apologize for the late reply. Could you add --verbose to you command? Have you got a slim.log.txt file in the output directory?

imogen-foote commented 9 months ago

Did this ever get resolved? I am having a similar issue. It does not say that slimming failed so I'm having problems troubleshooting, but it doesn't seem to be saving the slimmed assembly graph so the next step can't find it (I think?).

the slimmed_assembly_graph.slim.log.txt log only contains 2023-12-14 21:39:00,397 - INFO: Slimming file 1/1: /nesi/nobackup/vuw03922/projects/AntipodeanAlbatross/data/Chapter3/mitogenome/blue-45G_q8_h50/initial_assembly_graph.gfa

and the get_org.log.txt contains

GetOrganelle v1.7.7.0

get_organelle_from_assembly.py isolates organelle genomes from assembly graph.
Find updates in https://github.com/Kinggerm/GetOrganelle and see README.md for more information.

Python 3.9.18 (main, Sep 11 2023, 13:41:44)  [GCC 11.2.0]
PLATFORM: Linux wbn069 3.10.0-693.2.2.el7.x86_64 #1 SMP Tue Sep 12 22:26:13 UTC 2017 x86_64 x86_64
PYTHON LIBS: GetOrganelleLib 1.7.7.0; numpy 1.26.2; sympy 1.12; scipy 1.11.4
DEPENDENCIES: Blast 2.12.0; Bandage 0.8.1
GETORG_PATH=/home/footeim/.GetOrganelle
LABEL DB: animal_mt 0.0.1
WORKING DIR: /scale_wlg_nobackup/filesets/nobackup/vuw03922/scripts/Chapter3/extract_mitogenome
/nesi/project/vuw03922/bandage/bin/get_organelle_from_assembly.py -F animal_mt -g /nesi/nobackup/vuw03922/projects/AntipodeanAlbatross/data/Chapter3/assemblies/flye/1_raw/blue-45G_q8_h50/assembly_graph.gfa -o /nesi/nobackup/vuw03922/projects/AntipodeanAlbatross/data/Chapter3/mitogenome/blue-45G_q8_h50 -t 10 --overwrite --verbose

2023-12-14 21:38:54,334 - INFO: Processing assembly graph ...
2023-12-14 21:38:57,246 - INFO: Processing assembly graph finished.

2023-12-14 21:38:57,247 - INFO: Slimming assembly graph ...
2023-12-14 21:38:57,251 - INFO: /scale_wlg_persistent/filesets/project/vuw03922/bandage/bin/slim_graph.py -t 10 /nesi/nobackup/vuw03922/projects/AntipodeanAlbatross/data/Chapter3/mitogenome/blue-45G_q8_h50/initial_assembly_graph.gfa --out-base /nesi/nobackup/vuw03922/projects/AntipodeanAlbatross/data/Chapter3/mitogenome/blue-45G_q8_h50/slimmed_assembly_graph  --include-priority /home/footeim/.GetOrganelle/LabelDatabase/animal_mt.fasta --log --wrapper --verbose  --max-slim-extending-len 12500 
2023-12-14 21:39:02,390 - INFO: 2023-12-14 21:39:00,397 - INFO: Slimming file 1/1: /nesi/nobackup/vuw03922/projects/AntipodeanAlbatross/data/Chapter3/mitogenome/blue-45G_q8_h50/initial_assembly_graph.gfa

2023-12-14 21:39:02,390 - INFO: Slimming /nesi/nobackup/vuw03922/projects/AntipodeanAlbatross/data/Chapter3/mitogenome/blue-45G_q8_h50/initial_assembly_graph.gfa finished!
2023-12-14 21:39:02,390 - ERROR: 
Traceback (most recent call last):
  File "/nesi/project/vuw03922/bandage/bin/get_organelle_from_assembly.py", line 1021, in main
    if os.path.getsize(slimmed_graph_file) == 0:
  File "/nesi/project/vuw03922/bandage/lib/python3.9/genericpath.py", line 50, in getsize
    return os.stat(filename).st_size
FileNotFoundError: [Errno 2] No such file or directory: '/nesi/nobackup/vuw03922/projects/AntipodeanAlbatross/data/Chapter3/mitogenome/blue-45G_q8_h50/slimmed_assembly_graph.gfa'

Total cost 26.27 s
JianjunJin commented 9 months ago

Thanks for reaching out!

To better help you, could you add --verbose to your command? Have you got a slim.log.txt file in the output directory?

imogen-foote commented 9 months ago

Thanks @JianjunJin. Sorry I forgot to mention I tried it with --verbose in the command as per the previous suggestion and the above output is what that gave me. There is no slim.log.txt file in the output directory, only the get_org.log.txt and slimmed_assembly_graph.slim.log.txt that I included above.

alistairhockey commented 9 months ago

Would also appreciate this being solved. Having the exact same issue.

JianjunJin commented 9 months ago

Hi all, I cannot reproduce it from my side. But I would like to help.

Could you please test if slim_graph.py -h and blastn -h will be running correctly in your environment?

alistairhockey commented 9 months ago

Hi,

I think I solved the problem on my end: I had py scripts in my bin directory and in my conda environment. I removed the former and reinstalled getorganelle in the env and it worked.

Cheers, Alistair


From: JianJun Jin @.> Sent: Wednesday, December 20, 2023 9:39:53 AM To: Kinggerm/GetOrganelle @.> Cc: Alistair Hockey @.>; Comment @.> Subject: Re: [Kinggerm/GetOrganelle] get_organelle_from_assembly.py: no slimmed_assembly_graph found (#48)

Hi all, I cannot reproduce it from my side. But I would like to help.

Could you please test if slim_graph.py -h and blastn -h will be running correctly in your environment?

— Reply to this email directly, view it on GitHubhttps://github.com/Kinggerm/GetOrganelle/issues/48#issuecomment-1863707590, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A3SQS6HXTYDCZGSTXIKJOG3YKI6WTAVCNFSM4PXLWBWKU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBWGM3TANZVHEYA. You are receiving this because you commented.Message ID: @.***>

JianjunJin commented 9 months ago

@alistairhockey Glad that you solved it! And thanks for letting me know.

imogen-foote commented 9 months ago

Hi @alistairhockey, thanks for the info. Would you mind giving me a little more specific detail on how you solved this? I'm relatively new to all this, so can't quite follow your directions above. I have the py scripts in my_env/bin/, but I'm not sure where else you meant you had them that you removed them from?

Thank you!! Much appreciated

alistairhockey commented 9 months ago

Hi @imogen-foote, I'd sugest the following:

  1. Uninstall GetOrganelle and all .py scripts associated (e.g. get_organelle_from_reads.py).
  2. Create a conda environment with GetOrganelle installed (conda create env name -c bioconda GetOrganelle)
  3. Activate the conda environment.
  4. Test it out!

I found that having old GetOrganelle .py scripts in my /bin directory was causing the issue. Best to clean everything up and have the program running in a self-contained environment.

Cheers.

imogen-foote commented 9 months ago

Thanks so much @alistairhockey. I think I was initially a bit confused because I didn't have GetOrganelles installed anywhere else, other than my conda environment. Anyway I also found a solution, which was to remove the conda environment and create it fresh, using mamba create (I got a bunch of dependency issues using conda but mamba seems to solve them) and installing both bandage and GetOrganelles at the time of creation (previously I created it with bandage and installed getorganelles after).