faircloth-lab / phyluce

software for UCE (and general) phylogenomics
http://phyluce.readthedocs.org/
Other
80 stars 49 forks source link

Phyluce spaces assembly error? #314

Closed louisfnastasi closed 1 year ago

louisfnastasi commented 1 year ago

I have a feeling this will be an easy solve but I'm having an issue with parsing the config file for assembly with spades. The error I receive (see bottom of post) implies that the samples section can't be located, yet it is certainly there and I've verified that there are no hidden characters, etc. that could impact parsing. Any advice on solving this?

My script for assembly: source activate phyluce-1.7.2 cd /storage/group/hmh19/default/UCEs_working/ phyluce_assembly_assemblo_spades \ --conf assembly-conf1.conf \ --output spades-assemblies \ --cores 32

My config file titled assembly-conf1.conf (in the proper directory): [samples] Aylax_minor_CYNHG0061:/storage/group/hmh19/default/UCEs_working/PSUC-team-clean-fastq/Aylax_minor_CYNHG0061/split-adapter-quality-trimmed Synophromorpha_rubi_CKDPSUC65:/storage/group/hmh19/default/UCEs_working/PSUC-team-clean-fastq/Synophromorpha_rubi_CKDPSUC65/split-adapter-quality-trimmed

Error output from our cluster: 2023-09-09 14:24:41,849 - phyluce_assembly_assemblo_spades - INFO - =========== Starting phyluce_assembly_assemblo_spades =========== 2023-09-09 14:24:41,849 - phyluce_assembly_assemblo_spades - INFO - Version: 1.7.2 2023-09-09 14:24:41,849 - phyluce_assembly_assemblo_spades - INFO - Commit: None 2023-09-09 14:24:41,849 - phyluce_assembly_assemblo_spades - INFO - Argument --config: /storage/group/hmh19/default/UCEs_working/assembly-conf1 2023-09-09 14:24:41,849 - phyluce_assembly_assemblo_spades - INFO - Argument --cores: 32 2023-09-09 14:24:41,850 - phyluce_assembly_assemblo_spades - INFO - Argument --dir: None 2023-09-09 14:24:41,850 - phyluce_assembly_assemblo_spades - INFO - Argument --log_path: None 2023-09-09 14:24:41,850 - phyluce_assembly_assemblo_spades - INFO - Argument --memory: 8 2023-09-09 14:24:41,850 - phyluce_assembly_assemblo_spades - INFO - Argument --no_clean: False 2023-09-09 14:24:41,850 - phyluce_assembly_assemblo_spades - INFO - Argument --output: /storage/group/hmh19/default/UCEs_working/spades-assemblies 2023-09-09 14:24:41,850 - phyluce_assembly_assemblo_spades - INFO - Argument --subfolder:  2023-09-09 14:24:41,850 - phyluce_assembly_assemblo_spades - INFO - Argument --verbosity: INFO 2023-09-09 14:24:41,850 - phyluce_assembly_assemblo_spades - INFO - Getting input filenames and creating output directories Traceback (most recent call last): File "/storage/home/lfn5093/.conda/envs/phyluce-1.7.2/lib/python3.6/configparser.py", line 846, in items d.update(self._sections[section]) KeyError: 'samples'

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/storage/home/lfn5093/.conda/envs/phyluce-1.7.2/bin/phyluce_assembly_assemblo_spades", line 231, in main() File "/storage/home/lfn5093/.conda/envs/phyluce-1.7.2/bin/phyluce_assembly_assemblo_spades", line 184, in main input_data = get_input_data(args.config, args.dir) File "/storage/home/lfn5093/.conda/envs/phyluce-1.7.2/lib/python3.6/site-packages/phyluce/raw_reads.py", line 165, in get_input_data groups = conf.items("samples") File "/storage/home/lfn5093/.conda/envs/phyluce-1.7.2/lib/python3.6/configparser.py", line 849, in items raise NoSectionError(section) configparser.NoSectionError: No section: 'samples'

Thanks in advance for any help!

brantfaircloth commented 1 year ago

This still looks like some sort of issue with paths. Can you run this interactively (e.g. rather than using a script) so you can make sure things are operating as you expect? It could also be some weirdness in the structure of the config file - potentially a line ending problem, although it's very hard to say.

louisfnastasi commented 1 year ago

Interesting - I ran the exact same commands manually in the terminal and it worked and provided a typical output (although a couple failed but nothing unusual otherwise). Any ideas as to why?

brantfaircloth commented 1 year ago

Honestly not sure - maybe the script is not doing something correctly?