Closed Amjadhpc closed 11 months ago
I am also having the same issue and exceeding my disc quota due to the number of temp files generated on an hpc system
@Amjadhpc @sophieleech I will test this and update you on why the temp files are not being removed.
Hi @raphenya any update on this?
@Amjadhpc @sophieleech The temporary files are removed for each input file at the end of a run. So, having lots of input files will cause problems as the prodigal step is slow.
I also had this issue and solved it by dividing the multi-fasta assembly files into smaller chunks of 50k sequences each. Any tool will do the job, I used seqkit split2 (-s 50000).
Hello I am using rgi-main and passing --clean option with num-threads of 64 and --split-prodigal-jobs on a gpfs storage
This is causing lots of tmp files being generated and the inodes on gpfs strorage are running out.
My question is does the clean option only works after the run is completed and there is not an option to remove tmp files in middle of runs.
Also is there an option that can limit number of tmp files generated ?
Thanks