search

4dn-dcic / tibanna

Tibanna helps you run your genomic pipelines on Amazon cloud (AWS). It is used by the 4DN DCIC (4D Nucleome Data Coordination and Integration Center) to process data. Tibanna supports CWL/WDL (w/ docker), Snakemake (w/ conda) and custom Docker/shell command.
MIT License
70 stars 28 forks source link

Log Differences between 0.18.3 and 1.0+ #344

Closed klai5 closed 3 years ago

klai5 commented 3 years ago

Hello,

The old logs in v0.18.3 let me see all the files located on the server (e.g everything under /data1/snakemake). Is this missing from the new version?

Thanks!

SooLee commented 3 years ago

@klai5 That may be the case indeed. It was intended to produce a cleaner log, but looks like it's missing some info that could be useful. Sorry about the trouble and I will try to add it back in the next couple of days. Thanks for the ticket!

klai5 commented 3 years ago

Thanks! Yeah, sometimes I would like to see what's on the instance during errors (e.g if it didn't download S3 files to the correct location) without having to ls -R on /data1/snakemake for every rule. Appreciate the help!

SooLee commented 3 years ago

@klai5 Sorry for the delay. The log should include the directory contents from 1.4.1 now.