logging with timestamp - Githubissues

odissei-lifecourse / life-sequencing-dutch

MIT License

0 stars 0 forks source link

logging with timestamp #29

Open f-hafner opened 4 months ago

f-hafner commented 4 months ago

It would be nice to have the logs with a time stamp. #SBATCH -o /path/to/file/script-$(date +%Y-%m-%d_%H-%M-%S).txt does not work.

Some ideas

use python logging to write to a (separate?) log file with a time stamp in the name
keep a separate database with log file names and respective time stamps? overkill?

f-hafner commented 3 months ago

also: separate loggers, turn off logger from other modules (such as matplotlib in the evaluation). https://stackoverflow.com/questions/65728037/matplotlib-debug-turn-off-when-python-debug-is-on-to-debug-rest-of-program

f-hafner commented 2 months ago

using the python logger instead of the slurm stderr/stdout would also help to automatically write logs to different locations based on whether the script is run on which system (snellius or OSSC): first, detect the system in the bash script, and then define the log file dir based on that.