search

con / duct

A helper to run a command, capture stdout/stderr and details about running
MIT License
1 stars 1 forks source link

report "Memory Peak Usage" in absolute value not in "%" #63

Closed yarikoptic closed 1 week ago

yarikoptic commented 3 weeks ago 
...
Command: singularity run -B /mnt/DATA/data/yoh/1076_spacetop:/mnt/DATA/data/yoh/1076_spacetop:ro -B /mnt/DATA/data/yoh/1076_spacetop/derivatives:/mnt/DATA/data/yoh/1076_spacetop/derivatives:rw -B /mnt/DATA/data/yoh/1076_spacetop/scratch:/mnt/DATA/data/yoh/1076_spacetop/scratch:rw -B /mnt/DATA/data/yoh/1076_spacetop/../dsst-defacing-pipeline/src:/opt/dsst-defacing-pipeline:ro --scratch /mnt/DATA/data/yoh/1076_spacetop/scratch --pwd /mnt/DATA/data/yoh/1076_spacetop --net --network none ../dsst-defacing-pipeline/dsst-defacing-pipeline-0.0.5.sif -p 0001 -s 01 -- . derivatives/dss-defacing-0.0.5-1
Log files location: .duct/logs/2024.06.09T10.58.56-1623046_
Wall Clock Time: 2884.758 sec
Memory Peak Usage: 0.0%
CPU Peak Usage: 303.0%
[INFO   ] == Command exit (modification check follows) =====

and the same 0 was in _stats.json:

yoh@typhon:/mnt/DATA/data/yoh/1076_spacetop$ jq -r '."totals".pmem' .duct/logs/2024.06.09T10.58.56-1623046_usage.json | uniq
0

so there is smth wrong about it overall but also it is kinda not useful -- we need to know absolute values. Would not hurt reporting both rss (resident memory -- actually what was in the RAM) and vsz (virtual address space allocated, might be less useful but who knows). And may be then % of rss in relation to memory_total

asmacdo commented 2 weeks ago

Absolute mem stats will be much more useful +1