search

JPL-MGHG / JPL-MGHG-SDS

This is a generic repo for tracking of SDS tasks
0 stars 0 forks source link

Assess Resource Utilization for GHGF on Pleiades #29

Open ddalton-swe opened 5 months ago

ddalton-swe commented 5 months ago

Please report on the following

Memory Usage: Storage Usage: Compute Usage:

ddalton-swe commented 5 months ago

This will be used to determine what instance sizes to use for AWS-EC2

bkabyrne commented 5 months ago

Here is the memory used on Pleiades compute mode.

4x5 inversion (performed over one week)

forward model:

top - 13:12:24 up 20 days,  4:12,  1 user,  load average: 0.75, 0.75, 2.37
Tasks: 570 total,   2 running, 568 sleeping,   0 stopped,   0 zombie
%Cpu(s):  2.1 us,  0.4 sy,  0.0 ni, 97.5 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :   63955.2 total,  59826.4 free,   3036.2 used,   1092.6 buff/cache
MiB Swap:       0.0 total,      0.0 free,      0.0 used.  59657.3 avail Mem 

  PID     USER     PR   NI     VIRT     RES.     SHR   S  %CPU    %MEM     TIME+ COMMAND                                                                                
46185.   bbyrne1   20    0.   383164   157320   16920  R   96.4    0.2       1:13.04 fwd

Adjoint model:

top - 13:13:18 up 20 days,  4:13,  1 user,  load average: 0.90, 0.79, 2.29
Tasks: 570 total,   2 running, 568 sleeping,   0 stopped,   0 zombie
%Cpu(s):  2.5 us,  0.0 sy,  0.0 ni, 97.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  63955.2 total,  59784.6 free,   3054.5 used,   1116.1 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.   59638.4 avail Mem 

  PID     USER     PR   NI    VIRT     RES     SHR   S   %CPU   %MEM     TIME+ COMMAND                                                                                
46304    bbyrne1   20    0   408664   172412  16648  R   99.7    0.3       0:41.43 adj

Here is forward simulation at 2x2.5:

top - 13:43:48 up 1 day,  9:46,  1 user,  load average: 0.95, 1.71, 7.86
Tasks: 586 total,   2 running, 584 sleeping,   0 stopped,   0 zombie
%Cpu(s):  2.4 us,  0.0 sy,  0.0 ni, 97.5 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  63953.9 total,  58944.5 free,   2160.7 used,   2848.7 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  60892.6 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                                                                                                                                                                         
52532 bbyrne1   20   0  565180 341084  16924 R  96.7   0.5   7:57.22 fwd
gchang commented 4 months ago

Kevin: to get a better resource utilization metric, need to do a benchmark at a full year/two years. Low memory footprint looks suspicious.

ddalton-swe commented 3 months ago

This will need at least a 1-year run to confirm the footprint of GHGF