[common] 클라우드 리소스 모니터링

[tonykang22]

클라우드 리소스 모니터링

개요

• 현재 사용 중인 NCP server의 스펙
  • vCPU 32EA, Memory 128GB, [SSD]Disk 50GB

리소스 모니터링 파악

htop

• htop을 사용하여 서버의 리소스 사용량을 확인하려 했으나
  • 초당 사용량만 표기되며 과거의 데이터는 저장되지 않는 특성 때문에 적절하지 않다고 판단했다.
  • 특정 작업 수행 시, 변화하는 리소스 사용량을 파악하는 것이 목적이기 때문이었다.
• free도 마찬가지로 과거 메모리 사용량을 저장하는 기능이 없으므로 활용에 적절하지 않다고 판단했다.

GUI monitoring tool

• 가시적인 결과를 얻기 위해 GUI monitoring tool 도 고려했으나, 리소스 모니터링에만 활용하기에는 과하거나 적절하지 않다고 판단했다.
  • Zabbix, Nagios, Prometheus, Cockpit 등을 고려했었다.

Cockpit : PA - create sourcing results 가 수행될 때의 resource 모니터링 결과 : 개략적인 파악은 용이하나 구체적인 수치를 파악하기가 어렵다.

sysstat

• 해당 이슈의 목적을 가장 경제적으로 해결할 수 있는 패키지로 판단했다.
  • 과거 리소스 사용량 정보를 가지고 있으며
  • 수치적인 데이터를 제공한다.
• sysstat : 리눅스 성능 측정 도구 패키지이다.
  • sar : cpu, memory, network, disk io 등의 지표를 수치화하여 파일로 저장
  • iostat : disk io 지표 측정
  • mpstat : cpu 지표 측정
  • pidstat : 특정 프로세스의 CPU 및 스레드 정보 지표 측정
  • cifiostat : cifs 파일 시스템 지표 측정
• sar, pidstat을 사용하도록 한다.

sar 결과

총 메모리 사용량

• 01:00:00 : PA - create sourcing result 수행
• 01:37:19 : 리소스 사용량이 제대로 기록되는지 확인하기 위해 sysstat.service 재시작
• 모든 모듈 및 애플리케이션에 대해 통상 10.5G 의 메모리를 사용하는 것을 확인할 수 있다.

root@hwas-dev:~# sar -hr ALL
Linux 5.4.0-99-generic (hwas-dev)   05/02/23    _x86_64_    (32 CPU)

00:00:01    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
00:05:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.7G    364.0k     10.3G      1.7G     14.2M     27.9M     23.9M
00:15:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.7G    288.0k     10.3G      1.7G     14.1M     27.9M     23.7M
00:25:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.7G    244.0k     10.3G      1.7G     14.1M     27.9M     23.7M
00:35:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.7G    160.0k     10.3G      1.7G     14.1M     27.9M     23.7M
00:45:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.7G    348.0k     10.3G      1.7G     14.1M     27.9M     23.7M
00:55:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.7G     32.0k     10.3G      1.7G     14.1M     27.9M     23.6M
01:05:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.7G    524.0k     10.3G      1.7G     14.7M     27.9M     24.1M
01:15:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.1G     14.7G     11.7%     15.2G     13.7G    580.0k     10.3G      1.7G     14.7M     27.9M     24.3M
01:25:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.1G     14.8G     11.8%     15.2G     13.7G    352.0k     10.3G      1.7G     14.9M     28.5M     25.0M
01:35:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.1G     14.6G     11.6%     15.3G     13.6G    292.0k     10.3G      1.7G     14.9M     28.3M     24.5M
Average:        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.7G    318.4k     10.3G      1.7G     14.4M     28.0M     24.0M

01:37:19     LINUX RESTART  (32 CPU)

01:45:01    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
01:55:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.6G     11.6%     15.2G     13.6G    212.0k     10.3G      1.7G     14.7M     28.1M     24.4M
02:05:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.6G     11.6%     15.2G     13.6G    612.0k     10.3G      1.7G     14.8M     28.3M     24.5M
02:15:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    508.0k     10.3G      1.7G     14.8M     28.2M     24.5M
02:25:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G      1.1M     10.3G      1.7G     14.8M     28.2M     24.4M
02:35:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    560.0k     10.3G      1.7G     14.7M     28.2M     24.4M
02:45:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    772.0k     10.3G      1.7G     14.8M     28.2M     24.3M
02:55:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    420.0k     10.3G      1.7G     14.3M     28.2M     23.8M
03:05:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    220.0k     10.3G      1.7G     14.3M     28.3M     24.0M
03:15:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.8%     15.2G     13.6G    300.0k     10.3G      1.7G     14.3M     28.3M     24.0M
03:25:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    488.0k     10.3G      1.7G     14.2M     28.2M     23.8M
03:35:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    304.0k     10.3G      1.7G     14.2M     28.3M     23.9M
03:45:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    260.0k     10.3G      1.7G     14.2M     28.3M     23.9M
03:55:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    324.0k     10.3G      1.7G     14.2M     28.2M     23.8M
04:05:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    364.0k     10.3G      1.7G     14.3M     28.2M     23.9M
04:15:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    204.0k     10.3G      1.7G     14.2M     28.2M     23.9M
04:25:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    660.0k     10.3G      1.7G     14.2M     28.3M     24.0M
04:35:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G     84.0k     10.3G      1.7G     14.3M     28.3M     23.9M
04:45:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    328.0k     10.3G      1.7G     14.2M     28.2M     23.9M
04:55:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    208.0k     10.3G      1.7G     14.3M     28.2M     23.9M
05:05:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.8%     15.2G     13.6G    464.0k     10.3G      1.7G     14.2M     28.3M     23.8M
05:15:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G     44.0k     10.3G      1.7G     14.2M     28.2M     23.8M
05:25:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    164.0k     10.3G      1.7G     14.2M     28.2M     23.8M
05:35:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    248.0k     10.3G      1.7G     14.2M     28.2M     23.8M
05:45:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    268.0k     10.3G      1.7G     14.2M     28.2M     23.8M
05:55:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G     84.0k     10.3G      1.7G     14.2M     28.2M     23.8M
06:05:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    152.0k     10.3G      1.7G     14.2M     28.2M     23.9M
06:15:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    200.0k     10.3G      1.7G     14.2M     28.2M     23.8M
06:25:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    356.0k     10.3G      1.7G     14.3M     28.4M     23.9M
06:35:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G     40.0k     10.3G      1.7G     14.2M     28.3M     23.9M
06:45:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    124.0k     10.3G      1.7G     14.3M     28.2M     23.9M
06:55:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    300.0k     10.3G      1.7G     14.3M     28.4M     24.0M
07:05:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    536.0k     10.3G      1.7G     14.3M     28.4M     23.9M
07:15:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    300.0k     10.3G      1.7G     14.2M     28.3M     23.8M
07:25:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    420.0k     10.3G      1.7G     14.4M     28.4M     24.1M
07:35:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.7G     11.7%     15.2G     13.6G    348.0k     10.3G      1.7G     14.3M     28.4M     24.0M
07:45:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    256.0k     10.3G      1.7G     14.2M     28.4M     24.0M
07:55:01        95.0G    113.6G     10.5G      8.4%    556.2M     18.0G     14.8G     11.7%     15.2G     13.6G    156.0k     10.3G      1.7G     14.2M     28.4M     23.9M
08:05:01        94.9G    113.6G     10.5G      8.4%    556.2M     18.1G     14.8G     11.7%     15.3G     13.6G     53.5M     10.3G      1.7G     14.3M     28.4M     23.9M
08:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    172.0k     10.3G      1.7G     14.2M     28.3M     24.1M
08:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    176.0k     10.3G      1.7G     14.3M     28.4M     24.1M
08:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.6%     15.3G     13.6G    188.0k     10.3G      1.7G     14.3M     28.4M     24.2M
08:45:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    164.0k     10.3G      1.7G     14.2M     28.3M     24.1M
08:55:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    192.0k     10.3G      1.7G     14.3M     28.3M     24.1M
09:05:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    424.0k     10.3G      1.7G     14.3M     28.4M     24.1M
09:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    196.0k     10.3G      1.7G     14.3M     28.3M     24.1M
09:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    192.0k     10.3G      1.7G     14.2M     28.0M     23.9M
09:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    188.0k     10.3G      1.7G     14.1M     28.0M     23.8M
09:45:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    300.0k     10.3G      1.7G     14.2M     28.0M     23.9M
09:55:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G     56.0k     10.3G      1.7G     14.2M     28.0M     23.8M
10:05:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    184.0k     10.3G      1.7G     14.1M     28.0M     23.8M
10:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    292.0k     10.3G      1.7G     14.2M     28.0M     23.9M
10:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G     40.0k     10.3G      1.7G     14.1M     28.0M     23.8M
10:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    176.0k     10.3G      1.7G     14.1M     28.0M     23.8M
10:45:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G     44.0k     10.3G      1.7G     14.1M     28.0M     23.9M
10:55:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    180.0k     10.3G      1.7G     14.1M     28.0M     23.9M
11:05:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    164.0k     10.3G      1.7G     14.2M     28.2M     23.9M
11:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    212.0k     10.3G      1.7G     14.2M     28.2M     24.0M
11:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    192.0k     10.3G      1.7G     14.2M     28.2M     23.9M
11:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.7%     15.3G     13.6G    204.0k     10.3G      1.7G     14.2M     28.2M     24.0M

11:35:01    kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty  kbanonpg    kbslab  kbkstack   kbpgtbl  kbvmused
11:45:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.7%     15.3G     13.6G     56.0k     10.3G      1.7G     14.2M     28.2M     23.9M
11:55:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.7%     15.3G     13.6G    320.0k     10.3G      1.7G     14.2M     28.2M     23.8M
12:05:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.7%     15.3G     13.6G    160.0k     10.3G      1.7G     14.2M     28.2M     23.9M
12:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.7%     15.3G     13.6G     44.0k     10.3G      1.7G     14.1M     28.2M     23.9M
12:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G     44.0k     10.3G      1.7G     14.2M     28.3M     24.0M
12:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.7%     15.3G     13.6G     36.0k     10.3G      1.7G     14.1M     28.2M     23.9M
12:45:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.8%     15.3G     13.6G    164.0k     10.3G      1.7G     14.2M     28.3M     24.0M
12:55:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.7%     15.3G     13.6G     64.0k     10.3G      1.7G     14.1M     28.2M     23.9M
13:05:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.8G     11.7%     15.3G     13.6G    188.0k     10.3G      1.7G     14.2M     28.2M     23.9M
13:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    172.0k     10.3G      1.7G     14.2M     28.2M     23.8M
13:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.6G    524.0k     10.3G      1.7G     14.1M     28.2M     23.9M
13:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    336.0k     10.3G      1.7G     14.2M     28.2M     23.9M
13:45:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    356.0k     10.3G      1.7G     14.2M     28.2M     23.9M
13:55:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.6G     11.6%     15.3G     13.7G    188.0k     10.3G      1.7G     14.2M     28.2M     23.9M
14:05:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    184.0k     10.3G      1.7G     14.2M     28.2M     23.9M
14:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G     60.0k     10.3G      1.7G     14.2M     28.2M     23.9M
14:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G     68.0k     10.3G      1.7G     14.2M     28.2M     23.9M
14:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G     44.0k     10.3G      1.7G     14.2M     28.2M     23.9M
14:45:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G     40.0k     10.3G      1.7G     14.2M     28.2M     23.9M
14:55:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    188.0k     10.3G      1.7G     14.2M     28.2M     23.9M
15:05:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    300.0k     10.3G      1.7G     14.2M     28.2M     24.0M
15:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    172.0k     10.3G      1.7G     14.2M     28.2M     23.9M
15:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G     44.0k     10.3G      1.7G     14.2M     28.2M     24.0M
15:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G     24.0k     10.3G      1.7G     14.1M     28.2M     23.9M
15:45:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G     88.0k     10.3G      1.7G     14.2M     28.2M     23.9M
15:55:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    164.0k     10.3G      1.7G     14.2M     28.2M     23.9M
16:05:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    212.0k     10.3G      1.7G     14.2M     28.2M     24.0M
16:15:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    176.0k     10.3G      1.7G     14.2M     28.2M     23.9M
16:25:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.7G     11.7%     15.3G     13.7G    404.0k     10.3G      1.7G     14.2M     28.2M     23.9M
16:35:01        94.9G    113.6G     10.5G      8.4%    569.6M     18.1G     14.2G     11.3%     15.3G     13.6G    388.0k     10.3G      1.7G     13.7M     27.8M     23.5M
16:45:01        94.9G    113.6G     10.5G      8.4%    569.7M     18.1G     14.2G     11.3%     15.3G     13.6G    284.0k     10.3G      1.7G     13.6M     27.8M     23.3M
16:55:01        94.9G    113.6G     10.5G      8.4%    569.7M     18.1G     14.2G     11.3%     15.3G     13.6G     28.0k     10.3G      1.7G     13.6M     27.8M     23.3M
17:05:01        94.9G    113.6G     10.5G      8.4%    569.7M     18.1G     14.2G     11.3%     15.3G     13.6G    180.0k     10.3G      1.7G     13.7M     27.8M     23.4M
17:15:01        94.4G    113.6G     10.5G      8.4%    636.5M     18.1G     14.2G     11.3%     15.4G     13.7G    188.0k     10.3G      2.1G     13.7M     27.8M     23.3M
17:25:01        94.4G    113.6G     10.5G      8.4%    636.5M     18.1G     14.3G     11.3%     15.4G     13.6G    184.0k     10.3G      2.1G     13.7M     27.8M     23.4M
17:35:01        94.4G    113.6G     10.5G      8.4%    636.5M     18.1G     14.2G     11.3%     15.4G     13.6G    172.0k     10.3G      2.1G     13.7M     27.8M     23.4M
Average:        94.9G    113.6G     10.5G      8.4%    566.4M     18.1G     14.7G     11.7%     15.3G     13.6G    814.8k     10.3G      1.7G     14.2M     28.2M     23.9M

pidstat

OM 사용량

• 10초 간격으로 40회 측정
  • OM : Schedule job이 5 ~ 6분 마다 있기 때문이다.

• CPU 사용량 : 0.18%

root@hwas-dev:/# pidstat -u -p 4159333 10 40
Linux 5.4.0-99-generic (hwas-dev)   05/02/23    _x86_64_    (32 CPU)

17:33:30      UID       PID    %usr %system  %guest   %wait    %CPU   CPU  Command
17:33:40        0   4159333    0.10    0.10    0.00    0.00    0.20    10  java
17:33:50        0   4159333    0.00    0.20    0.00    0.00    0.20    10  java
17:34:00        0   4159333    0.10    0.10    0.00    0.00    0.20    10  java
17:34:10        0   4159333    0.10    0.10    0.00    0.00    0.20    10  java
17:34:20        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:34:30        0   4159333    0.10    0.00    0.00    0.00    0.10    10  java
17:34:40        0   4159333    0.10    0.10    0.00    0.00    0.20    10  java
17:34:50        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:35:00        0   4159333    0.20    0.10    0.00    0.00    0.30    10  java
17:35:10        0   4159333    0.00    0.10    0.00    0.00    0.10    10  java
17:35:20        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:35:30        0   4159333    0.10    0.10    0.00    0.00    0.20    10  java
17:35:40        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:35:50        0   4159333    0.10    0.00    0.00    0.00    0.10    10  java
17:36:00        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:36:10        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:36:20        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:36:30        0   4159333    0.00    0.20    0.00    0.00    0.20    10  java
17:36:40        0   4159333    0.10    0.10    0.00    0.00    0.20    10  java
17:36:50        0   4159333    0.10    0.00    0.00    0.00    0.10    10  java
17:37:00        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:37:10        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:37:20        0   4159333    0.10    0.00    0.00    0.00    0.10    10  java
17:37:30        0   4159333    0.10    0.20    0.00    0.00    0.30    10  java
17:37:40        0   4159333    0.10    0.10    0.00    0.00    0.20    10  java
17:37:50        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:38:00        0   4159333    0.10    0.00    0.00    0.00    0.10    10  java
17:38:10        0   4159333    0.00    0.20    0.00    0.00    0.20    10  java
17:38:20        0   4159333    0.10    0.10    0.00    0.00    0.20    10  java
17:38:30        0   4159333    0.00    0.10    0.00    0.00    0.10    10  java
17:38:40        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:38:50        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:39:00        0   4159333    0.10    0.00    0.00    0.00    0.10    10  java
17:39:10        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:39:20        0   4159333    0.00    0.20    0.00    0.00    0.20    10  java
17:39:30        0   4159333    0.10    0.20    0.00    0.00    0.30    10  java
17:39:40        0   4159333    0.10    0.00    0.00    0.00    0.10    10  java
17:39:50        0   4159333    0.20    0.00    0.00    0.00    0.20    10  java
17:40:00        0   4159333    0.20    0.10    0.00    0.00    0.30    10  java
17:40:10        0   4159333    0.00    0.10    0.00    0.00    0.10    10  java
Average:        0   4159333    0.12    0.06    0.00    0.00    0.18     -  java

• Memory 사용량 : 2.04%

root@hwas-dev:/# pidstat -rh -p 4159333 10 40
Linux 5.4.0-99-generic (hwas-dev)   05/02/23    _x86_64_    (32 CPU)

# Time        UID       PID  minflt/s  majflt/s     VSZ     RSS   %MEM  Command
17:49:00        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:49:10        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:49:20        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:49:30        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:49:40        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:49:50        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:50:00        0   4159333      3.00      0.00 41292552 2687984   2.04  java
17:50:10        0   4159333      0.10      0.00 41292552 2687984   2.04  java
17:50:20        0   4159333      0.10      0.00 41292552 2687984   2.04  java
17:50:30        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:50:40        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:50:50        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:51:00        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:51:10        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:51:20        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:51:30        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:51:40        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:51:50        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:52:00        0   4159333      3.20      0.00 41292552 2687984   2.04  java
17:52:10        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:52:20        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:52:30        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:52:40        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:52:50        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:53:00        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:53:10        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:53:20        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:53:30        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:53:40        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:53:50        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:54:00        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:54:10        0   4159333      3.10      0.00 41292552 2687984   2.04  java
17:54:20        0   4159333      3.40      0.00 41292552 2687984   2.04  java
17:54:30        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:54:40        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:54:50        0   4159333      0.20      0.00 41292552 2687984   2.04  java
17:55:00        0   4159333      3.00      0.00 41292552 2687984   2.04  java
17:55:10        0   4159333      0.00      0.00 41292552 2687984   2.04  java
17:55:20        0   4159333      3.20      0.00 41292552 2687984   2.04  java
17:55:30        0   4159333      0.10      0.00 41292552 2687984   2.04  java

PA, PM, CS 사용량

• 동일한 방식으로 측정 : 10초 간격, 40회
  • CSM : cpu 0.47% / mem 1.64%
  • OM : cpu 0.18% / mem 2.04%
  • PM : cpu 0.16% / mem 2.11%
  • Sync 수행 시 [트리거 후 1초 단위, 60초 기록] : cpu 2.12% / mem 0.97%
  • PA : cpu 0.16% / mem 2.31%
  • create 배치(select-score & sourcing-result) [트리거 후 1초 단위, 60초 측정] 수행 시 : cpu 1.31% / mem 0.93%

• cpu usage

Average:      UID       PID    %usr %system  %guest   %wait    %CPU   CPU  Command

// cs-manager
Average:        0   3382759    0.33    0.14    0.00    0.00    0.47     -  java

// order-manager
Average:        0   4159333    0.13    0.05    0.00    0.00    0.18     -  java

// product-manager
Average:        0    848312    0.16    0.01    0.00    0.00    0.16     -  java

// product-analyzer
Average:        0   1205847    0.15    0.01    0.00    0.00    0.16     -  java

• memory usage

Average:      UID       PID  minflt/s  majflt/s     VSZ     RSS   %MEM  Command
Average:        0    848312      0.23      0.00 41360144 2784840   2.11  java
Average:        0   1205847      0.11      0.00 44055360 3044756   2.31  java
Average:        0   3382759      0.27      0.00 40227532 2166132   1.64  java
Average:        0   4159333      0.57      0.00 41292552 2687984   2.04  java

Disk 사용량 파악

du

• Disk Usage

root@hwas-dev:/# du -h --max-depth=1 | sort -rh
24G .
7.8G    ./root
6.6G    ./tmp
4.9G    ./var
3.0G    ./usr
554M    ./snap
383M    ./home1
122M    ./opt
101M    ./boot
7.3M    ./etc
1.5M    ./Users
1.2M    ./run
48K ./.gradle
16K ./lost+found
8.0K    ./media
4.0K    ./srv
4.0K    ./mnt
4.0K    ./home
0   ./sys
0   ./proc
0   ./dev

[tonykang22]

결론

• 4 개의 모듈의 cpu, ram 사용량은 많아야 기존 서버의 10% 내외로 예측된다.
  • vCPU 3개, 10.5GB 정도 사용될 것으로 예측된다.
• vCPU 4개, 16GB도 운영하는데 문제가 없을 것으로 판단된다.
  • 여력이 된다면 조금 여유로운 vCPU 8개, 32GB까지도 합리적인 선택으로 판단된다.