[Disk] VNPT counter doesn't have enough storage for both FPT and VNPT

[anhnongdan]

As #7 and #9 and #12

http://pm.sbddigital.com/issues/384

Solution from mr. Vu:

Vấn đề: disk gần như ko đủ chạy cho logs 2 nhà mạng: VNPT & FPT. Riêng VNPT lại có 2 vùng là logs raw & logs từng CDN khách hàng Fix: cho quét vào xóa file cũ hơn 5 phút

for dir in /data/cdn /data/logs /data/logs_fpt;do
find $dir -type f -mmin +300 -exec rm -rf {} \;
done
rm -f $lock

[anhnongdan]

Continue monitoring: #11

[anhnongdan]

Almost of logs come from VNPT:

When 4001 disk is 100% full: (day time log)

[root@VNPT-HCM-BIMAX-01 data]# find /data/logs/2017/08/21/ -type f -printf '%T+ %p\n' | sort | head -n 1
2017-08-21+07:55:09.9980066790 /data/logs/2017/08/21/track-2017-08-21-07-55-0.log
[root@VNPT-HCM-BIMAX-01 data]# find /data/logs/2017/08/21/ -type f -printf '%T+ %p\n' | sort | tail -n 1
2017-08-21+21:44:50.8603703310 /data/logs/2017/08/21/track-2017-08-21-19-45-2.log
[root@VNPT-HCM-BIMAX-01 data]# find /data/cdn -type f -printf '%T+ %p\n' | sort | tail -n 1
2017-08-21+19:19:16.2208090490 /data/cdn/live.thvli.vn/2017/08/21/live.thvli.vn_2017_08_21_19_18
[root@VNPT-HCM-BIMAX-01 data]# find /data/cdn -type f -printf '%T+ %p\n' | sort | head -n 1
2017-08-21+07:55:23.0080802160 /data/cdn/media.nguoiduatin.vn/2017/08/21/media.nguoiduatin.vn_2017_08_21_07_55

[anhnongdan]

VNPT 4001 might not over come traffic peak in evening:

[root@VNPT-HCM-BIMAX-01 ~]# find /data/logs/2017/08 -type f -printf '%T+ %p\n' | sort | head -n 1
2017-08-22+05:53:09.9984740620 /data/logs/2017/08/22/track-2017-08-22-05-53-0.log
[root@VNPT-HCM-BIMAX-01 ~]# find /data/logs/2017/08 -type f -printf '%T+ %p\n' | sort | tail -n 1
2017-08-22+15:53:33.3098541300 /data/logs/2017/08/22/track-2017-08-22-15-53-3.log
[root@VNPT-HCM-BIMAX-01 ~]# find /data/cdns -type f -printf '%T+ %p\n' | sort | tail -n 1
find: ‘/data/cdns’: No such file or directory
[root@VNPT-HCM-BIMAX-01 ~]# find /data/cdn -type f -printf '%T+ %p\n' | sort | tail -n 1
2017-08-22+15:53:45.3609162070 /data/cdn/vtvgolive-appobj.b5695cde.cdnviet.com/2017/08/22/vtvgolive-appobj.b5695cde.cdnviet.com_2017_08_22_15_53
[root@VNPT-HCM-BIMAX-01 ~]#
[root@VNPT-HCM-BIMAX-01 ~]# find /data/cdn -type f -printf '%T+ %p\n' | sort | head -n 1
2017-08-22+10:53:01.9331444780 /data/cdn/pancake.apple.com/2017/08/22/pancake.apple.com_2017_08_22_10_52
[root@VNPT-HCM-BIMAX-01 ~]# df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/sda4       108G   48G   61G  45% /
devtmpfs         48G     0   48G   0% /dev
tmpfs            48G     0   48G   0% /dev/shm
tmpfs            48G  4.0G   44G   9% /run
tmpfs            48G     0   48G   0% /sys/fs/cgroup
/dev/sda2       494M  145M  350M  30% /boot
/dev/sda1       200M  9.5M  191M   5% /boot/efi
/dev/sdb1       879G  824G   12G  99% /data
tmpfs           9.5G     0  9.5G   0% /run/user/0

decrease /data/logs: 540 mins /data/cdn: 270 mins

[anhnongdan]

Can't make it to VN-Indo SEAGAME football match. Bring down further to logs 120 mins and cdn 60 mins.