anhnongdan / cBIMAX

Official source code for cBIMAX - the analytics system for CDN
0 stars 0 forks source link

[Archive] K+ CDN calculation's differences on 2 servers #42

Closed anhnongdan closed 7 years ago

anhnongdan commented 7 years ago

All CDNs dashboard (Total: 2,933 sessions, 1,530,371 hits, 603.24 G tranffered overall)
All CDNs dashboard (Total: 3,826 sessions, 1,493,011 hits, 570.71 G tranffered overall)

ott-vnpt.kplus.vn | 1,443 | 554,483 | 213.28G ott-vnpt.kplus.vn | 1,764 | 531,663 | 203.98 G

kplusupstream.local | 1,211 | 771,707 | 355.62 G kplusupstream.local | 1,635 | 741,141 | 335.97 G

ott-fpt.kplus.vn | 165 | 40,055 | 8.86 G ott-fpt.kplus.vn | 239 | 42,487 | 8.5 G

anhnongdan commented 7 years ago

Compare DB:

MariaDB [pw2]> select count(*) from piwik_log_visit;
+----------+
| count(*) |
+----------+
|    21809 |
+----------+
1 row in set (0.01 sec)

MariaDB [pw2]> select min(visit_last_action_time) from piwik_log_visit;
+-----------------------------+
| min(visit_last_action_time) |
+-----------------------------+
| 2017-09-25 18:11:00         |
+-----------------------------+
1 row in set (0.02 sec)
MariaDB [pw2]> select count(*) from piwik_log_visit;
+----------+
| count(*) |
+----------+
|    23643 |
+----------+
1 row in set (0.01 sec)

MariaDB [pw2]>
MariaDB [pw2]>
MariaDB [pw2]>
MariaDB [pw2]> select min(visit_last_action_time) from piwik_log_visit;
+-----------------------------+
| min(visit_last_action_time) |
+-----------------------------+
| 2017-09-25 18:11:00         |
+-----------------------------+
1 row in set (0.02 sec)
anhnongdan commented 7 years ago

Log import of the 2 instances are identical (this is just approx. as monitoring file size just give a 'feeling' about how much data comes in).

screen shot 2017-09-28 at 2 19 53 pm screen shot 2017-09-28 at 2 19 58 pm
anhnongdan commented 7 years ago

Nearly no queued request for both instances.

anhnongdan commented 7 years ago

Sessions and Hits over Server time:

screen shot 2017-09-28 at 2 29 31 pm screen shot 2017-09-28 at 2 29 37 pm screen shot 2017-09-28 at 2 29 49 pm screen shot 2017-09-28 at 2 29 54 pm

**Traffic lost from 2am to 4am causes by 4001 disk full:

screen shot 2017-09-28 at 2 44 32 pm
anhnongdan commented 7 years ago

There's difference between Session Durations of the 2 instance. The system is very time-sensitive

screen shot 2017-09-28 at 2 32 29 pm screen shot 2017-09-28 at 2 32 35 pm
anhnongdan commented 7 years ago

Get system running stable, then compare the numbers with those of other tools.