cureseven / isucon-practice-20231123-2

isucon-practice-20231123-2

0 stars 0 forks source link

動け〜〜〜〜〜 #1

Open cureseven opened 11 months ago

cureseven commented 11 months ago

ISUCON12予選

あとで消す

mism-mism commented 11 months ago

pinkumohikan commented 11 months ago

インフラ構成

スペック

OS: "Ubuntu 22.04.2 LTS"
vCPU: 2

メモリ

               total        used        free      shared  buff/cache   available
Mem:           3.6Gi       672Mi       1.9Gi       0.0Ki       1.1Gi       2.7Gi
Swap:             0B          0B          0B

ミドルウェア

MySQL: /usr/sbin/mysqld Ver 8.0.34-0ubuntu0.22.04.1 for Linux on x86_64 ((Ubuntu))
Nginx: nginx version: nginx/1.18.0 (Ubuntu)
Go:

開いているポート

COMMAND PID     USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
nginx   822     root    6u  IPv4  17367      0t0  TCP *:https (LISTEN)
nginx   823 www-data    6u  IPv4  17367      0t0  TCP *:https (LISTEN)
nginx   824 www-data    6u  IPv4  17367      0t0  TCP *:https (LISTEN)
mysqld  969    mysql   24u  IPv4  18697      0t0  TCP localhost:mysql (LISTEN)

起動中のサービス

  UNIT                                           LOAD   ACTIVE SUB     DESCRIPTION
  acpid.service                                  loaded active running ACPI event daemon
  apparmor.service                               loaded active exited  Load AppArmor profiles
  apport.service                                 loaded active exited  LSB: automatic crash report generation
  blackauth.service                              loaded active running isucon12 qualify auth server
  blk-availability.service                       loaded active exited  Availability of block devices
  chrony.service                                 loaded active running chrony, an NTP client/server
  cloud-config.service                           loaded active exited  Apply the settings specified in cloud-config
  cloud-final.service                            loaded active exited  Execute cloud user/final scripts
  cloud-init-local.service                       loaded active exited  Initial cloud-init job (pre-networking)
  cloud-init.service                             loaded active exited  Initial cloud-init job (metadata service crawler)
  console-setup.service                          loaded active exited  Set console font and keymap
  containerd.service                             loaded active running containerd container runtime
  cron.service                                   loaded active running Regular background program processing daemon
  dbus.service                                   loaded active running D-Bus System Message Bus
  docker.service                                 loaded active running Docker Application Container Engine
  finalrd.service                                loaded active exited  Create final runtime dir for shutdown pivot root
  getty@tty1.service                             loaded active running Getty on tty1
  irqbalance.service                             loaded active running irqbalance daemon
  isuports.service                               loaded active running isucon12 qualify webapp
  keyboard-setup.service                         loaded active exited  Set the console keyboard layout
  kmod-static-nodes.service                      loaded active exited  Create List of Static Device Nodes
  lvm2-monitor.service                           loaded active exited  Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling
  multipathd.service                             loaded active running Device-Mapper Multipath Device Controller
  mysql.service                                  loaded active running MySQL Community Server
  networkd-dispatcher.service                    loaded active running Dispatcher daemon for systemd-networkd
  nginx.service                                  loaded active running A high performance web server and a reverse proxy server
  plymouth-quit-wait.service                     loaded active exited  Hold until boot process finishes up
  plymouth-quit.service                          loaded active exited  Terminate Plymouth Boot Screen
  plymouth-read-write.service                    loaded active exited  Tell Plymouth To Write Out Runtime Data
  polkit.service                                 loaded active running Authorization Manager
  redis-server.service                           loaded active running Advanced key-value store
  rsyslog.service                                loaded active running System Logging Service
  serial-getty@ttyS0.service                     loaded active running Serial Getty on ttyS0
  setvtrgb.service                               loaded active exited  Set console scheme
  snap.amazon-ssm-agent.amazon-ssm-agent.service loaded active running Service for snap application amazon-ssm-agent.amazon-ssm-agent
  snapd.apparmor.service                         loaded active exited  Load AppArmor profiles managed internally by snapd
  snapd.seeded.service                           loaded active exited  Wait until snapd is fully seeded
  snapd.service                                  loaded active running Snap Daemon
  ssh.service                                    loaded active running OpenBSD Secure Shell server
  systemd-fsck-root.service                      loaded active exited  File System Check on Root Device
  systemd-fsck@dev-disk-by\x2dlabel-UEFI.service loaded active exited  File System Check on /dev/disk/by-label/UEFI
  systemd-journal-flush.service                  loaded active exited  Flush Journal to Persistent Storage
  systemd-journald.service                       loaded active running Journal Service
  systemd-logind.service                         loaded active running User Login Management
  systemd-modules-load.service                   loaded active exited  Load Kernel Modules
  systemd-networkd-wait-online.service           loaded active exited  Wait for Network to be Configured
  systemd-networkd.service                       loaded active running Network Configuration
  systemd-random-seed.service                    loaded active exited  Load/Save Random Seed
  systemd-remount-fs.service                     loaded active exited  Remount Root and Kernel File Systems
  systemd-resolved.service                       loaded active running Network Name Resolution
  systemd-sysctl.service                         loaded active exited  Apply Kernel Variables
  systemd-sysusers.service                       loaded active exited  Create System Users
  systemd-tmpfiles-setup-dev.service             loaded active exited  Create Static Device Nodes in /dev
  systemd-tmpfiles-setup.service                 loaded active exited  Create Volatile Files and Directories
  systemd-udev-trigger.service                   loaded active exited  Coldplug All udev Devices
  systemd-udevd.service                          loaded active running Rule-based Manager for Device Events and Files
  systemd-update-utmp.service                    loaded active exited  Record System Boot/Shutdown in UTMP
  systemd-user-sessions.service                  loaded active exited  Permit User Sessions
  ubuntu-fan.service                             loaded active exited  Ubuntu FAN network setup
  ufw.service                                    loaded active exited  Uncomplicated firewall
  unattended-upgrades.service                    loaded active running Unattended Upgrades Shutdown
  user-runtime-dir@1000.service                  loaded active exited  User Runtime Directory /run/user/1000
  user@1000.service                              loaded active running User Manager for UID 1000

LOAD   = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB    = The low-level unit activation state, values depend on unit type.
63 loaded units listed.
To show all installed unit files use 'systemctl list-unit-files'.

pinkumohikan commented 11 months ago

初期スコア

02:30:14.353865 PASSED: true 02:30:14.353868 SCORE: 2712 (+2712 0(0%))

ベンチコマンド:

$ ssh isucon-bench "cd ~/bench && ./bench -target-addr isucon-s1:443"

pinkumohikan commented 11 months ago

dockerで動いてる

WorkingDirectory=/home/isucon/webapp
ExecStart=docker compose -f docker-compose-go.yml up --build
ExecStop=docker compose -f docker-compose-go.yml down

pinkumohikan commented 11 months ago

CPU使用率

DBとアプリで半々ぐらい

mism-mism commented 11 months ago

kataribe

Top 20 Sort By Total
Count     Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max  2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
  737  1144.087  1.5524  3.0066   0.001   0.022   6.250   7.991  12.309  12.341  707    0   30    0     6156230          0       8353      14732  GET /api/player/competition/:competition_id/ranking
  530   900.848  1.6997  2.9227   0.001   0.144   6.040   7.256  11.454  12.236  504    0   26    0      407340          0        768       1866  GET /api/player/player/:player_id
   60   141.081  2.3514  2.5238   0.001   1.640   6.159   7.909  12.341  12.341   54    0    6    0        3101          0         51         62  POST /api/organizer/competition/:competition_id/score
   11   109.576  9.9615  4.4624   3.727  10.573  15.558  15.750  15.750  15.750    9    0    2    0       13596          0       1236       1529  GET /api/admin/tenants/billing?querystring
    8    28.620  3.5775  1.5598   1.676   3.785   5.532   5.532   5.532   5.532    8    0    0    0      150339      12150      18792      24700  POST /api/organizer/players/add HTTP/2.0
   23     4.512  0.1962  0.4877   0.002   0.025   0.902   0.947   2.150   2.150   23    0    0    0       39725        323       1727       3358  GET /api/organizer/billing HTTP/2.0
    1     3.764  3.7640  0.0000   3.764   3.764   3.764   3.764   3.764   3.764    1    0    0    0        1553       1553       1553       1553  GET /api/admin/tenants/billing HTTP/2.0
    1     2.974  2.9740  0.0000   2.974   2.974   2.974   2.974   2.974   2.974    1    0    0    0          55         55         55         55  POST /initialize HTTP/2.0
  117     1.362  0.0116  0.0096   0.001   0.010   0.027   0.030   0.036   0.038  105    0   12    0      132472         39       1132       2559  GET /api/player/competitions HTTP/2.0
   42     0.973  0.0232  0.0102   0.003   0.022   0.033   0.040   0.057   0.057   41    0    1    0        6757         39        160        180  POST /api/organizer/competitions/add HTTP/2.0
   39     0.504  0.0129  0.0089   0.001   0.009   0.032   0.037   0.038   0.038   38    0    1    0         837         21         21         39  POST /api/organizer/competition/:competition_id/finish
   11     0.417  0.0379  0.0345   0.001   0.043   0.077   0.110   0.110   0.110    6    0    5    0        1282         39        116        187  POST /api/admin/tenants/add HTTP/2.0
   26     0.165  0.0063  0.0058   0.001   0.004   0.015   0.015   0.026   0.026   26    0    0    0      544919       3897      20958      79116  GET /api/organizer/players HTTP/2.0
   15     0.159  0.0106  0.0037   0.001   0.010   0.015   0.017   0.017   0.017   14    0    1    0        2225         39        148        160  POST /api/organizer/player/:player_id/disqualified
    1     0.001  0.0010  0.0000   0.001   0.001   0.001   0.001   0.001   0.001    1    0    0    0         177        177        177        177  GET /api/organizer/competitions HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000    1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000    1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000    1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0

mism-mism commented 11 months ago

top-slow.log

mism-mism commented 11 months ago

# Query 2: 103.35 QPS, 1.10x concurrency, ID 0x94A9E43DFAAFA029A1FC19A5563AD0F5 at byte 555349
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.00
# Time range: 2023-11-23T02:55:09 to 2023-11-23T02:56:21
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count         21    7441
# Exec time     39     79s     3ms    89ms    11ms    23ms     7ms     9ms
# Lock time     99     35s       0    84ms     5ms    16ms     6ms     3ms
# Rows sent      0       0       0       0       0       0       0       0
# Rows examine   0       0       0       0       0       0       0       0
# Query size    23 327.00k      45      45      45      45       0      45
# String:
# Databases    isuports
# Hosts        localhost
# Users        isucon
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms  ################################################################
#  10ms  ####################################################
# 100ms
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `isuports` LIKE 'id_generator'\G
#    SHOW CREATE TABLE `isuports`.`id_generator`\G
REPLACE INTO id_generator (stub) VALUES ('a')\G

IDの自動生成をDBに持たせないようにしいます

mism-mism commented 11 months ago

一番小さいcrated_atしか見ていないアプリケーションで毎回書き込む必要なさそう

# Query 1: 18.80 QPS, 1.51x concurrency, ID 0x676347F321DB8BC7FCB05D4948FC2248 at byte 5092715
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.07
# Time range: 2023-11-23T02:55:09 to 2023-11-23T02:56:24
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          4    1410
# Exec time     56    113s   160us   531ms    80ms   230ms    73ms    59ms
# Lock time      0     2ms     1us    63us     1us     1us     1us     1us
# Rows sent     97 119.32k       0     195   86.66  174.84   50.43   76.28
# Rows examine  89  26.55M       0  46.90k  19.28k  40.32k  11.95k  15.96k
# Query size    14 196.85k     141     144  142.96  136.99    0.70  136.99
# String:
# Databases    isuports
# Hosts        localhost
# Users        isucon
# Query_time distribution
#   1us
#  10us
# 100us  ####
#   1ms  #####
#  10ms  ################################################################
# 100ms  ###############################
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `isuports` LIKE 'visit_history'\G
#    SHOW CREATE TABLE `isuports`.`visit_history`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT player_id, MIN(created_at) AS min_created_at FROM visit_history WHERE tenant_id = 59 AND competition_id = '184b9b3e1' GROUP BY player_id\G

mism-mism commented 11 months ago

id_generator

mism-mism commented 11 months ago

TABLE_NAME	TABLE_ROWS	total_storage_mb	avg_storage_b	total_data_mb	total_index_mb
visit_history	2968464	266	94	209	56
id_generator	0	0	null	0	0
tenant	100	0	327	0	0

mism-mism commented 11 months ago

nginxのログとslow query log
インデクス貼った
- CREATE UNIQUE INDEX visit_history_idx ON visit_history(tenant_id, player_id, competition_id);

03:39:35.458046 SCORE: 3012 (+3012 0(0%))

mism-mism commented 11 months ago

https://github.com/cureseven/isucon-practice-20231123-2/pull/3

kataribe

Top 20 Sort By Total
Count     Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max   2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
 1231  1159.244  0.9417  1.6125   0.001   0.256   2.241   2.527   9.768  11.180  1193    0   38    0     1196710          0        972       1487  GET /api/player/player/:player_id
 1048  1046.924  0.9990  1.8508   0.001   0.073   2.434   3.193   9.710  11.183  1016    0   32    0    11536509          0      11008      16282  GET /api/player/competition/:competition_id/ranking
   12   112.918  9.4098  5.0202   1.428  11.035  15.346  17.238  17.238  17.238    10    0    2    0       15107          0       1258       1528  GET /api/admin/tenants/billing?querystring
   74    86.954  1.1751  1.5806   0.001   0.747   2.259   3.055  10.004  10.004    68    0    6    0        3852          0         52         62  POST /api/organizer/competition/:competition_id/score
  175    21.094  0.1205  0.3877   0.001   0.019   0.073   1.033   1.891   1.895   161    0   14    0      200867         39       1147       2675  GET /api/player/competitions HTTP/2.0
   34    13.431  0.3950  0.7968   0.003   0.078   1.247   2.328   3.945   3.945    33    0    1    0       73500          0       2161       4606  GET /api/organizer/billing HTTP/2.0
    9    11.737  1.3041  0.4556   0.723   1.392   2.105   2.105   2.105   2.105     9    0    0    0      196949      13950      21883      30740  POST /api/organizer/players/add HTTP/2.0
    1     2.781  2.7810  0.0000   2.781   2.781   2.781   2.781   2.781   2.781     1    0    0    0        1577       1577       1577       1577  GET /api/admin/tenants/billing HTTP/2.0
    2     2.685  1.3425  1.3415   0.001   2.684   2.684   2.684   2.684   2.684     1    0    0    1         221         55        110        166  POST /initialize HTTP/2.0
   51     0.847  0.0166  0.0110   0.001   0.013   0.032   0.044   0.051   0.051    50    0    1    0        1089         21         21         39  POST /api/organizer/competition/:competition_id/finish
   54     0.776  0.0144  0.0093   0.002   0.011   0.023   0.037   0.055   0.055    53    0    1    0        9686         39        179        213  POST /api/organizer/competitions/add HTTP/2.0
   11     0.337  0.0306  0.0294   0.001   0.037   0.077   0.085   0.085   0.085     6    0    5    0        1305         39        118        203  POST /api/admin/tenants/add HTTP/2.0
   36     0.332  0.0092  0.0077   0.002   0.007   0.022   0.026   0.029   0.029    36    0    0    0      898350       3897      24954     126457  GET /api/organizer/players HTTP/2.0
   17     0.222  0.0131  0.0065   0.007   0.010   0.026   0.026   0.026   0.026    16    0    1    0        2604         39        153        175  POST /api/organizer/player/:player_id/disqualified
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         195        195        195        195  GET /api/organizer/competitions HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0

mism-mism commented 11 months ago

top-slow.log

mism-mism commented 11 months ago

このあたり見ていく

SELECT player_id, MIN(created_at) AS min_created_at FROM visit_history WHERE tenant_id = 33 AND competition_id = 'f2ba5e43' GROUP BY player_id\G

# Query 2: 14.97 QPS, 0.10x concurrency, ID 0x2E69352DE16B15042A1217500A0400FE at byte 2041939
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.00
# Time range: 2023-11-23T03:53:48 to 2023-11-23T03:54:57
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          5    1033
# Exec time      5      7s     3ms    28ms     7ms    13ms     3ms     6ms
# Lock time     16     2ms     1us   252us     1us     1us     7us     1us
# Rows sent      0       0       0       0       0       0       0       0
# Rows examine   0       0       0       0       0       0       0       0
# Query size    17 183.88k     150     185  182.28  183.58    6.23  183.58
# String:
# Databases    isuports
# Hosts        localhost
# Users        isucon
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms  ################################################################
#  10ms  ############
# 100ms
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `isuports` LIKE 'visit_history'\G
#    SHOW CREATE TABLE `isuports`.`visit_history`\G
INSERT INTO visit_history (player_id, tenant_id, competition_id, created_at, updated_at) VALUES ('01HFX5083SN54DEGCJQSJRG5H3', 167, '01HFX50CB1K7XG8DGHW7PCHT7J', 1700711660, 1700711660)\G

pinkumohikan commented 11 months ago

mism-mism commented 11 months ago

cd ~/ && sudo cat /var/log/nginx/access.log | ./kataribe

pinkumohikan commented 11 months ago

DB分離

DBをs3へお引越し

s1: app (in docker) s2: s3: db

04:19:39.716215 PASSED: true 04:19:39.716218 SCORE: 5102 (+5314 -212(4%))

mism-mism commented 11 months ago

04:45:01.064447 SCORE: 5819 (+6325 -506(8%))
top-slow.log

Top 20 Sort By Total
Count     Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max   2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
 1819  2008.193  1.1040  2.2821   0.001   0.280   2.486   2.818   9.929  30.000  1716    0  103    0     1664820          0        915       2160  GET /api/player/player/:player_id
 1630  1926.461  1.1819  2.4113   0.001   0.075   2.635   4.610   9.483  30.001  1542    0   87    1    17714187          0      10867      16291  GET /api/player/competition/:competition_id/ranking
   96   137.818  1.4356  1.7286   0.001   0.845   2.554   4.217   9.776   9.776    88    0    8    0        4925          0         51         62  POST /api/organizer/competition/:competition_id/score
   35    74.631  2.1323  4.3952   0.003   1.030   2.407   6.053  26.654  26.654    34    0    1    0       49906          0       1425       1552  GET /api/admin/tenants/billing?querystring
  267    37.183  0.1393  0.4544   0.001   0.017   0.070   1.151   2.376   2.556   251    0   16    0      304998          0       1142       2819  GET /api/player/competitions HTTP/2.0
   11    12.849  1.1681  0.3838   0.681   1.173   1.573   1.957   1.957   1.957    11    0    0    0      229829      13950      20893      27880  POST /api/organizer/players/add HTTP/2.0
   45     5.744  0.1276  0.3388   0.002   0.024   0.373   0.548   2.177   2.177    45    0    0    0       96870        341       2152       4911  GET /api/organizer/billing HTTP/2.0
    2     4.751  2.3755  2.1125   0.263   4.488   4.488   4.488   4.488   4.488     2    0    0    0        3046       1515       1523       1531  GET /api/admin/tenants/billing HTTP/2.0
   75     1.324  0.0177  0.0216   0.005   0.011   0.034   0.054   0.162   0.162    74    0    1    0       13476         39        179        200  POST /api/organizer/competitions/add HTTP/2.0
   69     1.202  0.0174  0.0161   0.002   0.011   0.032   0.044   0.101   0.101    68    0    1    0        1467         21         21         39  POST /api/organizer/competition/:competition_id/finish
   56     0.784  0.0140  0.0305   0.002   0.005   0.031   0.058   0.220   0.220    56    0    0    0     2471099       3070      44126     602067  GET /api/organizer/players HTTP/2.0
   12     0.771  0.0643  0.0931   0.000   0.032   0.258   0.266   0.266   0.266     7    0    5    0        1445         39        120        187  POST /api/admin/tenants/add HTTP/2.0
    1     0.488  0.4880  0.0000   0.488   0.488   0.488   0.488   0.488   0.488     1    0    0    0          55         55         55         55  POST /initialize HTTP/2.0
   18     0.172  0.0096  0.0043   0.001   0.010   0.015   0.023   0.023   0.023    17    0    1    0        2718         39        151        175  POST /api/organizer/player/:player_id/disqualified
    1     0.001  0.0010  0.0000   0.001   0.001   0.001   0.001   0.001   0.001     1    0    0    0         195        195        195        195  GET /api/organizer/competitions HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0

mism-mism commented 11 months ago

Statement	Execution Count	Average Time
DELETE FROM player_score WHERE tenant_id = ? AND competition_id = ?	81	0.010248844024691358
INSERT INTO competition (id, tenant_id, title, finished_at, created_at, updated_at) VALUES (?, ?, ?, ?, ?, ?)	65	0.01877756947692308
INSERT INTO player (id, tenant_id, display_name, is_disqualified, created_at, updated_at) VALUES (?, ?, ?, ?, ?, ?)	1473	0.00736665395858791
INSERT INTO player_score (id, tenant_id, player_id, competition_id, score, row_num, created_at, updated_at) VALUES (?, ?, ?, ?, ?, ?, ?, ?)	13471	0.008180866994284037
SELECT * FROM competition WHERE id = ?	15599	3.312373652157193e-05
SELECT * FROM competition WHERE tenant_id = ? ORDER BY created_at ASC	1336	6.622631511976061e-05
SELECT * FROM competition WHERE tenant_id=?	356	2.2248941011235965e-05
SELECT * FROM competition WHERE tenant_id=? ORDER BY created_at DESC	250	6.283040799999999e-05
SELECT * FROM player WHERE id = ?	227076	2.2987885377582517e-05
SELECT * FROM player WHERE tenant_id=? ORDER BY created_at DESC	49	4.3712061224489784e-05
SELECT * FROM player_score WHERE tenant_id = ? AND competition_id = ? AND player_id = ? ORDER BY row_num DESC LIMIT 1	12476	6.174189700224434e-05
SELECT * FROM player_score WHERE tenant_id = ? AND competition_id = ? ORDER BY row_num DESC	1343	5.523319880863729e-05
SELECT DISTINCT(player_id) FROM player_score WHERE tenant_id = ? AND competition_id = ?	4416	3.3421236186594226e-05
UPDATE competition SET finished_at = ?, updated_at = ? WHERE id = ?	58	0.009170613499999997
UPDATE player SET is_disqualified = ?, updated_at = ? WHERE id = ?	17	0.00849844694117647

cureseven commented 11 months ago

pprof list playerHandlerしたら

         .          .   1226:   // player_scoreを読んでいるときに更新が走ると不整合が起こるのでロックを取得する
         .   1385.53s   1227:   fl, err := flockByTenantID(v.tenantID)

が重そうロック取らなくてもいいようにN+1を解消して一発で取ってこようと思います

mism-mism commented 11 months ago

インデックス貼ったら下がった

以下のクエリが回数時間ともに重いのでtenant_id とcompetition_idでインデックスを貼ってみたと


SELECT * FROM player_score WHERE tenant_id = ? AND competition_id = ? AND player_id = ? ORDER BY row_num DESC LIMIT 1

回数 12476 時間 6.174189700224434e-05



> 05:32:49.907528 SCORE: 5226 (+5387 -161(3%))

mism-mism commented 11 months ago

インデックス追加してこの点数

06:01:39.588458 PASSED: true 06:01:39.588461 SCORE: 8564 (+8650 -86(1%))

mism-mism commented 11 months ago

Top 20 Sort By Total
Count     Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max   2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
 2108  3421.173  1.6229  2.4075   0.001   0.114   3.923   4.586  12.731  13.464  2048    0   60    0    25259030          0      11982      16288  GET /api/player/competition/:competition_id/ranking
 2553  3196.808  1.2522  2.0484   0.001   0.108   3.498   4.068  11.071  14.647  2488    0   64    1     2245624          0        879       2155  GET /api/player/player/:player_id
  117   261.060  2.2313  2.1836   0.001   1.390   3.982   5.849  11.141  12.765   108    0    9    0        6013          0         51         62  POST /api/organizer/competition/:competition_id/score
  388   108.965  0.2808  0.7181   0.000   0.022   0.942   2.006   3.662   3.668   373    0   15    0      458247         39       1181       3211  GET /api/player/competitions HTTP/2.0
   72    49.047  0.6812  2.0847   0.001   0.179   0.747   1.815  15.007  15.007    71    0    1    0      100647          0       1397       1562  GET /api/admin/tenants/billing?querystring
   18    33.392  1.8551  0.5968   0.710   1.947   2.625   2.854   2.854   2.854    18    0    0    0      433309      13950      24072      31260  POST /api/organizer/players/add HTTP/2.0
    5    16.606  3.3212  2.5777   0.069   2.890   7.901   7.901   7.901   7.901     5    0    0    0        7945       1580       1589       1608  GET /api/admin/tenants/billing HTTP/2.0
   63     9.125  0.1448  0.3782   0.002   0.015   0.427   0.759   2.497   2.497    62    0    1    0      134551          0       2135       6730  GET /api/organizer/billing HTTP/2.0
   96     2.229  0.0232  0.0649   0.001   0.013   0.030   0.057   0.642   0.642    95    0    1    0       17385         39        181        206  POST /api/organizer/competitions/add HTTP/2.0
   88     1.682  0.0191  0.0141   0.001   0.014   0.037   0.051   0.080   0.080    87    0    1    0        1866         21         21         39  POST /api/organizer/competition/:competition_id/finish
   15     1.154  0.0769  0.0787   0.001   0.044   0.194   0.244   0.244   0.244    10    0    5    0        2068         39        137        197  POST /api/admin/tenants/add HTTP/2.0
   78     0.982  0.0126  0.0242   0.001   0.004   0.035   0.046   0.179   0.179    78    0    0    0     5118200       3087      65617     701907  GET /api/organizer/players HTTP/2.0
    1     0.568  0.5680  0.0000   0.568   0.568   0.568   0.568   0.568   0.568     1    0    0    0          55         55         55         55  POST /initialize HTTP/2.0
   18     0.287  0.0159  0.0117   0.001   0.012   0.040   0.046   0.046   0.046    17    0    1    0        2733         39        151        175  POST /api/organizer/player/:player_id/disqualified
    1     0.001  0.0010  0.0000   0.001   0.001   0.001   0.001   0.001   0.001     1    0    0    0         195        195        195        195  GET /api/organizer/competitions HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0

mism-mism commented 11 months ago

06:40:07.166895 SCORE: 12369 (+12493 -124(1%))


Top 20 Sort By Total
Count     Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max   2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
 2962  2007.623  0.6778  0.8946   0.001   0.433   1.514   2.131   4.602   9.903  2885    0   77    0    38385027          0      12959      16280  GET /api/player/competition/:competition_id/ranking
 6033  1947.872  0.3229  0.5329   0.001   0.175   0.704   1.060   2.344   9.355  5959    0   74    0     6030034          0        999       2291  GET /api/player/player/:player_id
   44    98.106  2.2297  7.0268   0.001   0.156   2.000   8.499  36.627  36.627    41    0    3    0       56956          0       1294       1562  GET /api/admin/tenants/billing?querystring
   59    77.001  1.3051  1.8676   0.002   0.346   4.490   5.792   8.073   8.073    58    0    1    0      124989          0       2118       7017  GET /api/organizer/billing HTTP/2.0
  457    71.638  0.1568  0.2528   0.000   0.070   0.374   0.699   1.317   1.537   446    0   11    0      539799         39       1181       3206  GET /api/player/competitions HTTP/2.0
   21    53.150  2.5310  1.7578   0.764   2.014   4.630   5.645   7.437   7.437    20    0    1    0      480489          0      22880      31000  POST /api/organizer/players/add HTTP/2.0
   96    17.607  0.1834  0.2578   0.001   0.099   0.476   0.578   2.017   2.017    91    0    5    0        5118         39         53         62  POST /api/organizer/competition/:competition_id/score
   74    14.670  0.1982  0.5376   0.005   0.085   0.336   0.711   4.394   4.394    72    0    2    0        1551          0         20         39  POST /api/organizer/competition/:competition_id/finish
   71     8.378  0.1180  0.2050   0.002   0.049   0.306   0.552   1.206   1.206    71    0    0    0     5457631       2805      76868     704767  GET /api/organizer/players HTTP/2.0
   80     7.706  0.0963  0.1305   0.001   0.049   0.235   0.437   0.624   0.624    79    0    1    0       14360         39        179        202  POST /api/organizer/competitions/add HTTP/2.0
    4     5.076  1.2690  1.2750   0.066   1.650   3.192   3.192   3.192   3.192     4    0    0    0        6150       1532       1537       1547  GET /api/admin/tenants/billing HTTP/2.0
   14     1.012  0.0723  0.0680   0.001   0.056   0.177   0.185   0.185   0.185     9    0    5    0        1820         39        130        187  POST /api/admin/tenants/add HTTP/2.0
   13     0.754  0.0580  0.0898   0.002   0.023   0.235   0.293   0.293   0.293    12    0    1    0        1952         39        150        175  POST /api/organizer/player/:player_id/disqualified
    1     0.534  0.5340  0.0000   0.534   0.534   0.534   0.534   0.534   0.534     1    0    0    0          55         55         55         55  POST /initialize HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         195        195        195        195  GET /api/organizer/competitions HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0

cureseven commented 11 months ago

9 #4 で

07:16:33.988898 SCORE: 11880 (+12000 -120(1%))

Top 20 Sort By Total
Count     Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max   2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
 3458  2901.399  0.8390  1.6918   0.001   0.371   1.594   2.005   6.553  30.001  3385    0   73    0    30488570          0       8816      16289  GET /api/player/competition/:competition_id/ranking
 4061   512.759  0.1263  0.0824   0.002   0.111   0.236   0.284   0.386   0.611  4038    0   23    0     3882594          0        956       2248  GET /api/player/player/:player_id
  110   112.610  1.0237  1.1877   0.001   0.609   2.254   2.446   5.858   6.732   103    0    7    0        5764          0         52         62  POST /api/organizer/competition/:competition_id/score
   69    82.759  1.1994  1.0660   0.001   0.802   2.727   2.969   3.487   3.487    68    0    1    0       96172          0       1393       1562  GET /api/admin/tenants/billing?querystring
 1142    23.997  0.0210  0.0211   0.001   0.015   0.040   0.061   0.110   0.185  1129    0   13    0     1567383          0       1372       3941  GET /api/player/competitions HTTP/2.0
   18    14.870  0.8261  0.9721   0.065   0.316   2.514   3.036   3.036   3.036    18    0    0    0      442929      13950      24607      30220  POST /api/organizer/players/add HTTP/2.0
   63    10.071  0.1599  0.2353   0.002   0.087   0.306   0.727   1.262   1.262    63    0    0    0      143296        341       2274       8207  GET /api/organizer/billing HTTP/2.0
   81     7.176  0.0886  0.0321   0.020   0.091   0.122   0.137   0.192   0.192    81    0    0    0     5858667       5026      72329     805127  GET /api/organizer/players HTTP/2.0
    5     1.659  0.3318  0.2942   0.075   0.145   0.858   0.858   0.858   0.858     5    0    0    0        7819       1545       1563       1587  GET /api/admin/tenants/billing HTTP/2.0
   82     1.140  0.0139  0.0203   0.001   0.009   0.021   0.046   0.157   0.157    81    0    1    0        1740         21         21         39  POST /api/organizer/competition/:competition_id/finish
   92     0.815  0.0089  0.0134   0.001   0.005   0.017   0.028   0.111   0.111    91    0    1    0       16768         39        182        225  POST /api/organizer/competitions/add HTTP/2.0
    1     0.625  0.6250  0.0000   0.625   0.625   0.625   0.625   0.625   0.625     1    0    0    0          55         55         55         55  POST /initialize HTTP/2.0
   15     0.103  0.0069  0.0055   0.001   0.005   0.016   0.018   0.018   0.018    14    0    1    0        2265         39        151        175  POST /api/organizer/player/:player_id/disqualified
   15     0.043  0.0029  0.0020   0.001   0.003   0.004   0.009   0.009   0.009    10    0    5    0        2046         39        136        200  POST /api/admin/tenants/add HTTP/2.0
    1     0.001  0.0010  0.0000   0.001   0.001   0.001   0.001   0.001   0.001     1    0    0    0         195        195        195        195  GET /api/organizer/competitions HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     0    0    1    0         134        134        134        134  GET /dns-query?querystring
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     0    0    1    0         134        134        134        134  GET / HTTP/1.1

mism-mism commented 11 months ago

10

07:44:14.681508 PASSED: true
07:44:14.681510 SCORE: 12795 (+12795 0(0%))

mism-mism commented 11 months ago

[ADMIN] 07:49:45.170722 validation error: error: テナント別の請求ダッシュボード: 初期データチェック GET /api/admin/tenants/billing Billingの結果が違います tenantName:wvf-yom-16 (want: 54120, got: 307420) tenant:admin role:admin playerID:admin beforeTenantID:23
[ADMIN] 07:49:45.170731 Scenario:validation elapsed:3.504642319s
07:49:46.171624 ERROR[0] prepare: load-validation: GET /api/admin/tenants/billing Billingの結果が違います tenantName:wvf-yom-16 (want: 54120, got: 307420) tenant:admin role:admin playerID:admin beforeTenantID:23
[ADMIN] 07:49:46.171779 ScenarioScoreMap: map[string]int64{
  "AdminBilling":            0,

mism-mism commented 11 months ago

https://github.com/cureseven/isucon-practice-20231123-2/pull/10

08:47:33.545327 PASSED: true
[ADMIN] 08:47:33.545230 WorkerCount: map[string]int{
  "AdminBillingScenarioWorker":   1,
  "AdminBillingValidateWorker":   1,
  "NewTenantScenarioWorker":      6,
  "PlayerScenarioWorker":         188,
  "PlayerValidateScenarioWorker": 1,
  "PopularTenantScenarioWorker":  2,
  "TenantBillingValidateWorker":  1,
}
08:47:33.545330 SCORE: 12651 (+12651 0(0%))

cureseven commented 11 months ago

14 で

08:51:20.056582 SCORE: 13132 (+13132 0(0%))

pinkumohikan commented 11 months ago

[ADMIN] 08:52:45.037518 validation error: error: テナント別の請求ダッシュボード: 初期データチェック GET /api/admin/tenants/billing Billingの結果が違います tenantName:a-u-24 (want: 22710, got: 364210) tenant:admin role:admin playerID:admin beforeTenantID:29
08:52:45.037521 整合性チェックを終了します
08:52:45.037530 整合性チェックに失敗しました
[ADMIN] 08:52:45.037528 Scenario:validation elapsed:3.326465816s
08:52:46.037754 ERROR[0] prepare: load-validation: GET /api/admin/tenants/billing Billingの結果が違います tenantName:a-u-24 (want: 22710, got: 364210) tenant:admin role:admin playerID:admin beforeTenantID:29
[ADMIN] 08:52:46.037925 ScenarioScoreMap: map[string]int64{
  "AdminBilling":            0,
  "AdminBillingValidate":    0,
  "OrganizerNewTenant":      0,
  "OrganizerPeacefulTenant": 0,
  "OrganizerPopularTenant":  0,
  "Player":                  0,
  "PlayerValidate":          0,
  "TenantBillingValidate":   0,
}
08:52:46.038002 Error 1 (Critical:0)
08:52:46.038005 PASSED: false
08:52:46.038007 SCORE: 0 (+0 0(1%))

で死にがち

mism-mism commented 11 months ago

Top 20 Sort By Total
Count     Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max   2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
 4058  3276.474  0.8074  1.7207   0.001   0.414   1.498   1.798   7.362  30.001  4004    0   54    0    35672508          0       8790      16277  GET /api/player/competition/:competition_id/ranking
 5068   445.073  0.0878  0.0602   0.001   0.075   0.166   0.199   0.292   0.561  5048    0   20    0     5321603          0       1050       2575  GET /api/player/player/:player_id
  116   114.587  0.9878  1.2722   0.001   0.506   2.220   2.391   6.752   8.081   108    0    8    0        6023          0         51         62  POST /api/organizer/competition/:competition_id/score
   71    82.874  1.1672  1.1279   0.001   0.539   3.008   3.340   3.515   3.515    70    0    1    0       97821          0       1377       1565  GET /api/admin/tenants/billing?querystring
 1235    26.707  0.0216  0.0181   0.001   0.017   0.043   0.058   0.093   0.154  1220    0   15    0     1815374          0       1469       3426  GET /api/player/competitions HTTP/2.0
   20    17.974  0.8987  1.0111   0.064   0.296   2.835   2.838   2.838   2.838    20    0    0    0      450069      13950      22503      29440  POST /api/organizer/players/add HTTP/2.0
   64    11.312  0.1768  0.2429   0.002   0.085   0.421   0.624   1.344   1.344    64    0    0    0      151823        341       2372       6998  GET /api/organizer/billing HTTP/2.0
   86     6.208  0.0722  0.0345   0.017   0.072   0.100   0.127   0.235   0.235    86    0    0    0     5328218       3083      61956     700867  GET /api/organizer/players HTTP/2.0
    6     2.589  0.4315  0.4281   0.063   0.328   1.264   1.264   1.264   1.264     6    0    0    0        9627       1572       1604       1632  GET /api/admin/tenants/billing HTTP/2.0
   86     1.373  0.0160  0.0191   0.001   0.010   0.038   0.055   0.112   0.112    85    0    1    0        1824         21         21         39  POST /api/organizer/competition/:competition_id/finish
   96     1.043  0.0109  0.0140   0.000   0.006   0.023   0.035   0.092   0.092    95    0    1    0       17355         39        180        203  POST /api/organizer/competitions/add HTTP/2.0
    1     0.522  0.5220  0.0000   0.522   0.522   0.522   0.522   0.522   0.522     1    0    0    0          55         55         55         55  POST /initialize HTTP/2.0
   17     0.161  0.0095  0.0086   0.001   0.007   0.016   0.040   0.040   0.040    16    0    1    0        2588         39        152        175  POST /api/organizer/player/:player_id/disqualified
   16     0.027  0.0017  0.0009   0.000   0.002   0.003   0.004   0.004   0.004    11    0    5    0        2268         39        141        198  POST /api/admin/tenants/add HTTP/2.0
    1     0.001  0.0010  0.0000   0.001   0.001   0.001   0.001   0.001   0.001     1    0    0    0         195        195        195        195  GET /api/organizer/competitions HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0

mism-mism commented 11 months ago

Top 20 Sort By Total
Count     Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max   2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
 4058  3276.474  0.8074  1.7207   0.001   0.414   1.498   1.798   7.362  30.001  4004    0   54    0    35672508          0       8790      16277  GET /api/player/competition/:competition_id/ranking
 5068   445.073  0.0878  0.0602   0.001   0.075   0.166   0.199   0.292   0.561  5048    0   20    0     5321603          0       1050       2575  GET /api/player/player/:player_id
  116   114.587  0.9878  1.2722   0.001   0.506   2.220   2.391   6.752   8.081   108    0    8    0        6023          0         51         62  POST /api/organizer/competition/:competition_id/score
   71    82.874  1.1672  1.1279   0.001   0.539   3.008   3.340   3.515   3.515    70    0    1    0       97821          0       1377       1565  GET /api/admin/tenants/billing?querystring
 1235    26.707  0.0216  0.0181   0.001   0.017   0.043   0.058   0.093   0.154  1220    0   15    0     1815374          0       1469       3426  GET /api/player/competitions HTTP/2.0
   20    17.974  0.8987  1.0111   0.064   0.296   2.835   2.838   2.838   2.838    20    0    0    0      450069      13950      22503      29440  POST /api/organizer/players/add HTTP/2.0
   64    11.312  0.1768  0.2429   0.002   0.085   0.421   0.624   1.344   1.344    64    0    0    0      151823        341       2372       6998  GET /api/organizer/billing HTTP/2.0
   86     6.208  0.0722  0.0345   0.017   0.072   0.100   0.127   0.235   0.235    86    0    0    0     5328218       3083      61956     700867  GET /api/organizer/players HTTP/2.0
    6     2.589  0.4315  0.4281   0.063   0.328   1.264   1.264   1.264   1.264     6    0    0    0        9627       1572       1604       1632  GET /api/admin/tenants/billing HTTP/2.0
   86     1.373  0.0160  0.0191   0.001   0.010   0.038   0.055   0.112   0.112    85    0    1    0        1824         21         21         39  POST /api/organizer/competition/:competition_id/finish
   96     1.043  0.0109  0.0140   0.000   0.006   0.023   0.035   0.092   0.092    95    0    1    0       17355         39        180        203  POST /api/organizer/competitions/add HTTP/2.0
    1     0.522  0.5220  0.0000   0.522   0.522   0.522   0.522   0.522   0.522     1    0    0    0          55         55         55         55  POST /initialize HTTP/2.0
   17     0.161  0.0095  0.0086   0.001   0.007   0.016   0.040   0.040   0.040    16    0    1    0        2588         39        152        175  POST /api/organizer/player/:player_id/disqualified
   16     0.027  0.0017  0.0009   0.000   0.002   0.003   0.004   0.004   0.004    11    0    5    0        2268         39        141        198  POST /api/admin/tenants/add HTTP/2.0
    1     0.001  0.0010  0.0000   0.001   0.001   0.001   0.001   0.001   0.001     1    0    0    0         195        195        195        195  GET /api/organizer/competitions HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0
    1     0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000     1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0

mism-mism commented 11 months ago

top-slow.log

cureseven commented 11 months ago

ベンチ実行後のデータ量

+-------------------+------------+------------------+---------------+---------------+----------------+
| TABLE_NAME        | TABLE_ROWS | total_storage_mb | avg_storage_b | total_data_mb | total_index_mb |
+-------------------+------------+------------------+---------------+---------------+----------------+
| visit_history     |    2968464 |              266 |            94 |           209 |             56 |
| visit_history_old |    2968464 |              266 |            94 |           209 |             56 |
| player_score      |     207155 |               51 |           258 |            34 |             16 |
| player            |      19479 |                2 |           134 |             2 |              0 |
| competition       |       1199 |                0 |           122 |             0 |              0 |
| id_generator      |          0 |                0 |          NULL |             0 |              0 |
| tenant            |        100 |                0 |           327 |             0 |              0 |
+-------------------+------------+------------------+---------------+---------------+----------------+

↑違うようだ

mysql> SELECT COUNT() FROM player; +----------+ | COUNT() | +----------+ | 22611 | +----------+

mysql> SELECT COUNT() FROM competition; +----------+ | COUNT() | +----------+ | 1773 | +----------+

mism-mism commented 11 months ago

SELECT COUNT(*) FROM visit_history; 202892

mism-mism commented 11 months ago

Top 20 Sort By Total
Count      Total    Mean  Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max    2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
17423  12424.940  0.7131  0.7272   0.001   0.496   1.663   2.145   3.281   5.709  16865    0  558    0    20717689          0       1189       2259  GET /api/player/player/:player_id
 8282   1737.356  0.2098  0.3054   0.001   0.115   0.496   0.726   1.548   4.304   8225    0   57    0   111293366          0      13437      16277  GET /api/player/competition/:competition_id/ranking
  186    184.292  0.9908  1.3804   0.002   0.387   2.940   3.674   6.649   8.259    182    0    4    0      464003          0       2494       7929  GET /api/organizer/billing HTTP/2.0
 1431     93.899  0.0656  0.1441   0.001   0.025   0.150   0.258   0.532   2.414   1419    0   12    0     1902324         39       1329       3650  GET /api/player/competitions HTTP/2.0
  130     86.039  0.6618  2.2996   0.000   0.124   0.538   2.130  15.411  16.271    128    0    2    0      173698          0       1336       1614  GET /api/admin/tenants/billing?querystring
   33     70.319  2.1309  4.6790   0.083   0.222   8.626  17.308  17.798  17.798     31    0    2    0      757789          0      22963      30740  POST /api/organizer/players/add HTTP/2.0
  228     30.575  0.1341  0.2849   0.001   0.066   0.266   0.352   1.173   3.446    223    0    5    0       12248         39         53         62  POST /api/organizer/competition/:competition_id/score
  200     22.733  0.1137  0.1434   0.014   0.082   0.208   0.340   0.989   1.173    199    0    1    0    11307393          0      56536     783027  GET /api/organizer/players HTTP/2.0
  205     17.401  0.0849  0.1981   0.001   0.022   0.197   0.304   0.814   1.966    204    0    1    0        4323         21         21         39  POST /api/organizer/competition/:competition_id/finish
  212     11.552  0.0545  0.1873   0.000   0.014   0.105   0.197   0.683   2.390    209    0    3    0       38016          0        179        219  POST /api/organizer/competitions/add HTTP/2.0
   11      5.988  0.5444  1.5091   0.022   0.042   0.249   5.312   5.312   5.312     11    0    0    0       17813       1585       1619       1656  GET /api/admin/tenants/billing HTTP/2.0
    1      0.925  0.9250  0.0000   0.925   0.925   0.925   0.925   0.925   0.925      1    0    0    0          55         55         55         55  POST /initialize HTTP/2.0
   15      0.609  0.0406  0.0589   0.001   0.006   0.099   0.220   0.220   0.220     14    0    1    0        2270         39        151        175  POST /api/organizer/player/:player_id/disqualified
   21      0.049  0.0023  0.0031   0.000   0.001   0.006   0.007   0.013   0.013     16    0    5    0        3225         39        153        207  POST /api/admin/tenants/add HTTP/2.0
    1      0.002  0.0020  0.0000   0.002   0.002   0.002   0.002   0.002   0.002      1    0    0    0         195        195        195        195  GET /api/organizer/competitions HTTP/2.0
    1      0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000      1    0    0    0        4868       4868       4868       4868  GET /css/app.83b4c321.css HTTP/2.0
    1      0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000      1    0    0    0         479        479        479        479  GET /index.html HTTP/2.0
    1      0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000      0    0    1    0         162        162        162        162  GET /mix/v1/stream?querystring
    1      0.000  0.0000  0.0000   0.000   0.000   0.000   0.000   0.000   0.000      1    0    0    0       33296      33296      33296      33296  GET /js/app.3a4ec98c.js HTTP/2.0

cureseven commented 11 months ago

e.Use(middleware.Logger()) コメントアウトします

mism-mism commented 11 months ago

nginxログ止めた

mism-mism commented 11 months ago

09:57:02.233130 ERROR[4] load: load-validation: GET /api/player/player/01HFXSQXE9GQDNZDVQPD8HGAAS : expected([200]) != actual(500) tenant:x-aari-1700733384 role:player playerID:01HFXSQXCGC7P4XHA9P9MK1WNC playerID:01HFXSQXE9GQDNZDVQPD8HGAAS                                                                                                                                                                              [75/8940]
09:57:02.233133 ERROR[5] load: load-validation: GET /api/player/player/01HFXSQSMMMSPHJSZ9SW8GR5Y8 : expected([200]) != actual(500) tenant:ragx-spym-1700733380 role:player playerID:01HFXSQSKV5CGKYEC8KN0F2FAY playerID:01HFXSQSMMMSPHJSZ9SW8GR5Y8
09:57:02.233136 ERROR[6] load: load-validation: GET /api/player/player/01HFXSQXFNGM0WBEW5W8D1SKRV : expected([200]) != actual(500) tenant:x-aari-1700733384 role:player playerID:01HFXSQXCY6X4JZ6H96SFVGK10 playerID:01HFXSQXFNGM0WBEW5W8D1SKRV
09:57:02.233140 ERROR[7] load: load-validation: GET /api/player/competition/01HFXSRWV3626XTJEWRZ1C31R3/ranking : expected([200]) != actual(500) tenant:njlpk-mws-47 role:player playerID:476b829ef competitionID:01HFXSRWV3626XTJEWRZ1C31R3 rankAfter:
09:57:02.233142 ERROR[8] load: load-validation: GET /api/player/player/01HFXSQP46DCVSFDYHFKF6RKPS : expected([200]) != actual(500) tenant:nqi-qf-1700733376 role:player playerID:01HFXSQP39T3J3NWTG5GSFE6G9 playerID:01HFXSQP46DCVSFDYHFKF6RKPS
09:57:02.233146 ERROR[9] load: load-validation: GET /api/player/player/01HFXSQN9KP0MPR411MZSB947S : expected([200]) != actual(500) tenant:surez-ykfbcl-1700733375 role:player playerID:01HFXSQNAY4K2KZZJ5EX3CXJ4P playerID:01HFXSQN9KP0MPR411MZSB947S
09:57:02.233149 ERROR[10] load: load-validation: GET /api/player/player/01HFXSQXEEJF6EZD9GHPEKD2XK : expected([200]) != actual(500) tenant:x-aari-1700733384 role:player playerID:01HFXSQXCG3JVRB6QKZRSE3XXR playerID:01HFXSQXEEJF6EZD9GHPEKD2XK
09:57:02.233152 ERROR[11] load: load-validation: GET /api/player/player/01HFXSQXG267V2KCER5YA3FP64 : expected([200]) != actual(500) tenant:x-aari-1700733384 role:player playerID:01HFXSQXD2QYQ361KXR0J5RJ02 playerID:01HFXSQXG267V2KCER5YA3FP64
09:57:02.233157 ERROR[12] load: load-validation: GET /api/player/competition/01HFXSR3Q37NASHHJR07JV8MRF/ranking : expected([200]) != actual(500) tenant:dcx-sd-1700733378 role:player playerID:01HFXSQQMQ910HE62SCQ29PHSE competitionID:01HFXSR3Q37NASHHJR07JV8MRF rankAfter:88
09:57:02.233160 ERROR[13] load: load-validation: GET /api/player/competition/01HFXSR8FGWZ77JYFXCDY0VFM6/ranking : expected([200]) != actual(500) tenant:nqi-qf-1700733376 role:player playerID:01HFXSQP3STNFNCZTFWREK5780 competitionID:01HFXSR8FGWZ77JYFXCDY0VFM6 rankAfter:38
09:57:02.233163 ERROR[14] load: load-validation: GET /api/player/player/01HFXSQPX3QWD1QQYG8F278ZV0 : expected([200]) != actual(500) tenant:ux-fdcbah-1700733377 role:player playerID:01HFXSQPVS78P6CTA8JMJZ007P playerID:01HFXSQPX3QWD1QQYG8F278ZV0
09:57:02.233166 ERROR[15] load: load-validation: GET /api/player/competition/01HFXSRJ75TKCZNHD2RTX1RFPX/ranking : expected([200]) != actual(500) tenant:emsy-vl-1700733388 role:player playerID:01HFXSR1MDADC4ZAZVEP4HHG3W competitionID:01HFXSRJ75TKCZNHD2RTX1RFPX rankAfter:
09:57:02.233170 ERROR[16] load: load-validation: GET /api/player/player/01HFXSRAJ0GY9SRB0MJZXZ1DBR : expected([200]) != actual(500) tenant:a-u-24 role:player playerID:01HFXSRFZS19V7J2RZWR709C0T playerID:01HFXSRAJ0GY9SRB0MJZXZ1DBR
09:57:02.233173 ERROR[17] load: load-validation: GET /api/player/player/505aa1900 : expected([200]) != actual(500) tenant:a-u-24 role:player playerID:01HFXSQZ4M6CJB17T6SW7GZVJK playerID:505aa1900
09:57:02.233177 ERROR[18] load: load-validation: GET /api/player/player/01HFXSQXCWCPH4EGQKRG8R15JS : expected([200]) != actual(500) tenant:x-aari-1700733384 role:player playerID:01HFXSQXC9Z5X6PG4S3FFDQSZ2 playerID:01HFXSQXCWCPH4EGQKRG8R15JS
09:57:02.233180 ERROR[19] load: load-validation: GET /api/player/player/01HFXSQTYSVRY6CAGTTGP352Z2 : expected([200]) != actual(500) tenant:dln-tlznoz-1700733381 role:player playerID:01HFXSQTWXW3VG1DJY90XAJE5S playerID:01HFXSQTYSVRY6CAGTTGP352Z2
09:57:02.233184 ERROR[20] load: load-validation: GET /api/player/competition/01HFXSRCARSNV6QYTPHMSM2BNA/ranking : expected([200]) != actual(500) tenant:d-l-1700733379 role:player playerID:01HFXSQRKWKB4VT1VW9GHF9R5E competitionID:01HFXSRCARSNV6QYTPHMSM2BNA rankAfter:41
09:57:02.233188 ERROR[21] load: load-validation: GET /api/player/player/01HFXSQN9KF3DZ01T0WGM2ST07 : expected([200]) != actual(500) tenant:surez-ykfbcl-1700733375 role:player playerID:01HFXSQNAQB739EFFYFQM03PES playerID:01HFXSQN9KF3DZ01T0WGM2ST07
09:57:02.233192 ERROR[22] load: load-validation: GET /api/player/player/01HFXSQQNV05Y1V6JJKNPHP1R3 : expected([200]) != actual(500) tenant:dcx-sd-1700733378 role:player playerID:01HFXSQQMW0E46SB969EGKM960 playerID:01HFXSQQNV05Y1V6JJKNPHP1R3
09:57:02.233195 ERROR[23] load: load-validation: GET /api/player/player/01HFXSQSNHSKK4WBSW2TNPX69J : expected([200]) != actual(500) tenant:ragx-spym-1700733380 role:player playerID:01HFXSQSK0RPN5F8JX0GQBZRR0 playerID:01HFXSQSNHSKK4WBSW2TNPX69J
09:57:02.233198 ERROR[24] load: load-validation: GET /api/player/player/01HFXSQND2SPQV4CYNC6VJKGF2 : expected([200]) != actual(500) tenant:surez-ykfbcl-1700733375 role:player playerID:01HFXSQNA1H1K3W8FFW017CWY9 playerID:01HFXSQND2SPQV4CYNC6VJKGF2
09:57:02.233205 ERROR[25] load: load-validation: GET /api/player/competition/01HFXSQNENQWDMWMWFZ39WE022/ranking : expected([200]) != actual(500) tenant:surez-ykfbcl-1700733375 role:player playerID:01HFXSQN9HDE2315YPX51HM0X3 competitionID:01HFXSQNENQWDMWMWFZ39WE022 rankAfter:
09:57:02.233208 ERROR[26] load: load-validation: GET /api/player/player/01HFXSQTXG91RQGM5AJXYW3T4S : expected([200]) != actual(500) tenant:dln-tlznoz-1700733381 role:player playerID:01HFXSQTXSFEGKFFE1SVAW84EP playerID:01HFXSQTXG91RQGM5AJXYW3T4S
09:57:02.233212 ERROR[27] load: load-validation: GET /api/player/player/01HFXSR1M0VBTKZM6W4G1ZM1N5 : expected([200]) != actual(500) tenant:a-u-24 role:player playerID:01HFXSR72JTVN58FM7TGDF3J18 playerID:01HFXSR1M0VBTKZM6W4G1ZM1N5
09:57:02.233215 ERROR[28] load: load-validation: GET /api/player/competition/01HFXSS08MAKHW1KF6YQJMZ3NF/ranking : expected([200]) != actual(500) tenant:nqi-qf-1700733376 role:player playerID:01HFXSQP4ATW4G51982V4E41HX competitionID:01HFXSS08MAKHW1KF6YQJMZ3NF rankAfter:75
09:57:02.233218 ERROR[29] load: load-validation: GET /api/player/player/01HFXSQTYSVRY6CAGTTGP352Z2 : expected([200]) != actual(500) tenant:dln-tlznoz-1700733381 role:player playerID:01HFXSQTVVDJPBH87FWCF36V97 playerID:01HFXSQTYSVRY6CAGTTGP352Z2
09:57:02.233220 ERRORは最大30件まで表示しています
[ADMIN] 09:57:02.233394 ScenarioScoreMap: map[string]int64{
  "AdminBilling":                      253,
  "AdminBillingValidate":              253,
  "OrganizerNewTenant":                8354,
  "OrganizerPeacefulTenant":           0,
  "OrganizerPopularTenant":            600,
  "OrganizerPopularTenantHeavyTenant": 478,
  "Player":                            18606,
  "PlayerHeavyTenant":                 1231,
  "PlayerValidate":                    597,
  "TenantBillingValidate":             639,
}
09:57:02.233521 Error 100 (Critical:0)
09:57:02.233524 PASSED: false
09:57:02.233527 SCORE: 0 (+31011 -31011(100%))
[ADMIN] 09:57:02.233510 WorkerCount: map[string]int{
  "AdminBillingScenarioWorker":   1,
  "AdminBillingValidateWorker":   1,
  "NewTenantScenarioWorker":      12,
  "PlayerScenarioWorker":         1096,
  "PlayerValidateScenarioWorker": 1,
  "PopularTenantScenarioWorker":  2,
  "TenantBillingValidateWorker":  1,
}

mism-mism commented 11 months ago

09:59:41.379924 ERROR[5] load: load-validation: GET /api/player/player/01HFXSW3FCFX4VCCN90KG55XE6 : expected([200]) != actual(500) tenant:eishp-tplp-1700733521 role:player playerID:01HFXSW3CERC21GEC0J516NXT6 playerID:01HFXSW3FCFX4VCCN90KG55XE6
09:59:41.379927 ERROR[6] load: load-validation: GET /api/player/competition/01HFXSXJ8AXMVWKEHP0GH67SAA/ranking : expected([200]) != actual(500) tenant:ghi-bgofp-1700733547 role:player playerID:01HFXSX5T1H5N70HYAEVSJV5CX competitionID:01HFXSXJ8AXMVWKEHP0GH67SAA rankAfter:
09:59:41.379931 ERROR[7] load: load-validation: GET /api/player/player/01HFXSWB8GHTZWJ8Q6A9S7NXMB : expected([200]) != actual(500) tenant:isucon role:player playerID:01HFXSWHR7JDVGBFGMGTW8CA32 playerID:01HFXSWB8GHTZWJ8Q6A9S7NXMB
09:59:41.379935 ERROR[8] load: load-validation: GET /api/player/player/01HFXSW7VXJ0PVW1GBFJT5XPTR : expected([200]) != actual(500) tenant:lz-y-1700733525 role:player playerID:01HFXSW7SGR5WJSXEKHTRVY72C playerID:01HFXSW7VXJ0PVW1GBFJT5XPTR
09:59:41.379938 ERROR[9] load: load-validation: GET /api/player/player/01HFXSW6W8VQA9B1NTDT4D9CJM : expected([200]) != actual(500) tenant:c-zi-1700733524 role:player playerID:01HFXSW6S7YKAFN8ZRSHKAS4VH playerID:01HFXSW6W8VQA9B1NTDT4D9CJM
09:59:41.379943 ERROR[10] load: load-validation: GET /api/player/player/3005f7dc3 : expected([200]) != actual(500) tenant:isucon role:player playerID:01HFXSWB67BY2J10BBBB999810 playerID:3005f7dc3
09:59:41.379947 ERROR[11] load: load-validation: GET /api/player/player/01HFXSWDBT3YGGXFR0NXNDK6H3 : expected([200]) != actual(500) tenant:lkd-xhzv-1700733531 role:player playerID:01HFXSWDAXBCDW2ZSNB2ME76JD playerID:01HFXSWDBT3YGGXFR0NXNDK6H3
09:59:41.379950 ERROR[12] load: load-validation: GET /api/player/player/01HFXSWDBAEMJ52X669QY5H8BW : expected([200]) != actual(500) tenant:lkd-xhzv-1700733531 role:player playerID:01HFXSWDA0BWWNWP8ZMV6VKXNS playerID:01HFXSWDBAEMJ52X669QY5H8BW
09:59:41.379954 ERROR[13] load: load-validation: GET /api/player/player/01HFXSWBX5ZQABJWT61FKVKCYX : expected([200]) != actual(500) tenant:jx-dzvzfy-1700733529 role:player playerID:01HFXSWBXETSM2AJ0HSSK97E8F playerID:01HFXSWBX5ZQABJWT61FKVKCYX
09:59:41.379957 ERROR[14] load: load-validation: GET /api/player/player/01HFXSWGE2QZRARQ14STX7TV4G : expected([200]) != actual(500) tenant:kfr-lnhsyu-1700733534 role:player playerID:01HFXSWGVHJMK4S11Q312WF10Z playerID:01HFXSWGE2QZRARQ14STX7TV4G
09:59:41.379961 ERROR[15] load: load-validation: GET /api/player/player/5ee8881fc : expected([200]) != actual(500) tenant:isucon role:player playerID:63c653770 playerID:5ee8881fc
09:59:41.379965 ERROR[16] load: load-validation: GET /api/player/player/01HFXSW3CFB1HHABSE6HFY8PRV : expected([200]) != actual(500) tenant:eishp-tplp-1700733521 role:player playerID:01HFXSW3AGX5Z6W7N6YE7SXV9E playerID:01HFXSW3CFB1HHABSE6HFY8PRV
09:59:41.379968 ERROR[17] load: load-validation: GET /api/player/player/01HFXSW3FKXSJE6J1GTJ1KPXK3 : expected([200]) != actual(500) tenant:eishp-tplp-1700733521 role:player playerID:01HFXSW3CATVH4TEGJEQ8J61AT playerID:01HFXSW3FKXSJE6J1GTJ1KPXK3
09:59:41.379974 ERROR[18] load: load-validation: GET /api/player/player/01HFXSWA7F2H9S3Z8Z53BRJ6TW : expected([200]) != actual(500) tenant:pgtgd-byaa-1700733528 role:player playerID:01HFXSWA7AAVZK4CCWP31ZVN01 playerID:01HFXSWA7F2H9S3Z8Z53BRJ6TW
09:59:41.379977 ERROR[19] load: load-validation: GET /api/player/player/01HFXSW3DZQ4346W0RF49CNZ1M : expected([200]) != actual(500) tenant:eishp-tplp-1700733521 role:player playerID:01HFXSW3DG0BREW1VE70SD1H3T playerID:01HFXSW3DZQ4346W0RF49CNZ1M
09:59:41.379980 ERROR[20] load: load-validation: GET /api/player/player/01HFXSW5S2Q4A6SXHZM4ARY482 : expected([200]) != actual(500) tenant:szpwb-jvodjw-1700733523 role:player playerID:01HFXSW5RD427JYX8E2Y9M733V playerID:01HFXSW5S2Q4A6SXHZM4ARY482
09:59:41.379984 ERROR[21] load: load-validation: GET /api/player/competition/01HFXSW5DV3YG2Q61GGKY3D0DB/ranking : expected([200]) != actual(500) tenant:eishp-tplp-1700733521 role:player playerID:01HFXSW3AX1CPFKZZS21NP8PY3 competitionID:01HFXSW5DV3YG2Q61GGKY3D0DB rankAfter:
09:59:41.379991 ERROR[22] load: load-validation: GET /api/player/competition/01HFXSXGREC89JK5FH6MVYC2SQ/ranking : expected([200]) != actual(500) tenant:jx-dzvzfy-1700733529 role:player playerID:01HFXSWBX7WDYRR0TSWRW24ZF8 competitionID:01HFXSXGREC89JK5FH6MVYC2SQ rankAfter:
09:59:41.379994 ERROR[23] load: load-validation: GET /api/player/player/01HFXSWGQEQ0ASR2V5PREGEN4E : expected([200]) != actual(500) tenant:kfr-lnhsyu-1700733534 role:player playerID:01HFXSWGS0DVH2WJEE2DET9E7N playerID:01HFXSWGQEQ0ASR2V5PREGEN4E
09:59:41.379997 ERROR[24] load: load-validation: GET /api/player/competition/01HFXSXGY00PSNM607P3XW7AJZ/ranking : expected([200]) != actual(500) tenant:pgtgd-byaa-1700733528 role:player playerID:01HFXSWA6T5N0A0NK6ZD79X55E competitionID:01HFXSXGY00PSNM607P3XW7AJZ rankAfter:
09:59:41.380000 ERROR[25] load: load-validation: GET /api/player/competition/01HFXSXHVNWT16B8CMDBKEPX3F/ranking : expected([200]) != actual(500) tenant:lkd-xhzv-1700733531 role:player playerID:01HFXSWDBJNB05TFMB6D9P7797 competitionID:01HFXSXHVNWT16B8CMDBKEPX3F rankAfter:44
09:59:41.380003 ERROR[26] load: load-validation: GET /api/player/competition/01HFXSWY1JPBD7KBHVK5P0Z947/ranking : expected([200]) != actual(500) tenant:lkd-xhzv-1700733531 role:player playerID:01HFXSWDAT34QADJCWXC3RFS0M competitionID:01HFXSWY1JPBD7KBHVK5P0Z947 rankAfter:
09:59:41.380006 ERROR[27] load: load-validation: GET /api/player/player/01HFXSW3FQZC9G64QEK47HRAK5 : expected([200]) != actual(500) tenant:eishp-tplp-1700733521 role:player playerID:01HFXSW3CN15E2N5XDSV4RVVZ3 playerID:01HFXSW3FQZC9G64QEK47HRAK5
09:59:41.380010 ERROR[28] load: load-validation: GET /api/player/player/01HFXSX63KAT1Q74FA9DASMTHT : expected([200]) != actual(500) tenant:ghi-bgofp-1700733547 role:player playerID:01HFXSXACF97FBCH3C106XTZDM playerID:01HFXSX63KAT1Q74FA9DASMTHT
09:59:41.380014 ERROR[29] load: load-validation: GET /api/player/player/01HFXSW3E53H6VJ71KSN4BERF4 : expected([200]) != actual(500) tenant:eishp-tplp-1700733521 role:player playerID:01HFXSW3CFZ4KJYYWRBAFH01ZY playerID:01HFXSW3E53H6VJ71KSN4BERF4
09:59:41.380016 ERRORは最大30件まで表示しています
[ADMIN] 09:59:41.380255 ScenarioScoreMap: map[string]int64{
  "AdminBilling":                      250,
  "AdminBillingValidate":              265,
  "OrganizerNewTenant":                8847,
  "OrganizerPeacefulTenant":           0,
  "OrganizerPopularTenant":            600,
  "OrganizerPopularTenantHeavyTenant": 478,
  "Player":                            24310,
  "PlayerHeavyTenant":                 1496,
  "PlayerValidate":                    682,
  "TenantBillingValidate":             606,
}
[ADMIN] 09:59:41.380442 WorkerCount: map[string]int{
  "AdminBillingScenarioWorker":   1,
  "AdminBillingValidateWorker":   1,
  "NewTenantScenarioWorker":      12,
  "PlayerScenarioWorker":         1123,
  "PlayerValidateScenarioWorker": 1,
  "PopularTenantScenarioWorker":  2,
  "TenantBillingValidateWorker":  1,
}
09:59:41.380517 Error 82 (Critical:2)
09:59:41.380561 PASSED: false
09:59:41.380598 SCORE: 0 (+37534 -37534(100%))

mism-mism commented 11 months ago

nginxノエラーログ

2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:46 [alert] 341731#341731: *30224 1024 worker_connections are not enough while connecting to upstream, client: 172.31.35.30, server: *.t.isucon.dev, request: "GET /api/player/competition/01HFXT493ZV7VQJTD7YZPPMGMT/ranking HTTP/2.0", upstream: "http://127.0.0.1:3000/api/player/competition/01HFXT493ZV7VQJTD7YZPPMGMT/ranking", host: "dyhl-spmm-1700733775.t.isucon.local"
2023/11/23 10:03:46 [alert] 341731#341731: *14838 1024 worker_connections are not enough while connecting to upstream, client: 172.31.35.30, server: *.t.isucon.dev, request: "GET /api/player/player/01HFXT3ZSS91W6M0W3MHZ94DE7 HTTP/2.0", upstream: "http://127.0.0.1:3000/api/player/player/01HFXT3ZSS91W6M0W3MHZ94DE7", host: "eeo-mrwfuj-1700733779.t.isucon.local"
2023/11/23 10:03:46 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:50 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:50 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
2023/11/23 10:03:51 [alert] 341731#341731: 1024 worker_connections are not enough
/var/log/nginx/error.log (END)

mism-mism commented 11 months ago

[ADMIN] 10:07:04.308082 ScenarioScoreMap: map[string]int64{
  "AdminBilling":                      255,
  "AdminBillingValidate":              317,
  "OrganizerNewTenant":                9686,
  "OrganizerPeacefulTenant":           0,
  "OrganizerPopularTenant":            600,
  "OrganizerPopularTenantHeavyTenant": 478,
  "Player":                            25598,
  "PlayerHeavyTenant":                 1547,
  "PlayerValidate":                    711,
  "TenantBillingValidate":             700,
}
10:07:04.308199 Error 0 (Critical:0)
10:07:04.308203 PASSED: true
10:07:04.308206 SCORE: 39892 (+39892 0(0%))

mism-mism commented 11 months ago

10:36:56.134062 PASSED: true
10:36:56.134065 SCORE: 43486 (+43486 0(0%))