search

opengridcc / website

1 stars 10 forks source link

/usr/bin/uwsgi runs 3 times on the droplet #43

Closed saroele closed 8 years ago

saroele commented 8 years ago

Can we shut down two of those processes? They use too much memory on our memory-constrained infrastructure :-)

extract from ps aux:

www-data  7411  0.0  9.5 231448 48132 ?        S    Jan28   0:51 /usr/bin/uwsgi --ini /usr/share/uwsgi conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemoni
www-data  7424  0.0  9.6 232216 48264 ?        S    Jan28   0:04 /usr/bin/uwsgi --ini /usr/share/uwsgi/conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemoni
www-data  7425  0.0  9.5 232216 48124 ?        S    Jan28   0:02 /usr/bin/uwsgi --ini /usr/share/uwsgi/conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemoni
wouterh commented 8 years ago

are you sure it's running 3 times? It's probably a master process and 2 worker processes. Can you run ps aufx ?

saroele commented 8 years ago

Maybe you're right. Here's the output of ps aufx

USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         2  0.0  0.0      0     0 ?        S     2015   0:00 [kthreadd]
root         3  0.0  0.0      0     0 ?        S     2015   0:53  \_ [ksoftirqd/0]
root         5  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [kworker/0:0H]
root         7  0.0  0.0      0     0 ?        S     2015   0:00  \_ [migration/0]
root         8  0.0  0.0      0     0 ?        S     2015   0:00  \_ [rcu_bh]
root         9  0.0  0.0      0     0 ?        S     2015   0:00  \_ [rcuob/0]
root        10  0.0  0.0      0     0 ?        S     2015 182:05  \_ [rcu_sched]
root        11  0.0  0.0      0     0 ?        S     2015 204:22  \_ [rcuos/0]
root        12  0.0  0.0      0     0 ?        S     2015   3:22  \_ [watchdog/0]
root        13  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [khelper]
root        14  0.0  0.0      0     0 ?        S     2015   0:00  \_ [kdevtmpfs]
root        15  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [netns]
root        16  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [writeback]
root        17  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [kintegrityd]
root        18  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [bioset]
root        19  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [kworker/u3:0]
root        20  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [kblockd]
root        21  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [ata_sff]
root        22  0.0  0.0      0     0 ?        S     2015   0:00  \_ [khubd]
root        23  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [md]
root        24  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [devfreq_wq]
root        27  0.0  0.0      0     0 ?        S     2015   0:14  \_ [khungtaskd]
root        28  0.0  0.0      0     0 ?        S     2015   2:22  \_ [kswapd0]
root        29  0.0  0.0      0     0 ?        SN    2015   0:00  \_ [ksmd]
root        30  0.0  0.0      0     0 ?        S     2015   0:00  \_ [fsnotify_mark]
root        31  0.0  0.0      0     0 ?        S     2015   0:00  \_ [ecryptfs-kthrea]
root        32  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [crypto]
root        44  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [kthrotld]
root        46  0.0  0.0      0     0 ?        S     2015   0:00  \_ [scsi_eh_0]
root        47  0.0  0.0      0     0 ?        S     2015   0:00  \_ [scsi_eh_1]
root        68  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [deferwq]
root        69  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [charger_manager]
root       120  0.0  0.0      0     0 ?        S     2015   9:08  \_ [jbd2/vda-8]
root       121  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [ext4-rsv-conver]
root       122  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [ext4-unrsv-conv]
root       319  0.0  0.0      0     0 ?        S     2015   0:00  \_ [vballoon]
root       322  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [kpsmoused]
root       335  0.0  0.0      0     0 ?        S     2015   0:00  \_ [kworker/0:2]
root       353  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [ttm_swap]
root       515  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [kvm-irqfd-clean]
root      1487  0.0  0.0      0     0 ?        S     2015   0:00  \_ [kauditd]
root      8887  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [kworker/u3:1]
root     24123  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [xfsalloc]
root     24124  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [xfs_mru_cache]
root     24125  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [xfslogd]
root     24128  0.0  0.0      0     0 ?        S     2015   0:00  \_ [jfsIO]
root     24129  0.0  0.0      0     0 ?        S     2015   0:00  \_ [jfsCommit]
root     24130  0.0  0.0      0     0 ?        S     2015   0:00  \_ [jfsSync]
root     24149  0.0  0.0      0     0 ?        S<    2015   0:00  \_ [bioset]
root     20670  0.0  0.0      0     0 ?        S    Jan15   1:03  \_ [kworker/0:1]
root     24660  0.0  0.0      0     0 ?        S    11:50   0:00  \_ [kworker/u2:0]
root     24694  0.0  0.0      0     0 ?        S    12:05   0:00  \_ [kworker/u2:1]
root         1  0.0  0.3  33428  1608 ?        Ss    2015   1:09 /sbin/init
root       557  0.0  0.1  15520   752 ?        S     2015   0:00 upstart-socket-bridge --daemon
message+   579  0.0  0.2  39356  1076 ?        Ss    2015   0:01 dbus-daemon --system --fork
syslog     676  0.0  5.6 256612 28460 ?        Ssl   2015   2:22 rsyslogd
root       701  0.0  0.0  15272   452 ?        S     2015   0:00 upstart-file-bridge --daemon
root       769  0.0  0.0  15816   168 tty4     Ss+   2015   0:00 /sbin/getty -8 38400 tty4
root       773  0.0  0.0  15816   168 tty5     Ss+   2015   0:00 /sbin/getty -8 38400 tty5
root       778  0.0  0.0  15816   172 tty2     Ss+   2015   0:00 /sbin/getty -8 38400 tty2
root       779  0.0  0.0  15816   164 tty3     Ss+   2015   0:00 /sbin/getty -8 38400 tty3
root       781  0.0  0.0  15816   168 tty6     Ss+   2015   0:00 /sbin/getty -8 38400 tty6
root       811  0.0  0.0   4364   136 ?        Ss    2015   0:00 acpid -c /etc/acpi/events -s /var/run/acpid.socket
root       812  0.0  0.1  23652   572 ?        Ss    2015   0:59 cron
daemon     814  0.0  0.0  19136   168 ?        Ss    2015   0:01 atd
root      1453  0.0  0.0  15816   168 tty1     Ss+   2015   0:00 /sbin/getty -8 38400 tty1
www-data  7411  0.0  9.1 231448 46004 ?        S    Jan28   0:56 /usr/bin/uwsgi --ini /usr/share/uwsgi/conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemonize /var/l
www-data  7424  0.0  9.6 232216 48232 ?        S    Jan28   0:05  \_ /usr/bin/uwsgi --ini /usr/share/uwsgi/conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemonize /v
www-data  7425  0.0  9.5 232216 48168 ?        S    Jan28   0:03  \_ /usr/bin/uwsgi --ini /usr/share/uwsgi/conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemonize /v
root     14063  0.0  0.0  19472   196 ?        S    Feb04   0:00 upstart-udev-bridge --daemon
root     14066  0.0  0.0  51112   444 ?        Ss   Feb04   0:00 /lib/systemd/systemd-udevd --daemon
root     14710  0.0  0.2  43448  1168 ?        Ss   Feb04   0:00 /lib/systemd/systemd-logind
root     15168  0.0  0.1  61368   908 ?        Ss   Feb04   0:00 /usr/sbin/sshd -D
root     24704  0.1  0.8 105632  4252 ?        Ss   12:33   0:00  \_ sshd: saroele [priv]
saroele  24782  0.0  0.3 105632  1880 ?        S    12:34   0:00      \_ sshd: saroele@pts/0 
saroele  24783  0.6  0.7  22608  3784 pts/0    Ss   12:34   0:00          \_ -bash
saroele  24797  0.0  0.2  18572  1252 pts/0    R+   12:34   0:00              \_ ps aufx
whoopsie 15990  0.0  0.2 335696  1232 ?        Ssl  Feb04   0:00 whoopsie
root     16140  0.0  0.2  90236  1180 ?        S    Feb04   0:00 nginx: master process /usr/sbin/nginx
www-data 16141  0.0  0.4  90912  2288 ?        S    Feb04   0:00  \_ nginx: worker process
saroele  22720  0.0  0.1  24824   720 ?        S    Feb04   0:10 top
wouterh commented 8 years ago

So, it's a master process and two workers:

www-data  7411  0.0  9.1 231448 46004 ?        S    Jan28   0:56 /usr/bin/uwsgi --ini /usr/share/uwsgi/conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemonize /var/l
www-data  7424  0.0  9.6 232216 48232 ?        S    Jan28   0:05  \_ /usr/bin/uwsgi --ini /usr/share/uwsgi/conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemonize /v
www-data  7425  0.0  9.5 232216 48168 ?        S    Jan28   0:03  \_ /usr/bin/uwsgi --ini /usr/share/uwsgi/conf/default.ini --ini /etc/uwsgi/apps-enabled/opengrid.ini --daemonize /v

We can probably make it 1 worker...

saroele commented 8 years ago

Actually, the cron jobs seem to work well now, so no immediate need to save on memory use. Is there a way to monitor the load on these workers? If the load is low anyway, we could indeed reduce to 1 worker.

saroele commented 8 years ago

I propose to close this issue as we don't seem to have performance issues lately.