ouhft / COPE

Project Repository for Work Package 4 of the COPE Transplant Trial
https://cope.nds.ox.ac.uk
1 stars 0 forks source link

DEPLOY v0.8.0 #235

Closed marshalc closed 7 years ago

marshalc commented 7 years ago

Placeholder task for notes related to the live production deployment of this release.

marshalc commented 7 years ago

Steps planned so far:

  1. Take live site offline
  2. Copy data locally, and apply migration process
  3. Quick test of local data
  4. Merge Dev0.8.0 with Master
    • Then do a push to Github
    • Create a 0.8.0 release on Github from Master
  5. Test locally again
  6. Live Server updates:
    1. Patch Ubuntu, and restart
    2. Activate the virtualenv workon cope
    3. Move into the repository directory for most tasks cd cope-repo
    4. Get the latest updates from the central repository git pull --all
    5. Checkout the relevant tagged release (i.e. not Head of Master branch) git checkout 0.8.0
    6. Update the application libraries pip install -r requirements/production.txt
    7. Check things are working so far python manage.py check
    8. Apply any necessary migrations python manage.py migrate
    9. Gather the staticfiles up python manage.py collectstatic 10.Apply the locale updates python manage.py compilemessages
    10. Check things are working so far II python manage.py check
    11. Start the supervisor console to reload the changes sudo supervisorctl...
    12. and then restart cope-django
  7. Test the live site without making data changes
  8. Update cron with Follow Up task (#242)
marshalc commented 7 years ago

Site offline at 21/03/2017@00:45

marshalc commented 7 years ago

Last site activity was 20/03/2017@15:39. That version of the database is being used as the migration point

marshalc commented 7 years ago

Data migration applied without errors @00:53

marshalc commented 7 years ago

Codebase merged into Master through Testing branch from Dev0.8.0. Tagging 0.8.0 release.

marshalc commented 7 years ago

Codebase now updated on server. Slight issues with server config files that I've had to monkey patch (dbbackup.sh, etc) in between releases, but all captured in the codebase so just a case of remove and overwrite. @01:14

marshalc commented 7 years ago

Server updates... 6.i.

copeuser@cope:/sites/py3_cope/cope_repo$ sudo sudo apt-get update
[sudo] password for copeuser: 
Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Hit:2 http://gb.archive.ubuntu.com/ubuntu xenial InRelease
Get:3 http://gb.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:4 http://gb.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Get:5 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main Sources [237 kB]
Get:6 http://gb.archive.ubuntu.com/ubuntu xenial-updates/restricted Sources [2,996 B]
Get:7 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [496 kB]
Get:8 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main i386 Packages [486 kB]
Get:9 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main Translation-en [199 kB]
Get:10 http://gb.archive.ubuntu.com/ubuntu xenial-updates/restricted amd64 Packages [7,776 B]
Get:11 http://gb.archive.ubuntu.com/ubuntu xenial-updates/restricted i386 Packages [7,792 B]
Get:12 http://gb.archive.ubuntu.com/ubuntu xenial-updates/restricted Translation-en [2,548 B]
Get:13 http://gb.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [440 kB]
Get:14 http://gb.archive.ubuntu.com/ubuntu xenial-updates/universe i386 Packages [430 kB]
Get:15 http://gb.archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [168 kB]
Get:16 http://gb.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [8,652 B]
Get:17 http://gb.archive.ubuntu.com/ubuntu xenial-updates/multiverse i386 Packages [7,452 B]
Get:18 http://security.ubuntu.com/ubuntu xenial-security/main Sources [64.1 kB]
Get:19 http://security.ubuntu.com/ubuntu xenial-security/restricted Sources [2,600 B]
Get:20 http://security.ubuntu.com/ubuntu xenial-security/main amd64 Packages [232 kB]
Get:21 http://security.ubuntu.com/ubuntu xenial-security/main i386 Packages [223 kB]
Get:22 http://security.ubuntu.com/ubuntu xenial-security/main Translation-en [97.7 kB]
Get:23 http://security.ubuntu.com/ubuntu xenial-security/restricted amd64 Packages [7,428 B]
Get:24 http://security.ubuntu.com/ubuntu xenial-security/restricted i386 Packages [7,432 B]
Get:25 http://security.ubuntu.com/ubuntu xenial-security/restricted Translation-en [2,428 B]
Get:26 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 Packages [96.0 kB]
Get:27 http://security.ubuntu.com/ubuntu xenial-security/universe i386 Packages [87.4 kB]
Get:28 http://security.ubuntu.com/ubuntu xenial-security/universe Translation-en [51.4 kB]
Get:29 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [2,748 B]
Get:30 http://security.ubuntu.com/ubuntu xenial-security/multiverse i386 Packages [2,912 B]
Fetched 3,678 kB in 1s (3,175 kB/s)                    
Reading package lists... Done
copeuser@cope:/sites/py3_cope/cope_repo$ sudo apt-get upgrade
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
  linux-headers-4.4.0-59 linux-headers-4.4.0-59-generic linux-headers-4.4.0-64 linux-headers-4.4.0-64-generic linux-image-4.4.0-59-generic linux-image-4.4.0-64-generic
  linux-image-extra-4.4.0-59-generic linux-image-extra-4.4.0-64-generic
Use 'sudo apt autoremove' to remove them.
The following packages have been kept back:
  libcdt5 libcgraph6 libgraphviz-dev libgvc6 libgvpr2 libpathplan4 libxdot4
The following packages will be upgraded:
  grub-common grub-pc grub-pc-bin grub2-common init init-system-helpers libfreetype6
7 to upgrade, 0 to newly install, 0 to remove and 7 not to upgrade.
6 not fully installed or removed.
Need to get 3,653 kB of archives.
After this operation, 5,120 B of additional disk space will be used.
Do you want to continue? [Y/n] Y
Get:1 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main amd64 init-system-helpers all 1.29ubuntu4 [32.3 kB]
Get:2 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main amd64 init amd64 1.29ubuntu4 [4,624 B]
Get:3 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main amd64 grub-pc amd64 2.02~beta2-36ubuntu3.8 [197 kB]
Get:4 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main amd64 grub-pc-bin amd64 2.02~beta2-36ubuntu3.8 [888 kB]
Get:5 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main amd64 grub2-common amd64 2.02~beta2-36ubuntu3.8 [511 kB]
Get:6 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libfreetype6 amd64 2.6.1-0.1ubuntu2.1 [316 kB]
Get:7 http://gb.archive.ubuntu.com/ubuntu xenial-updates/main amd64 grub-common amd64 2.02~beta2-36ubuntu3.8 [1,704 kB]
Fetched 3,653 kB in 0s (19.8 MB/s) 
Preconfiguring packages ...
(Reading database ... 204821 files and directories currently installed.)
Preparing to unpack .../init-system-helpers_1.29ubuntu4_all.deb ...
Unpacking init-system-helpers (1.29ubuntu4) over (1.29ubuntu3) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up init-system-helpers (1.29ubuntu4) ...
(Reading database ... 204821 files and directories currently installed.)
Preparing to unpack .../init_1.29ubuntu4_amd64.deb ...
Unpacking init (1.29ubuntu4) over (1.29ubuntu3) ...
Setting up init (1.29ubuntu4) ...
(Reading database ... 204821 files and directories currently installed.)
Preparing to unpack .../grub-pc_2.02~beta2-36ubuntu3.8_amd64.deb ...
Unpacking grub-pc (2.02~beta2-36ubuntu3.8) over (2.02~beta2-36ubuntu3.7) ...
Preparing to unpack .../grub-pc-bin_2.02~beta2-36ubuntu3.8_amd64.deb ...
Unpacking grub-pc-bin (2.02~beta2-36ubuntu3.8) over (2.02~beta2-36ubuntu3.7) ...
Preparing to unpack .../grub2-common_2.02~beta2-36ubuntu3.8_amd64.deb ...
Unpacking grub2-common (2.02~beta2-36ubuntu3.8) over (2.02~beta2-36ubuntu3.7) ...
Preparing to unpack .../libfreetype6_2.6.1-0.1ubuntu2.1_amd64.deb ...
Unpacking libfreetype6:amd64 (2.6.1-0.1ubuntu2.1) over (2.6.1-0.1ubuntu2) ...
Preparing to unpack .../grub-common_2.02~beta2-36ubuntu3.8_amd64.deb ...
Unpacking grub-common (2.02~beta2-36ubuntu3.8) over (2.02~beta2-36ubuntu3.7) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for install-info (6.1.0.dfsg.1-5) ...
Processing triggers for libc-bin (2.23-0ubuntu5) ...
Processing triggers for systemd (229-4ubuntu16) ...
Processing triggers for ureadahead (0.100.0-19) ...
Setting up linux-image-4.4.0-67-generic (4.4.0-67.88) ...
Running depmod.
update-initramfs: deferring update (hook will be called later)
The link /initrd.img is a dangling linkto /boot/initrd.img-4.4.0-67-generic
vmlinuz(/boot/vmlinuz-4.4.0-67-generic
) points to /boot/vmlinuz-4.4.0-67-generic
 (/boot/vmlinuz-4.4.0-67-generic) -- doing nothing at /var/lib/dpkg/info/linux-image-4.4.0-67-generic.postinst line 491.
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-67-generic

gzip: stdout: No space left on device
E: mkinitramfs failure cpio 141 gzip 1
update-initramfs: failed for /boot/initrd.img-4.4.0-67-generic with 1.
run-parts: /etc/kernel/postinst.d/initramfs-tools exited with return code 1
Failed to process /etc/kernel/postinst.d at /var/lib/dpkg/info/linux-image-4.4.0-67-generic.postinst line 1052.
dpkg: error processing package linux-image-4.4.0-67-generic (--configure):
 subprocess installed post-installation script returned error exit status 2
dpkg: dependency problems prevent configuration of linux-image-extra-4.4.0-67-generic:
 linux-image-extra-4.4.0-67-generic depends on linux-image-4.4.0-67-generic; however:
  Package linux-image-4.4.0-67-generic is not configured yet.

dpkg: error processing package linux-image-extra-4.4.0-67-generic (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of linux-image-generic:
 linux-image-generic depends on linux-image-4.4.0-67-generic; however:
  Package linux-image-4.4.0-67-generic is not configured yet.
 linux-image-generic depends on linux-image-extra-4.4.0-67-generic; however:
  Package linux-image-extra-4.4.0-67-generic is not configured yet.

dpkg: error processing package linux-image-generic (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of linux-generic:
 linux-generic depends on linux-image-generic (= 4.4.0.67.72); however:
  Package linux-image-generic is not configured No apport report written because the error message indicates it's a follow-up error from a previous failure.
                                                                                                                                                            No apport report written because the error message indicates it's a follow-up error from a previous failure.
                                                                    No apport report written because MaxReports has already been reached
                                                                                                                                        No apport report written because MaxReports has already been reached
        yet.

dpkg: error processing package linux-generic (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of linux-generic-lts-vivid:
 linux-generic-lts-vivid depends on linux-generic; however:
  Package linux-generic is not configured yet.

dpkg: error processing package linux-generic-lts-vivid (--configure):
 dependency problems - leaving unconfigured
Setting up linux-image-extra-4.4.0-66-generic (4.4.0-66.87) ...
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-66-generic

gzip: stdout: No space left on device
E: mkinitramfs failure cpio 141 gzip 1
update-initramfs: failed for /boot/initrd.img-4.4.0-66-generic with 1.
run-parts: /etc/kernel/postinst.d/initramfs-tools exited with return code 1
dpkg: error processing package linux-image-extra-4.4.0-66-generic (--configure):
 subprocess installed post-installation script returned error exit status 1
No apport report written because MaxReports has already been reached
                                                                    Setting up libfreetype6:amd64 (2.6.1-0.1ubuntu2.1) ...
Setting up grub-common (2.02~beta2-36ubuntu3.8) ...
Installing new version of config file /etc/grub.d/10_linux ...
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
Setting up grub2-common (2.02~beta2-36ubuntu3.8) ...
Setting up grub-pc-bin (2.02~beta2-36ubuntu3.8) ...
Setting up grub-pc (2.02~beta2-36ubuntu3.8) ...
Installing for i386-pc platform.
Installation finished. No error reported.
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-4.4.0-67-generic
Found linux image: /boot/vmlinuz-4.4.0-66-generic
Found initrd image: /boot/initrd.img-4.4.0-66-generic
Found linux image: /boot/vmlinuz-4.4.0-65-generic
Found initrd image: /boot/initrd.img-4.4.0-65-generic
Found linux image: /boot/vmlinuz-4.4.0-64-generic
Found initrd image: /boot/initrd.img-4.4.0-64-generic
Found linux image: /boot/vmlinuz-4.4.0-59-generic
Found initrd image: /boot/initrd.img-4.4.0-59-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
Processing triggers for libc-bin (2.23-0ubuntu5) ...
Errors were encountered while processing:
 linux-image-4.4.0-67-generic
 linux-image-extra-4.4.0-67-generic
 linux-image-generic
 linux-generic
 linux-generic-lts-vivid
 linux-image-extra-4.4.0-66-generic
E: Sub-process /usr/bin/dpkg returned an error code (1)
copeuser@cope:/sites/py3_cope/cope_repo$ sudo apt-get upgrade
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
  linux-headers-4.4.0-59 linux-headers-4.4.0-59-generic linux-headers-4.4.0-64 linux-headers-4.4.0-64-generic linux-image-4.4.0-59-generic linux-image-4.4.0-64-generic
  linux-image-extra-4.4.0-59-generic linux-image-extra-4.4.0-64-generic
Use 'sudo apt autoremove' to remove them.
The following packages have been kept back:
  libcdt5 libcgraph6 libgraphviz-dev libgvc6 libgvpr2 libpathplan4 libxdot4
0 to upgrade, 0 to newly install, 0 to remove and 7 not to upgrade.
6 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Do you want to continue? [Y/n] Y
Setting up linux-image-4.4.0-67-generic (4.4.0-67.88) ...
Running depmod.
update-initramfs: deferring update (hook will be called later)
The link /initrd.img is a dangling linkto /boot/initrd.img-4.4.0-67-generic
vmlinuz(/boot/vmlinuz-4.4.0-67-generic
) points to /boot/vmlinuz-4.4.0-67-generic
 (/boot/vmlinuz-4.4.0-67-generic) -- doing nothing at /var/lib/dpkg/info/linux-image-4.4.0-67-generic.postinst line 491.
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-67-generic

gzip: stdout: No space left on device
E: mkinitramfs failure cpio 141 gzip 1
update-initramfs: failed for /boot/initrd.img-4.4.0-67-generic with 1.
run-parts: /etc/kernel/postinst.d/initramfs-tools exited with return code 1
Failed to process /etc/kernel/postinst.d at /var/lib/dpkg/info/linux-image-4.4.0-67-generic.postinst line 1052.
dpkg: error processing package linux-image-4.4.0-67-generic (--configure):
 subprocess installed post-installation script returned error exit status 2
dpkg: dependency problems prevent configuration of linux-image-extra-4.4.0-67-generic:
 linux-image-extra-4.4.0-67-generic depends on linux-image-4.4.0-67-generic; however:
  Package linux-image-4.4.0-67-generic is not configured yet.

dpkg: error processing package linux-image-extra-4.4.0-67-generic (--configure):
 dependency problems - leaving unconfigured
No apport report written because the error message indicates it's a follow-up error from a previous failure.
                                                                                                            dpkg: dependency problems prevent configuration of linux-image-generic:
 linux-image-generic depends on linux-image-4.4.0-67-generic; however:
  Package linux-image-4.4.0-67-generic is not configured yet.
 linux-image-generic depends on linux-image-extra-4.4.0-67-generic; however:
  Package linux-image-extra-4.4.0-67-generic is not configured yet.

dpkg: error processing package linux-image-generic (--configure):
 dependency problems - leaving unconfigured
No apport report written because the error message indicates it's a follow-up error from a previous failure.
                                                                                                            dpkg: dependency problems prevent configuration of linux-generic:
 linux-generic depends on linux-image-generic (= 4.4.0.67.72); however:
  Package linux-image-generic is not configured yet.

dpkg: error processing package linux-generic (--configure):
 dependency problems - leaving unconfigured
No apport report written because MaxReports has already been reached
                                                                    dpkg: dependency problems prevent configuration of linux-generic-lts-vivid:
 linux-generic-lts-vivid depends on linux-generic; however:
  Package linux-generic is not configured yet.

dpkg: error processing package linux-generic-lts-vivid (--configure):
 dependency problems - leaving unconfigured
No apport report written because MaxReports has already been reached
                                                                    Setting up linux-image-extra-4.4.0-66-generic (4.4.0-66.87) ...
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-66-generic

gzip: stdout: No space left on device
E: mkinitramfs failure cpio 141 gzip 1
update-initramfs: failed for /boot/initrd.img-4.4.0-66-generic with 1.
run-parts: /etc/kernel/postinst.d/initramfs-tools exited with return code 1
dpkg: error processing package linux-image-extra-4.4.0-66-generic (--configure):
 subprocess installed post-installation script returned error exit status 1
No apport report written because MaxReports has already been reached
                                                                    Errors were encountered while processing:
 linux-image-4.4.0-67-generic
 linux-image-extra-4.4.0-67-generic
 linux-image-generic
 linux-generic
 linux-generic-lts-vivid
 linux-image-extra-4.4.0-66-generic
E: Sub-process /usr/bin/dpkg returned an error code (1)
copeuser@cope:/sites/py3_cope/cope_repo$ sudo apt-get autoclean
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Del linux-headers-generic 4.4.0.64.68 [2,434 B]
Del linux-image-generic 4.4.0.67.72 [2,512 B]
Del linux-headers-generic-lts-vivid 4.4.0.67.72 [1,796 B]
Del linux-generic-lts-vivid 4.4.0.67.72 [1,804 B]
Del linux-generic-lts-vivid 4.4.0.64.68 [1,800 B]
Del linux-libc-dev 4.4.0-64.85 [834 kB]
Del linux-image-generic 4.4.0.64.68 [2,456 B]
Del linux-generic 4.4.0.67.72 [1,790 B]
Del linux-headers-generic 4.4.0.67.72 [2,464 B]
Del linux-headers-generic-lts-vivid 4.4.0.64.68 [1,798 B]
Del linux-generic 4.4.0.64.68 [1,784 B]
Del linux-libc-dev 4.4.0-66.87 [833 kB]
copeuser@cope:/sites/py3_cope/cope_repo$ sudo apt-get autoremove
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following packages will be REMOVED
  linux-headers-4.4.0-59 linux-headers-4.4.0-59-generic linux-headers-4.4.0-64 linux-headers-4.4.0-64-generic linux-image-4.4.0-59-generic linux-image-4.4.0-64-generic
  linux-image-extra-4.4.0-59-generic linux-image-extra-4.4.0-64-generic
0 to upgrade, 0 to newly install, 8 to remove and 7 not to upgrade.
6 not fully installed or removed.
After this operation, 593 MB disk space will be freed.
Do you want to continue? [Y/n] Y
(Reading database ... 204820 files and directories currently installed.)
Removing linux-headers-4.4.0-59-generic (4.4.0-59.80) ...
Removing linux-headers-4.4.0-59 (4.4.0-59.80) ...
Removing linux-headers-4.4.0-64-generic (4.4.0-64.85) ...
Removing linux-headers-4.4.0-64 (4.4.0-64.85) ...
Removing linux-image-extra-4.4.0-59-generic (4.4.0-59.80) ...
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-59-generic /boot/vmlinuz-4.4.0-59-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-59-generic /boot/vmlinuz-4.4.0-59-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-59-generic
run-parts: executing /etc/kernel/postinst.d/unattended-upgrades 4.4.0-59-generic /boot/vmlinuz-4.4.0-59-generic
run-parts: executing /etc/kernel/postinst.d/update-notifier 4.4.0-59-generic /boot/vmlinuz-4.4.0-59-generic
run-parts: executing /etc/kernel/postinst.d/zz-update-grub 4.4.0-59-generic /boot/vmlinuz-4.4.0-59-generic
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-4.4.0-67-generic
Found linux image: /boot/vmlinuz-4.4.0-66-generic
Found initrd image: /boot/initrd.img-4.4.0-66-generic
Found linux image: /boot/vmlinuz-4.4.0-65-generic
Found initrd image: /boot/initrd.img-4.4.0-65-generic
Found linux image: /boot/vmlinuz-4.4.0-64-generic
Found initrd image: /boot/initrd.img-4.4.0-64-generic
Found linux image: /boot/vmlinuz-4.4.0-59-generic
Found initrd image: /boot/initrd.img-4.4.0-59-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
Removing linux-image-4.4.0-59-generic (4.4.0-59.80) ...
Examining /etc/kernel/postrm.d .
run-parts: executing /etc/kernel/postrm.d/initramfs-tools 4.4.0-59-generic /boot/vmlinuz-4.4.0-59-generic
update-initramfs: Deleting /boot/initrd.img-4.4.0-59-generic
run-parts: executing /etc/kernel/postrm.d/zz-update-grub 4.4.0-59-generic /boot/vmlinuz-4.4.0-59-generic
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-4.4.0-67-generic
Found linux image: /boot/vmlinuz-4.4.0-66-generic
Found initrd image: /boot/initrd.img-4.4.0-66-generic
Found linux image: /boot/vmlinuz-4.4.0-65-generic
Found initrd image: /boot/initrd.img-4.4.0-65-generic
Found linux image: /boot/vmlinuz-4.4.0-64-generic
Found initrd image: /boot/initrd.img-4.4.0-64-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
The link /initrd.img is a damaged link
Removing symbolic link initrd.img 
 you may need to re-run your boot loader[grub]
The link /initrd.img.old is a damaged link
Removing symbolic link initrd.img.old 
 you may need to re-run your boot loader[grub]
Removing linux-image-extra-4.4.0-64-generic (4.4.0-64.85) ...
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-64-generic /boot/vmlinuz-4.4.0-64-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-64-generic /boot/vmlinuz-4.4.0-64-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-64-generic
run-parts: executing /etc/kernel/postinst.d/unattended-upgrades 4.4.0-64-generic /boot/vmlinuz-4.4.0-64-generic
run-parts: executing /etc/kernel/postinst.d/update-notifier 4.4.0-64-generic /boot/vmlinuz-4.4.0-64-generic
run-parts: executing /etc/kernel/postinst.d/zz-update-grub 4.4.0-64-generic /boot/vmlinuz-4.4.0-64-generic
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-4.4.0-67-generic
Found linux image: /boot/vmlinuz-4.4.0-66-generic
Found initrd image: /boot/initrd.img-4.4.0-66-generic
Found linux image: /boot/vmlinuz-4.4.0-65-generic
Found initrd image: /boot/initrd.img-4.4.0-65-generic
Found linux image: /boot/vmlinuz-4.4.0-64-generic
Found initrd image: /boot/initrd.img-4.4.0-64-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
Removing linux-image-4.4.0-64-generic (4.4.0-64.85) ...
Examining /etc/kernel/postrm.d .
run-parts: executing /etc/kernel/postrm.d/initramfs-tools 4.4.0-64-generic /boot/vmlinuz-4.4.0-64-generic
update-initramfs: Deleting /boot/initrd.img-4.4.0-64-generic
run-parts: executing /etc/kernel/postrm.d/zz-update-grub 4.4.0-64-generic /boot/vmlinuz-4.4.0-64-generic
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-4.4.0-67-generic
Found linux image: /boot/vmlinuz-4.4.0-66-generic
Found initrd image: /boot/initrd.img-4.4.0-66-generic
Found linux image: /boot/vmlinuz-4.4.0-65-generic
Found initrd image: /boot/initrd.img-4.4.0-65-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
Setting up linux-image-4.4.0-67-generic (4.4.0-67.88) ...
Running depmod.
update-initramfs: deferring update (hook will be called later)
vmlinuz(/boot/vmlinuz-4.4.0-67-generic
) points to /boot/vmlinuz-4.4.0-67-generic
 (/boot/vmlinuz-4.4.0-67-generic) -- doing nothing at /var/lib/dpkg/info/linux-image-4.4.0-67-generic.postinst line 491.
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/unattended-upgrades 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/update-notifier 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/zz-update-grub 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-4.4.0-67-generic
Found initrd image: /boot/initrd.img-4.4.0-67-generic
Found linux image: /boot/vmlinuz-4.4.0-66-generic
Found initrd image: /boot/initrd.img-4.4.0-66-generic
Found linux image: /boot/vmlinuz-4.4.0-65-generic
Found initrd image: /boot/initrd.img-4.4.0-65-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
Setting up linux-image-extra-4.4.0-67-generic (4.4.0-67.88) ...
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/unattended-upgrades 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/update-notifier 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
run-parts: executing /etc/kernel/postinst.d/zz-update-grub 4.4.0-67-generic /boot/vmlinuz-4.4.0-67-generic
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-4.4.0-67-generic
Found initrd image: /boot/initrd.img-4.4.0-67-generic
Found linux image: /boot/vmlinuz-4.4.0-66-generic
Found initrd image: /boot/initrd.img-4.4.0-66-generic
Found linux image: /boot/vmlinuz-4.4.0-65-generic
Found initrd image: /boot/initrd.img-4.4.0-65-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
Setting up linux-image-generic (4.4.0.67.72) ...
Setting up linux-generic (4.4.0.67.72) ...
Setting up linux-generic-lts-vivid (4.4.0.67.72) ...
Setting up linux-image-extra-4.4.0-66-generic (4.4.0-66.87) ...
run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
update-initramfs: Generating /boot/initrd.img-4.4.0-66-generic
run-parts: executing /etc/kernel/postinst.d/unattended-upgrades 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
run-parts: executing /etc/kernel/postinst.d/update-notifier 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
run-parts: executing /etc/kernel/postinst.d/zz-update-grub 4.4.0-66-generic /boot/vmlinuz-4.4.0-66-generic
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-4.4.0-67-generic
Found initrd image: /boot/initrd.img-4.4.0-67-generic
Found linux image: /boot/vmlinuz-4.4.0-66-generic
Found initrd image: /boot/initrd.img-4.4.0-66-generic
Found linux image: /boot/vmlinuz-4.4.0-65-generic
Found initrd image: /boot/initrd.img-4.4.0-65-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
copeuser@cope:/sites/py3_cope/cope_repo$ sudo apt-get autoclean
Reading package lists... Done
Building dependency tree       
Reading state information... Done
copeuser@cope:/sites/py3_cope/cope_repo$ sudo apt-get autoremove
Reading package lists... Done
Building dependency tree       
Reading state information... Done
0 to upgrade, 0 to newly install, 0 to remove and 7 not to upgrade.
copeuser@cope:/sites/py3_cope/cope_repo$ sudo apt-get upgrade
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Calculating upgrade... Done
The following packages have been kept back:
  libcdt5 libcgraph6 libgraphviz-dev libgvc6 libgvpr2 libpathplan4 libxdot4
0 to upgrade, 0 to newly install, 0 to remove and 7 not to upgrade.
copeuser@cope:/sites/py3_cope/cope_repo$ sudo sudo apt-get update
Hit:1 http://security.ubuntu.com/ubuntu xenial-security InRelease
Hit:2 http://gb.archive.ubuntu.com/ubuntu xenial InRelease
Hit:3 http://gb.archive.ubuntu.com/ubuntu xenial-updates InRelease
Hit:4 http://gb.archive.ubuntu.com/ubuntu xenial-backports InRelease
Reading package lists... Done                     
copeuser@cope:/sites/py3_cope/cope_repo$ sudo shutdown -r now
Connection to cope.nds.ox.ac.uk closed by remote host.
Connection to cope.nds.ox.ac.uk closed.
marshalc commented 7 years ago
iMacHome:~ carl$ ssh copeuser@cope.nds.ox.ac.uk
Welcome to Ubuntu 16.04.2 LTS (GNU/Linux 4.4.0-67-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

  System information as of Tue Mar 21 01:23:29 GMT 2017

  System load:  0.47               Processes:           130
  Usage of /:   16.6% of 47.84GB   Users logged in:     0
  Memory usage: 15%                IP address for eth0: 163.1.69.61
  Swap usage:   0%

  Graph this data and manage this system at:
    https://landscape.canonical.com/

22 packages can be updated.
2 updates are security updates.

You have new mail.
Last login: Tue Mar 21 00:44:14 2017 from 129.67.117.110

... that 22 packages message is a little concerning

marshalc commented 7 years ago

... and yet...

copeuser@cope:~$ sudo apt-get update
[sudo] password for copeuser: 
Hit:1 http://gb.archive.ubuntu.com/ubuntu xenial InRelease
Hit:2 http://gb.archive.ubuntu.com/ubuntu xenial-updates InRelease
Hit:3 http://gb.archive.ubuntu.com/ubuntu xenial-backports InRelease                                 
Hit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease                                    
Reading package lists... Done
copeuser@cope:~$ sudo apt-get upgrade
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Calculating upgrade... Done
The following packages have been kept back:
  libcdt5 libcgraph6 libgraphviz-dev libgvc6 libgvpr2 libpathplan4 libxdot4
0 to upgrade, 0 to newly install, 0 to remove and 7 not to upgrade.
copeuser@cope:~$ sudo apt-get check
Reading package lists... Done
Building dependency tree       
Reading state information... Done
copeuser@cope:~$ sudo apt-get autoclean
Reading package lists... Done
Building dependency tree       
Reading state information... Done
copeuser@cope:~$ sudo apt-get autoremove
Reading package lists... Done
Building dependency tree       
Reading state information... Done
0 to upgrade, 0 to newly install, 0 to remove and 7 not to upgrade.
copeuser@cope:~$ 
marshalc commented 7 years ago
  1. workon py3_cope
  2. cd /sites/py3_cope/cope_repo/
  3. pip install -U -r requirements/production.txt
  4. alias pm='python manage.py'
  5. pm check --> 0 issues :-)
  6. pm migrate --> No migrations to apply
  7. pm collectstatic
  8. pm compilemessages

Supervisorctl, start cope-django-py3...

And then we get the email saying the service is available again @01:34

marshalc commented 7 years ago

... and site loads. But then I get an application level 500 error on login attempt...

marshalc commented 7 years ago

Database was showing as being read-only. Changed the owner via sudo chown cope-app-user db.sqlite3 and login succeeded

marshalc commented 7 years ago

Site live.