setup Hitchwiki with ansible

[traumschule]

The ansible playbook (hitchwiki.yml) is a major step to make Hitchwiki v3 production ready. This branch aims for a stable and easy installation process. For future development see #172.

Test it!

git clone https://github.com/traumschule/hitchwiki -b ansible
./scripts/vagrant/install.sh
./scripts/deploy_remote.sh HOST

For details see INSTALL.md and ansible/README.md.

Changelog

Nov 18 Install Mediawiki without errors

Run ansible-playbook hitchwiki.yml until Import Mediawiki content, check debug output and fix the errors (See mw_import.yml)

• [X] Run Mediawiki install script (LocalSettings.php must be absent, or Cannot modify header information - headers already sent is risen) how to find BOMs backtrace
• [X] Setup database for several MW extensions (SemanticMediaWiki, AntiSpoof etc.)
• [X] Pre-populate the AntiSpoof extension's table
• [X] Create MediaWiki users
• [X] Import Semantic templates and other MediaWiki special pages
• [X] the MW update role has several errors, sometimes. automatic error correction would be great.
• [X] add security release: mediawiki-1.29.2.tar.gz (November 2017)

Nov 13 secure production setup (fixes #142)

• [X] Travis passes
• [X] test next ubuntu and debian with travis
• [X] make ansible branch clean to install via vagrant in one step
• [X] check if necessary variables are set: domain, env, admin_contact, dir.*, mediawiki.protocol, ...
• [X] update scripts INSTALL.md
• [X] implement tests to speed up the installer on reruns
• [X] daily dump with backupninja
• [X] #105 cache
• [X] #109 Setup cron jobs
• [X] #138 Override default user password
• [X] README.md: change travis badge to hItchwiki/master
• [X] use ansible-pull to deploy

Oct 28 deploy beta.hitchwiki.org with ansible

• [X] Monit: apache, mysql, parsoid, ssh
• [X] #127 https: Certbot / lets_encrypt module
• [X] Look into unix ACL stuff in roles/mw/tasks/main.yml
• [X] Move configs to yaml file (instead of ini file) https://github.com/Hitchwiki/hitchwiki/pull/164#issuecomment-337671250
• [X] Test loading settings with shyaml in configs/mediawiki.php and public/robots.txt.php (alternatives: spyc and below)
• [X] merge roles that won't be distributed to different hosts (eg. web mw dev), outsource groups of task to apps specific files, included conditionally (when clause)
• [X] auomate apache configuration
• [X] Fix Apache errors
  • [X] Apache: /var/www/public/.htaccess: Invalid command 'php_value' although mod_php is loaded => comment both lines and add them to /etc/php/7.0/cli/php.ini
  • [X] Apache: Could not reliably determine the server's fully qualified domain name although /etc/apache2/sites-enabled/hitchwiki.confdefines it => add ServerName outside of <VirtualHost
  • [X] Apache: index.php MWException from line 1205 of /home/hitchwiki/hitchwiki/public/wiki/includes/WebRequest.php: Unable to determine IP. => fix: add $_SERVER['REMOTE_ADDR'] = 'YOUR IP ADDRESS'; to Local Settings.php
• [X] Fix Mediawiki import errors
• [X] Configure Mediawiki logs path, now: $logDir = '/vagrant/logs' (./configs/mediawiki.php)
• [X] test TLS for staging (see INSTALL.md)
• [X] run post install scripts
• [X] add script to update LocalSettings.php

[simison]

@guaka or @omelnyk do you know how to read variables into Ansible from external config files (yaml/ini/json/whatnot)?

[guaka]

Just from .yml files

On Wed 18. Oct 2017 at 18:57, Mikael Korpela notifications@github.com wrote:

@guaka https://github.com/guaka or @omelnyk https://github.com/omelnyk do you know how to read variables into Ansible from external config files (yaml/ini/json/whatnot)?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Hitchwiki/hitchwiki/pull/164#issuecomment-337657160, or mute the thread https://github.com/notifications/unsubscribe-auth/AADVyENJw6zqUp8M6e-9szaPX7z313Qhks5sti3ygaJpZM4P8Pb6 .

-- sent from my phone

[simison]

Aight!

@traumschule so I guess this line in Mediawiki config needs to use PHP YAML then.

As for bash files, might be we won't have those left after Ansible but if they need access to settings, there's this: https://github.com/0k/shyaml

[simison]

Two other yaml readers for php that we can install via Composer: https://symfony.com/doc/current/components/yaml.html https://github.com/mustangostang/spyc/

[simison]

Use lets_encrypt module (and replace scripts/cert_selfsigned.sh)

cert_selfsigned.sh is still needed for dev environment, because lets encrypt works only for domains which are publicly accessible.

[simison]

Update migrations: scripts/bot/*

I think it's okay to let these read settings.ini, we'll just know to do that once we need to run the migration bot. Once migration is done, this whole directory is going to get wiped out anyway.

[guaka]

This week I put together some ansible code to deploy hitchwiki-private to a new server, it's almost done.

[guaka]

it's unfortunate but I don't think this will be (re)used - but please step up if you do want to (re)use some of this work