Octopus and Barracuda Aegir with Nginx Edition A12.A on Xen HVM with 1GB RAM

[luiginica]

Hi. Amazing Grace :). Yes, I know... it's an amazing team, now that you are 3 :D

So.. I've tried Octopus A12.A and Everything seems fine but not for Apache Solr: ==> Thu Aug 26 23:13:45 CEST 2010 INIT C: Aegir automated install script part B ==> Thu Aug 26 23:13:45 CEST 2010 INIT C: Create directories ==> Thu Aug 26 23:13:54 CEST 2010 INIT C: Preparing Pressflow core, please wait.. mv: cannot stat `atrium_apachesolrsearch-6.x-1.0.tar.gz': No such file or directory tar: atrium_apachesolr_search-6.x-1.0.tar.gz: Cannot open: No such file or directory tar: Error is not recoverable: exiting now tar: Child returned status 2 tar: Exiting with failure status due to previous errors

Drupal 5 - do you want to include this distro? [Y/n] n ==> STATUS: Drupal 5 installation skipped If I understand, for an upgrade, all I have to do is to run bash Octopus.sh.txt again right? And mantain the host and user.

Have a nice day and good luck with the presentation of Aegir and Baracuda at Drupal Camp. It is an amazing job.

Luigi

[omega8cc]

I had to add also my team members, even if they helped me only today here, since yhahn already told me on the IRC that I'm probably high level multitasking team-bot ;) He suggested even that I should drink some alcohol or something in the presence of ericg to prove that I'm one-person-human :) OK, back to our oceanic monsters from the AEgir Kingdom!

For the problem with atrium_apachesolrsearch-6.x-1.0.tar.gz please blame joshk or anyone from Chapter Three, since it is a module from their feature server (connection issue during install maybe).

The good thing with code shared between instances is that you have to download the code for particular version only once, and then simply re-use it with symlinks created by Octopus on every new instance install.

As for upgrades - it will not upgrade sites (of course), only Aegir itself, and it will add new platforms so you will be able to properly use Aegir for check consistency, migrations and upgrading sites between available platforms created by Octopus.

Thanks for the nice wishes!

[luiginica]

:)) Yes.. Probably you work too much. You must take care of you. Please.

Back to Aegir, it wasn't a conection issue as I was able to get it from here: wget http://ftp.drupal.org/files/projects/apachesolr-6.x-1.0.tar.gz I am not sure that I get this right. Octopus will install Solr or us? Because here http://github.com/nlcluigi/nginx-for-drupal/blob/master/docs/SOLR.txt Albert said that we must do that?

After I want to do a bash Octopus again to see hot the upgrade works, I get this:

• Your e-mail address appears to be hi@kevero.com - is that correct?
• Your Aegir control panel for this instance will be available at http://host.kevero.com.
• Your Aegir user for this instance will be admin.

Do you want to proceed with the setup? [Y/n] y ==> Fri Aug 27 00:22:18 CEST 2010 INIT A: Welcome Linux keveroco.kevero.com 2.6.32-24-generic #42-Ubuntu SMP Fri Aug 20 14:24:04 UTC 2010 i686 GNU/Linux ==> Fri Aug 27 00:22:27 CEST 2010 INIT A: Aegir automated install script part A ==> Fri Aug 27 00:22:27 CEST 2010 INIT A: Stop the cron and wait 8 seconds.. ==> Fri Aug 27 00:22:37 CEST 2010 INIT A: Checking status.. ==> Fri Aug 27 00:22:46 CEST 2010 UPGRADE A: _STATUS is UPGRADE ==> Fri Aug 27 00:22:55 CEST 2010 UPGRADE A: Create directories and/or set good permissions ==> Fri Aug 27 00:23:04 CEST 2010 UPGRADE A: Prepare scripts ==> Fri Aug 27 00:23:13 CEST 2010 UPGRADE A: Run standard pre-installer ==> Fri Aug 27 00:23:31 CEST 2010 UPGRADE A: Run standard pre-installer completed ==> Fri Aug 27 00:23:31 CEST 2010 UPGRADE A: Switch user and run AegirSetupB ==> Fri Aug 27 00:23:40 CEST 2010 INIT B: Aegir automated install script part B ==> Fri Aug 27 00:23:40 CEST 2010 INIT B: Checking status.. ==> Fri Aug 27 00:23:49 CEST 2010 UPGRADE B: Create dirs and/or set good permissions ==> Fri Aug 27 00:23:58 CEST 2010 UPGRADE B: UPGRADE in progress.. ==> Fri Aug 27 00:23:58 CEST 2010 UPGRADE B: UPGRADE v.2 in progress.. ==> Fri Aug 27 00:23:58 CEST 2010 UPGRADE B: RAW _DOMAIN is host.kevero.com ==> Fri Aug 27 00:23:58 CEST 2010 UPGRADE B: Run standard installer ==> Fri Aug 27 00:24:10 CEST 2010 UPGRADE B: Drush seems to be functionning properly ==> Fri Aug 27 00:24:10 CEST 2010 UPGRADE B: Installing provision backend in /data/disk/admin/.drush ==> Fri Aug 27 00:24:18 CEST 2010 UPGRADE B: Build Aegir base ==> Fri Aug 27 00:24:27 CEST 2010 UPGRADE Hostmaster STATUS: Start, please wait... ==> Fri Aug 27 00:24:38 CEST 2010 UPGRADE Hostmaster STATUS: Completed ==> Fri Aug 27 00:24:38 CEST 2010 UPGRADE B: Simple check if Aegir install is successful ==> Fri Aug 27 00:24:47 CEST 2010 UPGRADE FATAL ERROR: Something is wrong, Aegir not ready - exit now ==> Fri Aug 27 00:24:47 CEST 2010 UPGRADE A: Run standard post-installer chgrp: cannot access /data/disk/admin/aegir/distro/002/sites/host.kevero.com/files': No such file or directory chgrp: cannot access/data/disk/admin/aegir/distro/002/sites/host.kevero.com/settings.php': No such file or directory /var/tmp/nginx-for-drupal/aegir/barracuda/AegirSetupA.sh.txt: line 256: cd: /data/disk/admin/aegir/distro/002: No such file or directory ==> Fri Aug 27 00:24:56 CEST 2010 UPGRADE A: Run standard post-installer completed ==> Fri Aug 27 00:24:56 CEST 2010 UPGRADE A: Set permissions for all chmod: cannot access /data/disk/admin/aegir/distro/002': No such file or directory ==> Fri Aug 27 00:25:05 CEST 2010 UPGRADE A: Switch user and run Distros build ==> Fri Aug 27 00:25:14 CEST 2010 INIT C: Aegir automated install script part B ==> Fri Aug 27 00:25:14 CEST 2010 INIT C: Create directories ==> Fri Aug 27 00:25:23 CEST 2010 INIT C: Preparing Pressflow core, please wait.. mv: cannot statatrium_apachesolrsearch-6.x-1.0.tar.gz': No such file or directory tar: atrium_apachesolr_search-6.x-1.0.tar.gz: Cannot open: No such file or directory tar: Error is not recoverable: exiting now tar: Child returned status 2 tar: Exiting with failure status due to previous errors

[luiginica]

It is a mess this paste. The important thing is that: ==> Fri Aug 27 00:24:47 CEST 2010 UPGRADE FATAL ERROR: Something is wrong, Aegir not ready - exit now

chgrp: cannot access /data/disk/admin/aegir/distro/002/sites/host.kevero.com/files': No such file or directory chgrp: cannot access/data/disk/admin/aegir/distro/002/sites/host.kevero.com/settings.php': No such file or directory /var/tmp/nginx-for-drupal/aegir/barracuda/AegirSetupA.sh.txt: line 256: cd: /data/disk/admin/aegir/distro/002: No such file or directory mv: cannot stat `atrium_apachesolrsearch-6.x-1.0.tar.gz': No such file or directory

atrium_apachesolrsearch-6.x-1.0.tar.gz is the same as apachesolr-6.x-1.0.tar.gz? I mean .. I can rename the archive?

[luiginica]

One suggestion: in the upgrade case you must tell "yes/no" at each platform: Put a dialog before platform installation: Do you want to include some distro's? Because if you don't want a platform, you must wait ~10sec for each "no".

[luiginica]

I will try again right now as I see some modifications in Barracuda and I will report you back. Btw. How we can uninstall Aegir? Because if we mess with different configs/overwrites we don't have a clean system anymore. Or what do we have to remove to be able to to a clean Aegir install again?

[luiginica]

No... It's the same thing. I will wait for the next push :)

==> Fri Aug 27 01:21:26 CEST 2010 UPGRADE B: Drush seems to be functionning properly ==> Fri Aug 27 01:21:26 CEST 2010 UPGRADE B: Installing provision backend in /data/disk/admin/.drush ==> Fri Aug 27 01:21:31 CEST 2010 UPGRADE B: Build Aegir base ==> Fri Aug 27 01:21:40 CEST 2010 UPGRADE Hostmaster STATUS: Start, please wait... AegirSetupB.sh.txt: line 259: cd: /data/disk/admin/aegir/distro/003: No such file or directory ==> Fri Aug 27 01:21:49 CEST 2010 UPGRADE Hostmaster STATUS: Completed ==> Fri Aug 27 01:21:49 CEST 2010 UPGRADE B: Simple check if Aegir install is successful ==> Fri Aug 27 01:21:58 CEST 2010 UPGRADE FATAL ERROR: Something is wrong, Aegir not ready - exit now ==> Fri Aug 27 01:21:58 CEST 2010 UPGRADE A: Run standard post-installer chgrp: cannot access /data/disk/admin/aegir/distro/004/sites/host.kevero.com/files': No such file or directory chgrp: cannot access/data/disk/admin/aegir/distro/004/sites/host.kevero.com/settings.php': No such file or directory /var/tmp/nginx-for-drupal/aegir/barracuda/AegirSetupA.sh.txt: line 256: cd: /data/disk/admin/aegir/distro/004: No such file or directory ==> Fri Aug 27 01:22:07 CEST 2010 UPGRADE A: Run standard post-installer completed ==> Fri Aug 27 01:22:07 CEST 2010 UPGRADE A: Set permissions for all chmod: cannot access /data/disk/admin/aegir/distro/004': No such file or directory ==> Fri Aug 27 01:22:16 CEST 2010 UPGRADE A: Switch user and run Distros build .... ==> Fri Aug 27 01:22:34 CEST 2010 INIT C: Preparing Pressflow core, please wait.. mv: cannot statatrium_apachesolrsearch-6.x-1.0.tar.gz': No such file or directory tar: atrium_apachesolr_search-6.x-1.0.tar.gz: Cannot open: No such file or directory

[luiginica]

Uffff..... All work good. I was wrong to do it with Octopus? Because Octopus failed to do the upgrade. But Barracuda succeed. So... all is fine now ;)

[omega8cc]

All installers will have enabled back the flag to exit early on the first error to avoid cascades of confusion and possibility to seriously break things (however it is easy to rollback, we just need to document it)

[omega8cc]

Re: "Put a dialog before platform installation: Do you want to include some distro's?" - good idea! Also, all 8s will be reduced to 3s.

[omega8cc]

Re: "How we can uninstall Aegir" - this is why I recommend to keep that instance created by Barracuda as a safe place to move platforms and sites in case something bad will happen to instance(s) created by Octopus. To start clean, you need to delete all databases created by Octopus, delete all system users (and crons) with home set to somewhere in /data/* and completely delete the /data directory plus all Nginx symlinks in /var/aegir/config/server_master/nginx/platform.d. Then Octopus will be able to start from scratch.

[luiginica]

You know ... I just tell you this ideas. I'm not complaining at all :) I know that you are busy. In fact this platform is a dream platform for me. And I'm afraid that this code will not remain free. It's just overwhelming :) I just remember how many post I have read about Nginx and config problems; Php-FPM - same things. Mercury.... what to say... hard to follow up if you are not on Amazon or Linode. And all that fight is gone now. We can do other things like ...sites? :D

[luiginica]

I will start over again I guess. I'm a perfectionist type of guy :( Too bad for me. You know .. .I have done some tests with Unix Byte regarding x32 systems vs x64: 4 CPU’s in system - Intel(R) Core(TM) i7 CPU 975 @ 3.33GHz (6683.9 bogomips) x32 System Benchmarks Index Score 1060 / 3549 x64 System Benchmarks Index Score 1474.6 / 4614.6 And I'm on x32 now because I was thinking that it will do a better memory management. But is not the case. So I want to go on x64. And also I want to setup in place a Back Up (And Restore) LVM Partitions With LVM Snapshots. That way I can have a little time machine there - because I like to test a lot :D Again ... congrats. I like Aegir. It's so complete. I can't imagine anything better. Ok... something with Munin or Cacti for server monitoring, bandwidth ... but that's not important.

[omega8cc]

Great, thank you for your feedback and good ideas.

[luiginica]

It is my pleasure ;)

[omega8cc]

Re: Solr - it is now installed by Barracuda, but you can disable it, if you wish.

[luiginica]

No... it will not be complete without it. It's the best. Maybe it will be a good ideea to have solr external ... like on another vps - Solr only.

[omega8cc]

It depends on how you will use Solr. If for search only and some views on not that busy site, it can live on the same server. We made it possible (in configuration) to run everything on the same 1 GB RAM VPS, but of course you can very easily deploy Solr on another server, using snippet from the Barracuda script.