Closed Grabajuice closed 10 years ago
Thank you for the bug report and great information!
The issue lies in the special case for the 2.0.8 release of DSC: http://debian.datastax.com/community/pool/
I've fixed this with 9681985a87524982fe1896d43c16887064cb9fa7.
Let me know if you see any further issues!
I want to set up a complete new cluster with release 2.0.8, but it failed. For me the problem seems to be the release 2.0.8. Tests with --release 2.0.9 worked fine.
For testing I use this configuration. --clustername test --totalnodes 1 --version community --release 2.0.8 --opscenter no
Console: Exception seen in ds1_launcher.py. Please check ~/datastax_ami/ami.log for more info.
Please visit http://datastax.com/ami for this AMI's feature set.
ami.log: [EXEC] 07/24/14-15:26:11 git pull: Updating 5f722d6..e38ae0d Fast-forward README.md | 9 +- SWITCHES.md | 7 +- ami_ids.json | 22 +++++ community_cloud/README.md | 5 + community_cloud/cloudformation/README.md | 35 +++++++ .../cloudformation/cassandra-vpc.template | 103 ++++++++++++++++++++ ds1_launcher.py | 2 + ds2_configure.py | 103 ++++++++++++++------ ds4_motd.py | 7 +- logger.py | 2 +- presetup/setup.md | 4 +- 11 files changed, 261 insertions(+), 38 deletions(-) create mode 100644 ami_ids.json create mode 100644 community_cloud/README.md create mode 100644 community_cloud/cloudformation/README.md create mode 100644 community_cloud/cloudformation/cassandra-vpc.template
[EXEC] 07/24/14-15:26:11 git reset --hard: HEAD is now at e38ae0d In some VPC cases meta-data/public-hostname returns blanks. Account for these cases.
[EXEC:E] 07/24/14-15:26:11 gpg --import /home/ubuntu/datastax_ami/repo_keys/DataStax_AMI.7123CDFD.key: gpg: directory
/root/.gnupg' created gpg: new configuration file
/root/.gnupg/gpg.conf' created gpg: WARNING: options in/root/.gnupg/gpg.conf' are not yet active during this run gpg: keyring
/root/.gnupg/secring.gpg' created gpg: keyring `/root/.gnupg/pubring.gpg' created gpg: /root/.gnupg/trustdb.gpg: trustdb created gpg: key 7123CDFD: public key "Joaquin Casares (DataStax AMI) joaquin@datastax.com" imported gpg: Total number processed: 1 gpg: imported: 1 (RSA: 1)[EXEC] 07/24/14-15:26:11 git log --pretty="format:%G?" --show-signature HEAD^..HEAD: gpg: Signature made Fri Jul 18 22:50:44 2014 UTC using RSA key ID 7123CDFD gpg: Good signature from "Joaquin Casares (DataStax AMI) joaquin@datastax.com" gpg: WARNING: This key is not certified with a trusted signature! gpg: There is no indication that the signature belongs to the owner. Primary key fingerprint: 6273 EED3 28B4 B09B 2087 1C0E E711 FCAF 7123 CDFD G [EXEC] 07/24/14-15:26:11 sudo rm ds2_configure.py [INFO] Deleting ds2_configure.py now. This AMI will never change any configs after this first run. [EXEC] 07/24/14-15:26:11 sudo apt-key add /home/ubuntu/datastax_ami/repo_keys/Launchpad_VLC.C2518248EEA14886.key: OK
[EXEC] 07/24/14-15:26:11 sudo apt-key add /home/ubuntu/datastax_ami/repo_keys/Ubuntu_Archive.40976EAF437D05B5.key: OK
[EXEC] 07/24/14-15:26:11 sudo rm -rf /etc/motd [EXEC] 07/24/14-15:26:11 sudo touch /etc/motd [INFO] Started with user data set to: [INFO] --clustername test --totalnodes 1 --version community --release 2.0.8 --opscenter no [INFO] Using instance type: m3.large [INFO] meta-data:instance-type: m3.large [INFO] meta-data:local-ipv4: 10.107.24.50 [INFO] meta-data:public-hostname: ec2-54-74-10-193.eu-west-1.compute.amazonaws.com [INFO] meta-data:ami-launch-index: 0 [INFO] meta-data:reservation-id: r-ecae08ae [EXEC] 07/24/14-15:26:11 sudo ls: ami.conf ami_ids.json AMI_LICENSE.txt ami.log CHANGES.md community_cloud conf.py conf.pyc ds0_updater.py ds0_utils.py ds0_utils.pyc ds1_launcher.py ds1_launcher.pyc ds2_configure.pyc ds3_after_init.py ds4_motd.py EXPANDING.md FILES.md logger.py logger.pyc presetup README.md reflector.php repo_keys SWITCHES.md tokentool.html tokentoolv2.py
[INFO] Using cluster name: test [INFO] Using cluster size: 1 [INFO] Using seed indexes: [0, 1, 1] [PIPE] 07/24/14-15:26:11 echo "deb http://debian.datastax.com/community stable main" | sudo tee /etc/apt/sources.list.d/datastax.sources.list: deb http://debian.datastax.com/community stable main
[PIPE] 07/24/14-15:26:11 echo "deb http://debian.datastax.com/community stable main" | sudo tee /etc/apt/sources.list.d/datastax.sources.list: deb http://debian.datastax.com/community stable main
[EXEC] 07/24/14-15:26:11 sudo apt-key add /home/ubuntu/datastax_ami/repo_keys/DataStax.key: OK
[EXEC] 07/24/14-15:26:26 sudo apt-get update: Get:1 http://eu-west-1.ec2.archive.ubuntu.com precise Release.gpg [198 B] Get:2 http://eu-west-1.ec2.archive.ubuntu.com precise-updates Release.gpg [198 B] Get:3 http://ppa.launchpad.net precise Release.gpg [316 B] Hit http://eu-west-1.ec2.archive.ubuntu.com precise Release Get:4 http://ppa.launchpad.net precise Release [11.9 kB] Get:5 http://eu-west-1.ec2.archive.ubuntu.com precise-updates Release [49.6 kB] Get:6 http://ppa.launchpad.net precise/main Sources [1,253 B] Get:7 http://eu-west-1.ec2.archive.ubuntu.com precise/main Sources [934 kB] Get:8 http://ppa.launchpad.net precise/main amd64 Packages [2,826 B] Get:9 http://ppa.launchpad.net precise/main i386 Packages [2,826 B] Ign http://ppa.launchpad.net precise/main TranslationIndex Get:10 http://eu-west-1.ec2.archive.ubuntu.com precise/universe Sources [5,019 kB] Get:11 http://security.ubuntu.com precise-security Release.gpg [198 B] Ign http://ppa.launchpad.net precise/main Translation-en_US Ign http://ppa.launchpad.net precise/main Translation-en Get:12 http://debian.datastax.com stable Release.gpg [280 B] Get:13 http://security.ubuntu.com precise-security Release [49.6 kB] Get:14 http://eu-west-1.ec2.archive.ubuntu.com precise/main amd64 Packages [1,273 kB] Get:15 http://debian.datastax.com stable Release [2,870 B] Get:16 http://eu-west-1.ec2.archive.ubuntu.com precise/universe amd64 Packages [4,786 kB] Get:17 http://debian.datastax.com stable/main amd64 Packages [14.3 kB] Get:18 http://security.ubuntu.com precise-security/main Sources [107 kB] Get:19 http://debian.datastax.com stable/main i386 Packages [14.3 kB] Get:20 http://security.ubuntu.com precise-security/universe Sources [30.7 kB] Ign http://debian.datastax.com stable/main TranslationIndex Get:21 http://eu-west-1.ec2.archive.ubuntu.com precise/main i386 Packages [1,274 kB] Get:22 http://security.ubuntu.com precise-security/main amd64 Packages [414 kB] Get:23 http://eu-west-1.ec2.archive.ubuntu.com precise/universe i386 Packages [4,796 kB] Get:24 http://eu-west-1.ec2.archive.ubuntu.com precise/main TranslationIndex [3,706 B] Get:25 http://eu-west-1.ec2.archive.ubuntu.com precise/universe TranslationIndex [2,922 B] Get:26 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main Sources [475 kB] Get:27 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe Sources [108 kB] Get:28 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main amd64 Packages [821 kB] Get:29 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe amd64 Packages [244 kB] Get:30 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main i386 Packages [853 kB] Get:31 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe i386 Packages [251 kB] Get:32 http://security.ubuntu.com precise-security/universe amd64 Packages [94.3 kB] Ign http://debian.datastax.com stable/main Translation-en_US Get:33 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main TranslationIndex [3,564 B] Get:34 http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe TranslationIndex [2,850 B] Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main Translation-en Get:35 http://security.ubuntu.com precise-security/main i386 Packages [442 kB] Ign http://debian.datastax.com stable/main Translation-en Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe Translation-en Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main Translation-en Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe Translation-en Get:36 http://security.ubuntu.com precise-security/universe i386 Packages [99.7 kB] Get:37 http://security.ubuntu.com precise-security/main TranslationIndex [74 B] Get:38 http://security.ubuntu.com precise-security/universe TranslationIndex [73 B] Get:39 http://security.ubuntu.com precise-security/main Translation-en [189 kB] Get:40 http://security.ubuntu.com precise-security/universe Translation-en [57.8 kB] Fetched 22.4 MB in 8s (2,624 kB/s) Reading package lists...
[EXEC] 07/24/14-15:26:31 sudo apt-get update: Hit http://eu-west-1.ec2.archive.ubuntu.com precise Release.gpg Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates Release.gpg Hit http://eu-west-1.ec2.archive.ubuntu.com precise Release Hit http://ppa.launchpad.net precise Release.gpg Hit http://security.ubuntu.com precise-security Release.gpg Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates Release Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main Sources Hit http://ppa.launchpad.net precise Release Hit http://security.ubuntu.com precise-security Release Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe Sources Hit http://ppa.launchpad.net precise/main Sources Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main amd64 Packages Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe amd64 Packages Hit http://security.ubuntu.com precise-security/main Sources Hit http://ppa.launchpad.net precise/main amd64 Packages Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main i386 Packages Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe i386 Packages Hit http://security.ubuntu.com precise-security/universe Sources Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main TranslationIndex Hit http://ppa.launchpad.net precise/main i386 Packages Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe TranslationIndex Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main Sources Hit http://security.ubuntu.com precise-security/main amd64 Packages Ign http://ppa.launchpad.net precise/main TranslationIndex Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe Sources Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main amd64 Packages Hit http://security.ubuntu.com precise-security/universe amd64 Packages Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe amd64 Packages Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main i386 Packages Hit http://security.ubuntu.com precise-security/main i386 Packages Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe i386 Packages Hit http://security.ubuntu.com precise-security/universe i386 Packages Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main TranslationIndex Hit http://security.ubuntu.com precise-security/main TranslationIndex Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe TranslationIndex Hit http://eu-west-1.ec2.archive.ubuntu.com precise/main Translation-en Hit http://eu-west-1.ec2.archive.ubuntu.com precise/universe Translation-en Hit http://security.ubuntu.com precise-security/universe TranslationIndex Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/main Translation-en Hit http://eu-west-1.ec2.archive.ubuntu.com precise-updates/universe Translation-en Hit http://security.ubuntu.com precise-security/main Translation-en Hit http://security.ubuntu.com precise-security/universe Translation-en Ign http://ppa.launchpad.net precise/main Translation-en_US Ign http://ppa.launchpad.net precise/main Translation-en Get:1 http://debian.datastax.com stable Release.gpg [280 B] Get:2 http://debian.datastax.com stable Release [2,870 B] Get:3 http://debian.datastax.com stable/main amd64 Packages [14.3 kB] Get:4 http://debian.datastax.com stable/main i386 Packages [14.3 kB] Ign http://debian.datastax.com stable/main TranslationIndex Ign http://debian.datastax.com stable/main Translation-en_US Ign http://debian.datastax.com stable/main Translation-en Fetched 31.8 kB in 2s (15.9 kB/s) Reading package lists...
[INFO] Performing deployment install... [EXEC] 07/24/14-15:26:36 sudo mv /etc/security/limits.d/cassandra.conf /etc/security/limits.d/cassandra.conf.bak [EXEC] 07/24/14-15:26:36 sudo apt-get install -y python-cql datastax-agent cassandra=2.0.8 dsc20=2.0.8-1: Reading package lists... Building dependency tree... Reading state information...
[ERROR] 07/24/14-15:26:36 sudo service cassandra stop: cassandra: unrecognized service
[EXEC] 07/24/14-15:26:36 sudo rm -rf /var/lib/cassandra [EXEC] 07/24/14-15:26:36 sudo rm -rf /var/log/cassandra [EXEC] 07/24/14-15:26:36 sudo mkdir -p /var/lib/cassandra [EXEC] 07/24/14-15:26:36 sudo mkdir -p /var/log/cassandra [ERROR] 07/24/14-15:26:36 sudo chown -R cassandra:cassandra /var/lib/cassandra: chown: invalid user: `cassandra:cassandra'
[ERROR] 07/24/14-15:26:36 sudo chown -R cassandra:cassandra /var/log/cassandra: chown: invalid user: `cassandra:cassandra'
[EXEC] 07/24/14-15:26:36 sudo mv /etc/security/limits.d/cassandra.conf.bak /etc/security/limits.d/cassandra.conf [INFO] Reflector loop... [INFO] 07/24/14-15:26:37 Reflector: Received 1 of 1 responses from: [u'10.107.24.50'] [INFO] Seed list: set([u'10.107.24.50']) [INFO] OpsCenter: 10.107.24.50 [INFO] Options: Namespace(analyticsnodes=0, base64postscript=None, cfsreplication=None, clustername='test', customreservation=None, email=None, hadoop=False, heapsize=None, opscenter='no', opscenterinterface=None, opscenteronly=False, opscenterssl=False, password=None, raidonly=False, realtimenodes=1, reflector=None, release='2.0.8', rpcbinding=False, searchnodes=0, seed_indexes=[0, 1, 1], totalnodes=1, username=None, version='community') [ERROR] Exception seen in ds1_launcher.py: Traceback (most recent call last): File "/home/ubuntu/datastax_ami/ds1_launcher.py", line 22, in initial_configurations ds2_configure.run() File "/home/ubuntu/datastax_ami/ds2_configure.py", line 1051, in run File "/home/ubuntu/datastax_ami/ds2_configure.py", line 513, in construct_yaml IOError: [Errno 2] No such file or directory: '/etc/cassandra/cassandra.yaml'