ebu / OSCIED

Open Source Cloud Infrastructure for Encoding and Distribution
Other
16 stars 2 forks source link

Storage : Slave of a cluster fail to gather infos from deleted volume ... Ben oui #50

Closed davidfischer-ch closed 11 years ago

davidfischer-ch commented 11 years ago
2013-05-23 23:47:26,897 unit:oscied-storage/0: hook.executor DEBUG: Running hook: /var/lib/juju/units/oscied-storage-0/charm/hooks/peer-relation-changed
2013-05-23 23:47:27,610 unit:oscied-storage/0: unit.hook.api DEBUG: Get unit setting: 'private-address'
2013-05-23 23:47:27,902 unit:oscied-storage/0: unit.hook.api DEBUG: Get unit setting: 'public-address'
2013-05-23 23:47:28,196 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] Load metadatas from file metadata.yaml
2013-05-23 23:47:28,484 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] My __dict__ is {'local_config': {'volume_flag': False, 'volume_infos_regex': <_sre.SRE_Pattern object at 0x2a9d810>, '_pickle_filename': 'local_config.pkl', 'allowed_ips': ''}, 'name': 'oscied-storage/0', 'public_address': 'ec2-54-224-238-23.compute-1.amazonaws.com', 'env_uuid': 'c21d6b29f3b44ed3a8762e29586c4bc8', 'private_address': 'ip-10-242-229-176.ec2.internal', 'juju_log': <function callable_command at 0x2d150c8>, 'config': {u'allowed_ips': u'*', 'verbose': True, u'replica_count': 2}, 'juju_ok': True, 'metadata': {'peers': {'peer': {'interface': 'glusterfs-peers'}}, 'maintainer': 'OSCIED Main Developper <david.fischer.ch@gmail.com>', 'description': "Installs the EBU's OSCIED shared storage based on glusterfs.\n", 'provides': {'storage': {'interface': 'mount'}}, 'name': 'oscied-storage', 'ensemble': 'oscied', 'summary': "EBU's OSCIED Storage"}}
2013-05-23 23:47:28,781 unit:oscied-storage/0: unit.hook.api INFO: --> Entering StorageHooks.py
2013-05-23 23:47:29,069 unit:oscied-storage/0: unit.hook.api INFO: [HOOK] Execute StorageHooks hook peer-relation-changed
2013-05-23 23:47:29,660 unit:oscied-storage/0: unit.hook.api INFO: [INFO] Peer address is ip-10-101-59-119.ec2.internal
2013-05-23 23:47:29,952 unit:oscied-storage/0: unit.hook.api INFO: [INFO] Open required ports
2013-05-23 23:47:30,593 unit:oscied-storage/0: unit.hook.api DEBUG: opened 24010/tcp
2013-05-23 23:47:30,988 provision:ec2: juju.ec2 DEBUG: Opened 24010/tcp on provider machine 'i-b46807de'
2013-05-23 23:47:31,564 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] id=0 ids=[1]
2013-05-23 23:47:31,909 unit:oscied-storage/0: unit.hook.api INFO: [INFO] As leader, probe remote peer ip-10-101-59-119.ec2.internal and create or expand volume medias_volume_0
2013-05-23 23:47:32,257 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] Execute gluster peer probe ip-10-101-59-119.ec2.internal
2013-05-23 23:47:35,895 unit:oscied-storage/1: unit.hook.api INFO: [DEBUG] id=1 ids=[0]
2013-05-23 23:47:37,518 unit:oscied-storage/0: unit.hook.api INFO: [INFO] Create and start a replica=2 volume medias_volume_0 with 2 bricks
2013-05-23 23:47:37,796 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] Execute gluster volume create medias_volume_0  replica 2 transport tcp ip-10-242-229-176.ec2.internal:/exp0 ip-10-101-59-119.ec2.internal:/exp0
2013-05-23 23:47:44,857 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] Execute gluster volume start medias_volume_0 
2013-05-23 23:47:58,952 unit:oscied-storage/1: unit.hook.api INFO: [INFO] As slave, stop and delete my own volume medias_volume_1
2013-05-23 23:48:13,326 unit:oscied-storage/1: unit.hook.api INFO: [DEBUG] Execute gluster volume info medias_volume_1 
2013-05-23 23:48:13,768 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] Execute gluster volume info medias_volume_0 
2013-05-23 23:48:13,917 unit:oscied-storage/1: unit.hook.api INFO: [DEBUG] {'returncode': 255, 'stderr': '', 'stdout': 'Volume medias_volume_1 does not exist\n'}
2013-05-23 23:48:14,133 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] Volume infos stdout: '\nVolume Name: medias_volume_0\nType: Replicate\nStatus: Started\nNumber of Bricks: 2\nTransport-type: tcp\nBricks:\nBrick1: ip-10-242-229-176.ec2.internal:/exp0\nBrick2: ip-10-101-59-119.ec2.internal:/exp0\n'
2013-05-23 23:48:14,220 unit:oscied-storage/1: unit.hook.api INFO: Exception caught:
2013-05-23 23:48:14,406 unit:oscied-storage/0: unit.hook.api INFO: [INFO] {'status': 'Started', 'name': 'medias_volume_0', 'bricks': ['ip-10-242-229-176.ec2.internal:/exp0', 'ip-10-101-59-119.ec2.internal:/exp0'], 'auth_allow': '', 'type': 'Replicate', 'transport': 'tcp'}
2013-05-23 23:48:14,521 unit:oscied-storage/1: unit.hook.api INFO: 
2013-05-23 23:48:14,685 unit:oscied-storage/0: unit.hook.api INFO: [DEBUG] Execute gluster volume rebalance medias_volume_0 status
2013-05-23 23:48:14,823 unit:oscied-storage/1: unit.hook.api INFO: <-- Exiting StorageHooks.py
2013-05-23 23:48:14,854 unit:oscied-storage/1: hook.output INFO: Traceback (most recent call last):
  File "lib/StorageHooks.py", line 219, in <module>
    DEFAULT_OS_ENV).trigger()
  File "/var/lib/juju/units/oscied-storage-1/charm/lib/CharmHooks.py", line 313, in trigger
    getattr(self, 'hook_%s' % hook_name.replace('-', '_'))()
  File "lib/StorageHooks.py", line 179, in hook_peer_relation_joined
    if self.volume in self.volumes:
  File "lib/StorageHooks.py", line 51, in volumes
    return re.findall('Name:\s*(\S*)', self.volume_do('info', volume='')['stdout'])
  File "lib/StorageHooks.py", line 89, in volume_do
    input=input, cli_input=cli_input, fail=fail)
  File "/var/lib/juju/units/oscied-storage-1/charm/lib/CharmHooks.py", line 291, in cmd
    return cmd(command, input=input, cli_input=cli_input, fail=fail, log=self.debug)
  File "/usr/local/lib/python2.7/dist-packages/pyutils-1.0-py2.7.egg/pyutils/pyutils.py", line 119, in cmd
    raise subprocess.CalledProcessError(process.returncode, command, stderr)
subprocess.CalledProcessError: Command 'gluster volume info medias_volume_1 ' returned non-zero exit status 255