Closed maller closed 11 years ago
Try to do:
/etc/init.d/tgt stop
There is some stupid conflict between tgt and iscsi-target i think.
Please be more specific and try to determine the problem (or the log errors ) before pasting all of this just like that.
I can't attach volume to my instances. I can start instances without volume, that work fine and i can create volume. My setup: 3 Nodes Control, Network and Computenode, i followed the Multinode Guide.
If i attached volume to any instances, they will be stay in attaching status. I test it about Horizon and CLI I become the same failure.
nova-compute.log from compute node 2013-04-24 10:55:21.182 ERROR nova.openstack.common.rpc.amqp [req-058903d8-2ff9-4fd0-9251-ab09b735b584 7e8cef045e0e46749fdb8fc7a0d91317 f438353be1494506b2950a5c9d79d374] Exception during message handling TRACE nova.openstack.common.rpc.amqp ConnectionError: [Errno 101] ENETUNREACH
@Dr4ik i have stop the tgt service, but the problem still exists
Am exactly seeing this error. 2013-04-24 10:55:21.182 ERROR nova.openstack.common.rpc.amqp [req-058903d8-2ff9-4fd0-9251-ab09b735b584 7e8cef045e0e46749fdb8fc7a0d91317 f438353be1494506b2950a5c9d79d374] Exception during message handling TRACE nova.openstack.common.rpc.amqp ConnectionError: [Errno 101] ENETUNREACH
It seems to me that we need to specify somewhere the Cinder details in nova-compute.conf.
You need to mount the cinder-volumes group inside each compute node ! If you do a vgdisplay in a compute node and you don't see the cinder-volumes volume group , that means you can't connect your VMs to your volumes !
2013/4/24 hrushig notifications@github.com
Am exactly seeing this error. 2013-04-24 10:55:21.182 ERROR nova.openstack.common.rpc.amqp [req-058903d8-2ff9-4fd0-9251-ab09b735b584 7e8cef045e0e46749fdb8fc7a0d91317 f438353be1494506b2950a5c9d79d374] Exception during message handling TRACE nova.openstack.common.rpc.amqp ConnectionError: [Errno 101] ENETUNREACH
It seems to me that we need to specify somewhere the Cinder details in nova-compute.conf.
— Reply to this email directly or view it on GitHubhttps://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/issues/35#issuecomment-16937152 .
Bilel Msekni | IT Engineer Mobile: +33 6 49 52 42 17
Adding this line to compute node's nova.conf helped resolve the issue. cinder_catalog_info=volume:cinder:internalURL
I understand it is an overhead on management network i.e. 10.10.10.x, but i can;t create and dedicate volume on each compute node. I guess your solution is to add multiple storage backend so that each compute node has its local cinder volume. Can you please suggest that in your documentation?
thanks, with this line works now.
Don't we need to document this?
Indeed Hrushig ! we need to ! But can you correct this for me please, if i want to add this to nova.conf in compute node, it should become like this : cinder_catalog_info=volume:cinder-volumes:10.10.10.51 right ?
I had to do two changes:
Control node (cinder.conf): don’t replace internalURL with ip address – just keep it as is.
volume_api_class=nova.volume.cinder.API osapi_volume_listen_port=5900 cinder_catalog_info=volume:cinder:internalURL
Compute node (nova.conf): iscsi_ip_address=10.10.10.51
From: SkiBLE [mailto:notifications@github.com] Sent: Friday, April 26, 2013 1:19 AM To: mseknibilel/OpenStack-Grizzly-Install-Guide Cc: Gangur, Hrushikesh (HP Converged Cloud - R&D - Sunnyvale) Subject: Re: [OpenStack-Grizzly-Install-Guide] stay in attaching status (#35)
Indeed Hrushig ! we need to ! But can you correct this for me please, if i want to add this to nova.conf in compute node, it should become like this : cinder_catalog_info=volume:cinder-volumes:10.10.10.51 right ?
— Reply to this email directly or view it on GitHubhttps://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/issues/35#issuecomment-17060830.
By control node, i think you mean change in nova.conf and not cinder.conf, am i correct ?
Best regards, Bilel
2013/4/26 hrushig notifications@github.com
I had to do two changes:
Control node (cinder.conf): don’t replace internalURL with ip address – just keep it as is.
Cinder
volume_api_class=nova.volume.cinder.API osapi_volume_listen_port=5900 cinder_catalog_info=volume:cinder:internalURL
Compute node (nova.conf): iscsi_ip_address=10.10.10.51
From: SkiBLE [mailto:notifications@github.com] Sent: Friday, April 26, 2013 1:19 AM To: mseknibilel/OpenStack-Grizzly-Install-Guide Cc: Gangur, Hrushikesh (HP Converged Cloud - R&D - Sunnyvale) Subject: Re: [OpenStack-Grizzly-Install-Guide] stay in attaching status (#35)
Indeed Hrushig ! we need to ! But can you correct this for me please, if i want to add this to nova.conf in compute node, it should become like this : cinder_catalog_info=volume:cinder-volumes:10.10.10.51 right ?
— Reply to this email directly or view it on GitHub< https://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/issues/35#issuecomment-17060830>.
— Reply to this email directly or view it on GitHubhttps://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/issues/35#issuecomment-17061074 .
Bilel Msekni | IT Engineer Mobile: +33 6 49 52 42 17
Sorry, to be clear on the instructions, here is what we need to get the cinder volume attach to active VM instance working:
This is to indicate that when we create volume, the iqn to record mgmt ip of controller node. By default, it uses external ip of controller node that is not reachable from compute node.
iscsi_ip_address=10.10.10.51
cinder_catalog_info=volume:cinder:internalURL
Additionally (and optional), and not sure if everyone will observe this issue. I had to change my cinder configuration reflect tgt and here are the instructions and explanation to do so:
If you are unable to attach an existing volume to an instance, you must switch from iet to tgt iscsi_helper mode in cinder.conf. The reason is mentioned in this Launchpad id https://bugs.launchpad.net/cinder/+bug/1096009
Error seen in nova-compute.log: – iscsiadm: No portal found –
Explanation – I noticed that some Cinder related install guides instructs you to install the "iscsitarget" package (that's the IET iSCSI target, instead of TGT) and enable it's user space components in "/etc/default/iscsitarget". When combined with the "cinder-volume" package, which (in Ubuntu 12.10) already depends on tgt by default, gives you two active iSCSI target daemons (yes, that's one to many). In this case it's possible (and most likely) that the IET iSCSI target starts earlier than the TGT one and blocks the default iSCSI port (3260) that prevents TGT to successfully start. When this happens Cinder's tgt-admin commands are send to the active IET iSCSI target which doesn't work (IET & TGT are two completely different iSCSI frameworks). This doesn't effect LVM volume creation because these are separate calls from the tgt-admin ones, so volumes are created successfully as you stated.
Check if, and more important which iSCSI target daemon is active on your system
1.ss -tuplen | grep 3260 It should show an active socket on tcp port 3260 with a tgtd process
If you're using Ubuntu 12.10 check if you have the package "iscsitarget" installed. Remove this and also the kernel module package "iscsitarget-dkms" if installed, after that restart all related OpenStack services or just reboot to be absolutely sure... –
Solution The instructions are as following:
Hrushig, is likely correct, I'm using ubuntu os deployed with MAAS server and TGT is either installed by default or comes with cinder, I had the problem of TGT starting first and having the port already, I haven't tested my volumes as yet but I've always used TGT in past installs , in fact if you do apt-get remove -s TGT you will see it also wants to remove cinder-volume so they are packaged together with Ubuntu by the looks of the dependencies
I have Verified this and it's working now thanks to hrushig's instructions ! Good Job man ! I have added you to the official contributor's list :+1:
Hi all.
I add the same problem. I could create volumes but they didn't attach to an existing instance. The work around that issue was:
1 - In Horizon, delete the volume that was created, because this one used tgt to create 2 - Stop tgt service --> tgt stop 3 - Restart iscsi --> service iscsitarget restart ; service open-iscsi restart 4 - In Horizon, create a new volume 5 - Then attach it to an instance
I hope that this helps
Cheers
@mseknibilel could you fix that in the main guide please !
Hello,
I can create a volume, but i can't attach this volume to a instances. It will be stay in attaching status.
Here are my Log files. Who can help me, where are my misstake?
cinder-api.log 2013-04-24 10:54:51 WARNING [cinder.openstack.common.policy] Inheritance-based rules are deprecated; use the default brain instead of HttpBrain. 2013-04-24 10:54:51 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail 2013-04-24 10:54:52 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail returned with HTTP 200 2013-04-24 10:54:53 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/types 2013-04-24 10:54:53 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/types returned with HTTP 200 2013-04-24 10:54:53 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/snapshots/detail 2013-04-24 10:54:53 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/snapshots/detail returned with HTTP 200 2013-04-24 10:54:53 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/os-quota-sets/f438353be1494506b2950a5c9d79d374 2013-04-24 10:54:53 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/os-quota-sets/f438353be1494506b2950a5c9d79d374 returned with HTTP 200 2013-04-24 10:54:53 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail 2013-04-24 10:54:53 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail returned with HTTP 200 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/types 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/types returned with HTTP 200 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/snapshots/detail 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/snapshots/detail returned with HTTP 200 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/os-quota-sets/f438353be1494506b2950a5c9d79d374 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/os-quota-sets/f438353be1494506b2950a5c9d79d374 returned with HTTP 200 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail returned with HTTP 200 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] POST http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes 2013-04-24 10:54:59 AUDIT [cinder.api.v1.volumes] Create volume of 10 GB 2013-04-24 10:54:59 INFO [cinder.openstack.common.rpc.common] Connected to AMQP server on localhost:5672 2013-04-24 10:54:59 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': 'nova', 'terminated_at': None, 'updated_at': None, 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': '9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': None, 'scheduled_at': None, 'status': 'creating', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': None, 'host': None, 'source_volid': None, 'provider_auth': None, 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59, 629295), 'attach_status': 'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x46015d0>, 'metadata': {}} 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes returned with HTTP 200 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail 2013-04-24 10:54:59 AUDIT [cinder.api.v1.volumes] vol=<cinder.db.sqlalchemy.models.Volume object at 0x4905c90> 2013-04-24 10:54:59 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail returned with HTTP 200 2013-04-24 10:55:00 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:00 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': None, 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'creating', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': None, 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': None, 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4a9da50>} 2013-04-24 10:55:00 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:02 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:02 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'available', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4befd50>} 2013-04-24 10:55:02 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:07 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail 2013-04-24 10:55:07 AUDIT [cinder.api.v1.volumes] vol=<cinder.db.sqlalchemy.models.Volume object at 0x4a9df90> 2013-04-24 10:55:07 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail returned with HTTP 200 2013-04-24 10:55:08 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:08 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'available', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4cde350>} 2013-04-24 10:55:08 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:11 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:11 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'available', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4ada510>} 2013-04-24 10:55:11 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:20 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'available', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4ab3090>} 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:20 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'available', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4911850>} 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] POST http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83/action 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83/action returned with HTTP 202 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:20 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4abb9d0>} 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail 2013-04-24 10:55:20 AUDIT [cinder.api.v1.volumes] vol=<cinder.db.sqlalchemy.models.Volume object at 0x4bbe150> 2013-04-24 10:55:20 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail returned with HTTP 200 2013-04-24 10:55:21 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:21 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4911990>} 2013-04-24 10:55:21 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:23 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:23 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4dddc50>} 2013-04-24 10:55:23 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:26 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:26 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4ce9e10>} 2013-04-24 10:55:26 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:39 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail 2013-04-24 10:55:39 AUDIT [cinder.api.v1.volumes] vol=<cinder.db.sqlalchemy.models.Volume object at 0x4ac1e90> 2013-04-24 10:55:39 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/detail returned with HTTP 200 2013-04-24 10:55:40 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:40 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4a9dad0>} 2013-04-24 10:55:40 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:42 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:42 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4acde10>} 2013-04-24 10:55:42 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:45 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:45 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x49b8610>} 2013-04-24 10:55:45 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:50 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:50 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4911bd0>} 2013-04-24 10:55:50 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:55:57 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:55:57 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4cc0450>} 2013-04-24 10:55:57 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:56:07 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:56:07 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4df0550>} 2013-04-24 10:56:07 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:56:20 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:56:20 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x49c3b90>} 2013-04-24 10:56:20 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:56:35 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:56:35 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x49d3910>} 2013-04-24 10:56:35 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:56:52 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:56:52 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4918ad0>} 2013-04-24 10:56:52 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:57:12 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:57:12 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4cba6d0>} 2013-04-24 10:57:12 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:57:35 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:57:35 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x499dd50>} 2013-04-24 10:57:35 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:58:00 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:58:00 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4aa4510>} 2013-04-24 10:58:00 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200 2013-04-24 10:58:27 INFO [cinder.api.openstack.wsgi] GET http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 2013-04-24 10:58:27 AUDIT [cinder.api.v1.volumes] vol={'volume_metadata': [], 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2013, 4, 24, 8, 55, 20), 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'9cff9422-de37-40e9-adb5-a28655871e83', 'size': 10L, 'user_id': u'7e8cef045e0e46749fdb8fc7a0d91317', 'attach_time': None, 'display_description': u'', 'project_id': u'f438353be1494506b2950a5c9d79d374', 'launched_at': datetime.datetime(2013, 4, 24, 8, 55), 'scheduled_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'status': u'attaching', 'volume_type_id': u'3aa61424-fb15-49b3-8955-9c2ea7772d10', 'deleted': False, 'provider_location': u'10.123.4.101:3260,1 iqn.2010-10.org.openstack:volume-9cff9422-de37-40e9-adb5-a28655871e83 0', 'volume_glance_metadata': [], 'host': u'controlnode', 'source_volid': None, 'provider_auth': u'CHAP Vv9G3g4km22Ed2cu4mD8 9cvgs23m8yGypfkctykU', 'display_name': u'admin', 'instance_uuid': None, 'created_at': datetime.datetime(2013, 4, 24, 8, 54, 59), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x4394090>} 2013-04-24 10:58:27 INFO [cinder.api.openstack.wsgi] http://10.123.4.101:8776/v1/f438353be1494506b2950a5c9d79d374/volumes/9cff9422-de37-40e9-adb5-a28655871e83 returned with HTTP 200
cinder-scheduler.log 2013-04-24 10:54:40 AUDIT [cinder.service] SIGTERM received 2013-04-24 10:54:41 AUDIT [cinder.service] Starting cinder-scheduler node (version 2013.1) 2013-04-24 10:54:41 INFO [cinder.openstack.common.rpc.common] Connected to AMQP server on localhost:5672 2013-04-24 10:54:41 INFO [cinder.openstack.common.rpc.common] Connected to AMQP server on localhost:5672
cinder-volume.log 2013-04-24 10:54:41 INFO [cinder.openstack.common.rpc.common] Connected to AMQP server on localhost:5672 2013-04-24 10:54:57 INFO [cinder.volume.manager] Updating volume status 2013-04-24 10:54:59 INFO [cinder.volume.manager] volume volume-9cff9422-de37-40e9-adb5-a28655871e83: creating 2013-04-24 10:55:00 INFO [cinder.volume.manager] volume volume-9cff9422-de37-40e9-adb5-a28655871e83: created successfully 2013-04-24 10:55:00 INFO [cinder.volume.manager] Clear capabilities 2013-04-24 10:55:57 INFO [cinder.volume.manager] Updating volume status 2013-04-24 10:56:57 INFO [cinder.volume.manager] Updating volume status 2013-04-24 10:57:57 INFO [cinder.volume.manager] Updating volume status
nova-compute.log 2013-04-24 10:55:21.182 ERROR nova.openstack.common.rpc.amqp [req-058903d8-2ff9-4fd0-9251-ab09b735b584 7e8cef045e0e46749fdb8fc7a0d91317 f438353be1494506b2950a5c9d79d374] Exception during message handling 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last): 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 430, in _process_data 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, _args) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 133, in dispatch 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, _kwargs) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp temp_level, payload) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in exit 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp self.gen.next() 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in wrapped 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp return f(self, context, _args, _kw) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209, in decorated_function 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp pass 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in exit 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp self.gen.next() 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195, in decorated_function 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp return function(self, context, _args, _kwargs) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237, in decorated_function 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info()) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in exit 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp self.gen.next() 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp return function(self, context, _args, _kwargs) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2833, in attach_volume 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp context, instance, mountpoint) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in exit 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp self.gen.next() 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2828, in attach_volume 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp mountpoint, instance) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2836, in _attach_volume 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp volume = self.volume_api.get(context, volume_id) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/volume/cinder.py", line 193, in get 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp self._reraise_translated_volume_exception(volume_id) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/volume/cinder.py", line 190, in get 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp item = cinderclient(context).volumes.get(volume_id) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinderclient/v1/volumes.py", line 180, in get 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp return self._get("/volumes/%s" % volume_id, "volume") 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinderclient/base.py", line 141, in _get 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp resp, body = self.api.client.get(url) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 185, in get 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp return self._cs_request(url, 'GET', _kwargs) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 153, in _cs_request 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp _kwargs) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 123, in request 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp _kwargs) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/requests/api.py", line 44, in request 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp return session.request(method=method, url=url, *_kwargs) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 279, in request 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp resp = self.send(prep, stream=stream, timeout=timeout, verify=verify, cert=cert, proxies=proxies) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 374, in send 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp r = adapter.send(request, **kwargs) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/requests/adapters.py", line 206, in send 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp raise ConnectionError(sockerr) 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp ConnectionError: [Errno 101] ENETUNREACH 2013-04-24 10:55:21.182 1277 TRACE nova.openstack.common.rpc.amqp