search

zstackio / zstack

ZStack - the open-source IaaS software http://zstack.org (国内用户请至 http://zstack.io)
Apache License 2.0
1.3k stars 392 forks source link

update zstacak from 1.0 to1.0.4,it is sucessful,but after restart zstack , it can not connet host #244

Closed fudingsheng closed 8 years ago

fudingsheng commented 8 years ago

{ "org.zstack.header.host.APIReconnectHostEvent": { "success": false, "apiId": "f8262b3af7b041c084553961c0905115", "headers": { "schema": {} }, "error": { "code": "HOST.1002", "cause": { "code": "HOST.1002", "cause": { "code": "HOST.1003", "cause": { "code": "SYS.1006", "description": "An operation failed", "details": "invalid literal for long() with base 10: ''" }, "description": "An error happened when connecting to host", "details": "invalid literal for long() with base 10: ''" }, "description": "Unable to reconnect host", "details": "invalid literal for long() with base 10: ''" }, "description": "Unable to reconnect host", "details": "invalid literal for long() with base 10: ''" }, "id": "da1897ae4ef449d88af2e6466e208d7d", "creatingTime": 1458702777393 } }

youyk commented 8 years ago

@fudingsheng could you join ZStack QQ group 410185063 . We need the Exception log in management-server.log to analyze the issue.

fudingsheng commented 8 years ago

ok ,this is the Exception log

fudingsheng commented 8 years ago

2016-03-23 05:55:31,186 DEBUG HostBase Host HOST03 [uuid:ede4ffe9a0044daf9fcce84f7c673d2c] changed connection state from Disconnected to Connecting 2016-03-23 05:55:31,186 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-ede4ffe9a0044daf9fcce84f7c673d2c] starts 2016-03-23 05:55:31,186 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-ede4ffe9a0044daf9fcce84f7c673d2c] start executing flow[apply-ansible-playbook] 2016-03-23 05:55:31,194 DEBUG HostBase Host HOST2 [uuid:7efe5ae38aed4aa49def6d80bfed1141] changed connection state from Disconnected to Connecting 2016-03-23 05:55:31,195 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-7efe5ae38aed4aa49def6d80bfed1141] starts 2016-03-23 05:55:31,195 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-7efe5ae38aed4aa49def6d80bfed1141] start executing flow[apply-ansible-playbook] 2016-03-23 05:55:31,213 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"055e8e6e243146c9b08da392e275d171","from":"Unknown","to":"Running","originalHostUuid":"7efe5ae38aed4aa49def6d80bfed1141","currentHostUuid":"7efe5ae38aed4aa49def6d80bfed1141"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"7b2837baa37b4510baa25483f2ccb392","creatingTime":1458726791128}} 2016-03-23 05:55:31,221 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"683e2a430d344be5a7a7667a44e49d4b","from":"Unknown","to":"Running","originalHostUuid":"7efe5ae38aed4aa49def6d80bfed1141","currentHostUuid":"7efe5ae38aed4aa49def6d80bfed1141"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"c90432014f6c4a0495ecd1fec4fb8ec4","creatingTime":1458726791136}} 2016-03-23 05:55:31,222 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"21b1b7b6248548c1a9cb04e2c055222c","from":"Unknown","to":"Running","originalHostUuid":"7efe5ae38aed4aa49def6d80bfed1141","currentHostUuid":"7efe5ae38aed4aa49def6d80bfed1141"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"a2897b1980e942bba8695b9318345681","creatingTime":1458726791136}} 2016-03-23 05:55:31,223 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"654388dac9da47738d11a3d66970d742","from":"Unknown","to":"Running","originalHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c","currentHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"453e58a7c3be4ce091598bc1ac92987d","creatingTime":1458726791137}} 2016-03-23 05:55:31,224 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"a188bac4cbbd4cd081a741508843d484","from":"Unknown","to":"Running","originalHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c","currentHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"138d86d1ada3446aa036bf56149465d2","creatingTime":1458726791137}} 2016-03-23 05:55:31,224 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"33157dee412847a590d713cdea0144bc","from":"Unknown","to":"Running","originalHostUuid":"7efe5ae38aed4aa49def6d80bfed1141","currentHostUuid":"7efe5ae38aed4aa49def6d80bfed1141"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"25b89b7b670347d68338ec7d1db3bb83","creatingTime":1458726791137}} 2016-03-23 05:55:31,224 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"651e379d283a47728b307315ba22654c","from":"Unknown","to":"Running","originalHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c","currentHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"a7c0cbf9343e4b8ba93239f84cc6a1fb","creatingTime":1458726791137}} 2016-03-23 05:55:31,225 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"cee4e1d63a214c33a0e0ed6856c0506b","from":"Unknown","to":"Running","originalHostUuid":"7efe5ae38aed4aa49def6d80bfed1141","currentHostUuid":"7efe5ae38aed4aa49def6d80bfed1141"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"9f8f6767bf7d42de888003fd1ebddb3e","creatingTime":1458726791137}} 2016-03-23 05:55:31,225 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"d67955ab30b44775a4a7d90c5b4d1d16","from":"Unknown","to":"Running","originalHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c","currentHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"ea10f009d67e45d99de9cdcb7b23433c","creatingTime":1458726791137}} 2016-03-23 05:55:31,226 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"ec7a5eb78a6e46e0916dd82102b694c0","from":"Unknown","to":"Running","originalHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c","currentHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"1ce5807c9cc44b02aa137f8dc137e4a8","creatingTime":1458726791137}} 2016-03-23 05:55:31,226 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"cbba610a17db4e7eb414314a36cca6da","from":"Unknown","to":"Running","originalHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c","currentHostUuid":"ede4ffe9a0044daf9fcce84f7c673d2c"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"390b93e7145142038b54ac9d34a15989","creatingTime":1458726791137}} 2016-03-23 05:55:31,229 TRACE CloudBusImpl2 [event received]: {"org.zstack.core.cloudbus.CanonicalEvent":{"path":"/vmTracer/vmStateChanged","content":{"vmUuid":"fe3d090f07934661891b25e1d6aea9ea","from":"Unknown","to":"Running","originalHostUuid":"7efe5ae38aed4aa49def6d80bfed1141","currentHostUuid":"7efe5ae38aed4aa49def6d80bfed1141"},"type":{"_name":"key.event.LOCAL.canonicalEvent"},"headers":{"schema":{"org.zstack.header.vm.VmTracerCanonicalEvents$VmStateChangedData":["content"]}},"id":"872a8a10e89e4b2fab19cfdaf033819a","creatingTime":1458726791145}} 2016-03-23 05:55:31,556 TRACE Ssh [start SSH] md5sum /var/lib/zstack/kvm/zstacklib-1.0.tar.gz 2016-03-23 05:55:31,580 TRACE Ssh [end SSH] md5sum /var/lib/zstack/kvm/zstacklib-1.0.tar.gz 2016-03-23 05:55:31,581 TRACE Ssh ssh execution[host: 103.30.54.210, port:22] command: md5sum /var/lib/zstack/kvm/zstacklib-1.0.tar.gz cost time: 384ms

2016-03-23 05:55:31,582 DEBUG ShellUtils exec shell command[sudo md5sum /usr/local/zstack/apache-tomcat-7.0.35/webapps/zstack/WEB-INF/classes/ansible/zstacklib/zstacklib-1.0.tar.gz] 2016-03-23 05:55:31,599 TRACE ShellUtils shell command[sudo md5sum /usr/local/zstack/apache-tomcat-7.0.35/webapps/zstack/WEB-INF/classes/ansible/zstacklib/zstacklib-1.0.tar.gz] costs 18ms to finish 2016-03-23 05:55:31,607 DEBUG VolumeManagerImpl [Volume Expunging Task]: no volume to expunge 2016-03-23 05:55:31,619 DEBUG VmInstanceManagerImpl [VM Expunging Task]: no vm to expunge 2016-03-23 05:55:31,620 TRACE Ssh [start SSH] md5sum /var/lib/zstack/kvm/kvmagent-1.0.tar.gz 2016-03-23 05:55:31,637 DEBUG ImageManagerImpl [Image Expunge Task]: no images to expunge 2016-03-23 05:55:31,637 TRACE Ssh [end SSH] md5sum /var/lib/zstack/kvm/kvmagent-1.0.tar.gz 2016-03-23 05:55:31,637 TRACE Ssh ssh execution[host: 103.30.54.210, port:22] command: md5sum /var/lib/zstack/kvm/kvmagent-1.0.tar.gz cost time: 38ms

fudingsheng commented 8 years ago

2016-03-23 05:55:31,638 DEBUG ShellUtils exec shell command[sudo md5sum /usr/local/zstack/apache-tomcat-7.0.35/webapps/zstack/WEB-INF/classes/ansible/kvm/kvmagent-1.0.tar.gz] 2016-03-23 05:55:31,651 TRACE ShellUtils shell command[sudo md5sum /usr/local/zstack/apache-tomcat-7.0.35/webapps/zstack/WEB-INF/classes/ansible/kvm/kvmagent-1.0.tar.gz] costs 14ms to finish 2016-03-23 05:55:31,651 DEBUG AnsibleRunner agent port[7070] on target ip[103.30.54.210] is opened, ansible module[kvm.yaml] is not changed, skip to run ansible 2016-03-23 05:55:31,651 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-7efe5ae38aed4aa49def6d80bfed1141] successfully executed flow[apply-ansible-playbook] 2016-03-23 05:55:31,651 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-7efe5ae38aed4aa49def6d80bfed1141] start executing flow[echo-host] 2016-03-23 05:55:31,651 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/host/echo], <,{Content-Type=[application/json], Content-Length=[0]}> 2016-03-23 05:55:31,670 DEBUG RESTFacadeImpl successfully echo http://103.30.54.210:7070/host/echo 2016-03-23 05:55:31,670 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-7efe5ae38aed4aa49def6d80bfed1141] successfully executed flow[echo-host] 2016-03-23 05:55:31,670 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-7efe5ae38aed4aa49def6d80bfed1141] start executing flow[collect-kvm-host-facts] 2016-03-23 05:55:31,670 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/host/fact], <{},{Content-Type=[application/json], Content-Length=[2], taskuuid=[7ddfafc801ee4323ac5a18399b2c1865], callbackurl=[http://103.30.54.210:8080/zstack/asyncrest/callback]}> 2016-03-23 05:55:31,737 TRACE RESTFacadeImpl [http response(url: http://103.30.54.210:7070/host/fact)] {"libvirtVersion": "1.2.17", "hvmCpuFlag": "vmx", "qemuImgVersion": "1.5.3", "success": true, "error": ""} 2016-03-23 05:55:31,819 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-7efe5ae38aed4aa49def6d80bfed1141] successfully executed flow[collect-kvm-host-facts] 2016-03-23 05:55:31,820 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/host/connect], <{"hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","sendCommandUrl":"http://103.30.54.210:8080/zstack/asyncrest/sendcommand"},{Content-Type=[application/json], Content-Length=[121]}> 2016-03-23 05:55:31,836 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostAsyncHttpCallMsg":{"path":"/vm/vmsync","command":"{}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"commandTimeout":300,"timeout":1800000,"headers":{"correlationId":"a97b10a83fe24342be4182bd13c3c402","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"a97b10a83fe24342be4182bd13c3c402","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931835}} 2016-03-23 05:55:31,837 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostAsyncHttpCallMsg":{"path":"/vm/vmsync","command":"{}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"commandTimeout":300,"timeout":1800000,"headers":{"correlationId":"a97b10a83fe24342be4182bd13c3c402","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"a97b10a83fe24342be4182bd13c3c402","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931835}} 2016-03-23 05:55:31,845 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/vm/vmsync], <{},{Content-Type=[application/json], Content-Length=[2], taskuuid=[4e5901171046434991f0adb7b7c7212f], callbackurl=[http://103.30.54.210:8080/zstack/asyncrest/callback]}> 2016-03-23 05:55:31,858 TRACE RESTFacadeImpl [http response(url: http://103.30.54.210:7070/vm/vmsync)] {"states": {"33157dee412847a590d713cdea0144bc": "Running", "cee4e1d63a214c33a0e0ed6856c0506b": "Running", "21b1b7b6248548c1a9cb04e2c055222c": "Running", "fe3d090f07934661891b25e1d6aea9ea": "Running", "683e2a430d344be5a7a7667a44e49d4b": "Running", "055e8e6e243146c9b08da392e275d171": "Running"}, "success": true, "error": ""} 2016-03-23 05:55:31,858 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostAsyncHttpCallReply":{"response":{"states":{"33157dee412847a590d713cdea0144bc":"Running","cee4e1d63a214c33a0e0ed6856c0506b":"Running","21b1b7b6248548c1a9cb04e2c055222c":"Running","fe3d090f07934661891b25e1d6aea9ea":"Running","683e2a430d344be5a7a7667a44e49d4b":"Running","055e8e6e243146c9b08da392e275d171":"Running"},"success":true,"error":""},"success":true,"headers":{"isReply":"true","correlationId":"a97b10a83fe24342be4182bd13c3c402","schema":{}},"id":"46031db781eb4810b134e05fb6f05696","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931858}} 2016-03-23 05:55:31,859 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostAsyncHttpCallReply":{"response":{"states":{"33157dee412847a590d713cdea0144bc":"Running","cee4e1d63a214c33a0e0ed6856c0506b":"Running","21b1b7b6248548c1a9cb04e2c055222c":"Running","fe3d090f07934661891b25e1d6aea9ea":"Running","683e2a430d344be5a7a7667a44e49d4b":"Running","055e8e6e243146c9b08da392e275d171":"Running"},"success":true,"error":""},"success":true,"headers":{"isReply":"true","correlationId":"a97b10a83fe24342be4182bd13c3c402","schema":{}},"id":"46031db781eb4810b134e05fb6f05696","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931858}} 2016-03-23 05:55:31,864 TRACE CloudBusImpl2 [msg send]: {"org.zstack.storage.primary.local.InitPrimaryStorageOnHostConnectedMsg":{"primaryStorageUuid":"9c058be62eb94aaea3618da3a5ef75e3","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","timeout":1800000,"headers":{"correlationId":"ab49015af22a4c9ca8de2a0b0ec59ced","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"ab49015af22a4c9ca8de2a0b0ec59ced","serviceId":"storage.primary.5529ff5dd13b4978bf086174fee3de7d","creatingTime":1458726931864}} 2016-03-23 05:55:31,874 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostAsyncHttpCallMsg":{"path":"/localstorage/init","command":"{\"path\":\"/home/pri_storage\",\"hostUuid\":\"7efe5ae38aed4aa49def6d80bfed1141\"}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"commandTimeout":300,"timeout":330000,"headers":{"correlationId":"31e2242ea26041da8089380624f66e46","replyTo":"zstack.message.cloudbus.5529ff5dd13b4978bf086174fee3de7d","noReply":"false","schema":{}},"id":"31e2242ea26041da8089380624f66e46","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726791789}} 2016-03-23 05:55:31,882 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/localstorage/init], <{"path":"/home/pri_storage","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141"},{Content-Type=[application/json], Content-Length=[74], taskuuid=[d5dcb1693d7647f18542a8dea803733d], callbackurl=[http://103.30.54.210:8080/zstack/asyncrest/callback]}> 2016-03-23 05:55:31,919 TRACE RESTFacadeImpl [http response(url: http://103.30.54.210:7070/localstorage/init)] {"availableCapacity": 885014233088, "totalCapacity": 920103772160} 2016-03-23 05:55:31,919 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostAsyncHttpCallReply":{"response":{"availableCapacity":8.85014233088E11,"totalCapacity":9.2010377216E11},"success":true,"headers":{"isReply":"true","correlationId":"31e2242ea26041da8089380624f66e46","schema":{}},"id":"997de303eede4150bd34c3e681020e2b","serviceId":"zstack.message.cloudbus.5529ff5dd13b4978bf086174fee3de7d","creatingTime":1458726931919}} 2016-03-23 05:55:31,936 TRACE CloudBusImpl2 [msg received]: {"org.zstack.storage.primary.local.InitPrimaryStorageOnHostConnectedReply":{"success":true,"headers":{"isReply":"true","correlationId":"ab49015af22a4c9ca8de2a0b0ec59ced","schema":{}},"id":"b8c724157b4043c09dad5230c03839fd","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726791787}} 2016-03-23 05:55:31,940 DEBUG SimpleFlowChain [FlowChain: prepare-l2-26810b7d6a8f44b19489c1c6a7af231e-for-kvm-7efe5ae38aed4aa49def6d80bfed1141-connect] starts

fudingsheng commented 8 years ago

2016-03-23 05:55:31,940 DEBUG SimpleFlowChain [FlowChain: prepare-l2-26810b7d6a8f44b19489c1c6a7af231e-for-kvm-7efe5ae38aed4aa49def6d80bfed1141-connect] start executing flow[org.zstack.kvm.KVMConnectExtensionForL2Network$1] 2016-03-23 05:55:31,941 TRACE CloudBusImpl2 [msg send]: {"org.zstack.header.network.l2.CheckNetworkPhysicalInterfaceMsg":{"physicalInterface":"enp1s0f0","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","timeout":1800000,"headers":{"correlationId":"375eacede50d48b6a1f5dedd8c71ce98","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"375eacede50d48b6a1f5dedd8c71ce98","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931940}} 2016-03-23 05:55:31,943 TRACE CloudBusImpl2 [msg received]: {"org.zstack.header.network.l2.CheckNetworkPhysicalInterfaceMsg":{"physicalInterface":"enp1s0f0","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","timeout":1800000,"headers":{"correlationId":"375eacede50d48b6a1f5dedd8c71ce98","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"375eacede50d48b6a1f5dedd8c71ce98","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931940}} 2016-03-23 05:55:31,951 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/network/checkphysicalnetworkinterface], <{"interfaceNames":["enp1s0f0"]},{Content-Type=[application/json], Content-Length=[31]}> 2016-03-23 05:55:31,977 TRACE CloudBusImpl2 [msg send]: {"org.zstack.header.network.l2.CheckNetworkPhysicalInterfaceReply":{"success":true,"headers":{"isReply":"true","correlationId":"375eacede50d48b6a1f5dedd8c71ce98","schema":{}},"id":"8e20f19d03de41059e21ef16f6ce3cb3","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931951}} 2016-03-23 05:55:31,979 TRACE CloudBusImpl2 [msg received]: {"org.zstack.header.network.l2.CheckNetworkPhysicalInterfaceReply":{"success":true,"headers":{"isReply":"true","correlationId":"375eacede50d48b6a1f5dedd8c71ce98","schema":{}},"id":"8e20f19d03de41059e21ef16f6ce3cb3","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931951}} 2016-03-23 05:55:31,979 DEBUG SimpleFlowChain [FlowChain: prepare-l2-26810b7d6a8f44b19489c1c6a7af231e-for-kvm-7efe5ae38aed4aa49def6d80bfed1141-connect] successfully executed flow[org.zstack.kvm.KVMConnectExtensionForL2Network$1] 2016-03-23 05:55:31,979 DEBUG SimpleFlowChain [FlowChain: prepare-l2-26810b7d6a8f44b19489c1c6a7af231e-for-kvm-7efe5ae38aed4aa49def6d80bfed1141-connect] start executing flow[org.zstack.kvm.KVMConnectExtensionForL2Network$2] 2016-03-23 05:55:31,979 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostAsyncHttpCallMsg":{"path":"/network/l2novlan/createbridge","command":"{\"physicalInterfaceName\":\"enp1s0f0\",\"bridgeName\":\"br_enp1s0f0\"}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"commandTimeout":300,"timeout":1800000,"headers":{"correlationId":"301a9f45c8614fe699051b0518c279a4","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"301a9f45c8614fe699051b0518c279a4","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931979}} 2016-03-23 05:55:31,981 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostAsyncHttpCallMsg":{"path":"/network/l2novlan/createbridge","command":"{\"physicalInterfaceName\":\"enp1s0f0\",\"bridgeName\":\"br_enp1s0f0\"}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"commandTimeout":300,"timeout":1800000,"headers":{"correlationId":"301a9f45c8614fe699051b0518c279a4","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"301a9f45c8614fe699051b0518c279a4","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931979}} 2016-03-23 05:55:31,989 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/network/l2novlan/createbridge], <{"physicalInterfaceName":"enp1s0f0","bridgeName":"br_enp1s0f0"},{Content-Type=[application/json], Content-Length=[63], taskuuid=[4b8fc5a4388d41beb6107f40d2aa50fe], callbackurl=[http://103.30.54.210:8080/zstack/asyncrest/callback]}> 2016-03-23 05:55:32,055 TRACE RESTFacadeImpl [http response(url: http://103.30.54.210:7070/network/l2novlan/createbridge)] {"success": true, "error": ""} 2016-03-23 05:55:32,055 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostAsyncHttpCallReply":{"response":{"success":true,"error":""},"success":true,"headers":{"isReply":"true","correlationId":"301a9f45c8614fe699051b0518c279a4","schema":{}},"id":"aff836294a994e1288e73650c662ca8c","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932055}} 2016-03-23 05:55:32,057 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostAsyncHttpCallReply":{"response":{"success":true,"error":""},"success":true,"headers":{"isReply":"true","correlationId":"301a9f45c8614fe699051b0518c279a4","schema":{}},"id":"aff836294a994e1288e73650c662ca8c","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932055}} 2016-03-23 05:55:32,057 DEBUG KVMRealizeL2NoVlanNetworkBackend successfully realize bridge[br_enp1s0f0] for l2Network[uuid:26810b7d6a8f44b19489c1c6a7af231e, type:L2NoVlanNetwork] on kvm host[uuid:7efe5ae38aed4aa49def6d80bfed1141] 2016-03-23 05:55:32,062 DEBUG SimpleFlowChain [FlowChain: prepare-l2-26810b7d6a8f44b19489c1c6a7af231e-for-kvm-7efe5ae38aed4aa49def6d80bfed1141-connect] successfully executed flow[org.zstack.kvm.KVMConnectExtensionForL2Network$2] 2016-03-23 05:55:32,062 DEBUG SimpleFlowChain [FlowChain: prepare-l2-26810b7d6a8f44b19489c1c6a7af231e-for-kvm-7efe5ae38aed4aa49def6d80bfed1141-connect] successfully completed 2016-03-23 05:55:32,062 TRACE CloudBusImpl2 [msg send]: {"org.zstack.network.securitygroup.RefreshSecurityGroupRulesOnHostMsg":{"hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","headers":{"correlationId":"d0dc82bbc7c14997928719f05917936e","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","schema":{}},"id":"d0dc82bbc7c14997928719f05917936e","serviceId":"securityGroup.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932062}} 2016-03-23 05:55:32,063 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostSyncHttpCallMsg":{"path":"/host/capacity","command":"{}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"timeout":1800000,"headers":{"correlationId":"40d80faca3c04bd3a9f440cbbd98cb89","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"40d80faca3c04bd3a9f440cbbd98cb89","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932062}} 2016-03-23 05:55:32,064 TRACE CloudBusImpl2 [msg received]: {"org.zstack.network.securitygroup.RefreshSecurityGroupRulesOnHostMsg":{"hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","headers":{"correlationId":"d0dc82bbc7c14997928719f05917936e","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","schema":{}},"id":"d0dc82bbc7c14997928719f05917936e","serviceId":"securityGroup.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932062}} 2016-03-23 05:55:32,064 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostSyncHttpCallMsg":{"path":"/host/capacity","command":"{}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"timeout":1800000,"headers":{"correlationId":"40d80faca3c04bd3a9f440cbbd98cb89","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"40d80faca3c04bd3a9f440cbbd98cb89","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932062}} 2016-03-23 05:55:32,071 DEBUG SecurityGroupManagerImpl required to refresh rules on host[uuid:7efe5ae38aed4aa49def6d80bfed1141] 2016-03-23 05:55:32,071 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostAsyncHttpCallMsg":{"path":"/securitygroup/refreshrulesonhost","command":"{\"ruleTOs\":[{\"vmNicInternalName\":\"vnic31.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"149407a353484819855f68a30ae5663b\",\"vmNicMac\":\"fa:f9:93:3d:4b:00\",\"vmNicIp\":\"103.30.67.197\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic159.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"3ffa90abe4d74ed48117db97c07c2603\",\"vmNicMac\":\"fa:51:d5:3a:e7:00\",\"vmNicIp\":\"103.30.67.198\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic72.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"63772f5bb84045e5ba3e7a3963b5340d\",\"vmNicMac\":\"fa:4a:9e:2c:da:00\",\"vmNicIp\":\"103.30.67.196\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic139.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"74ff245ce1d5430284f74ddf25c11c19\",\"vmNicMac\":\"fa:b6:7b:83:9a:00\",\"vmNicIp\":\"103.30.67.143\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic144.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"8587b06ecc5d4225bc98ee0850b3382a\",\"vmNicMac\":\"fa:7e:63:f8:07:00\",\"vmNicIp\":\"103.30.67.231\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic74.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"92dd285aa6b24b40ac3b0b31151076cf\",\"vmNicMac\":\"fa:86:51:c4:e6:00\",\"vmNicIp\":\"103.30.67.216\",\"actionCode\":\"deleteChain\"}]}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"commandTimeout":300,"timeout":1800000,"headers":{"correlationId":"0465584655744a1c950291172e2bb2c4","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"0465584655744a1c950291172e2bb2c4","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932071}} 2016-03-23 05:55:32,073 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/host/capacity], <{},{Content-Type=[application/json], Content-Length=[2]}> 2016-03-23 05:55:32,073 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostAsyncHttpCallMsg":{"path":"/securitygroup/refreshrulesonhost","command":"{\"ruleTOs\":[{\"vmNicInternalName\":\"vnic31.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"149407a353484819855f68a30ae5663b\",\"vmNicMac\":\"fa:f9:93:3d:4b:00\",\"vmNicIp\":\"103.30.67.197\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic159.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"3ffa90abe4d74ed48117db97c07c2603\",\"vmNicMac\":\"fa:51:d5:3a:e7:00\",\"vmNicIp\":\"103.30.67.198\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic72.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"63772f5bb84045e5ba3e7a3963b5340d\",\"vmNicMac\":\"fa:4a:9e:2c:da:00\",\"vmNicIp\":\"103.30.67.196\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic139.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"74ff245ce1d5430284f74ddf25c11c19\",\"vmNicMac\":\"fa:b6:7b:83:9a:00\",\"vmNicIp\":\"103.30.67.143\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic144.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"8587b06ecc5d4225bc98ee0850b3382a\",\"vmNicMac\":\"fa:7e:63:f8:07:00\",\"vmNicIp\":\"103.30.67.231\",\"actionCode\":\"deleteChain\"},{\"vmNicInternalName\":\"vnic74.0\",\"rules\":[],\"ingressDefaultPolicy\":\"deny\",\"egressDefaultPolicy\":\"accept\",\"vmNicUuid\":\"92dd285aa6b24b40ac3b0b31151076cf\",\"vmNicMac\":\"fa:86:51:c4:e6:00\",\"vmNicIp\":\"103.30.67.216\",\"actionCode\":\"deleteChain\"}]}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"commandTimeout":300,"timeout":1800000,"headers":{"correlationId":"0465584655744a1c950291172e2bb2c4","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"0465584655744a1c950291172e2bb2c4","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932071}} 2016-03-23 05:55:32,082 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/securitygroup/refreshrulesonhost], <{"ruleTOs":[{"vmNicInternalName":"vnic31.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"149407a353484819855f68a30ae5663b","vmNicMac":"fa:f9:93:3d:4b:00","vmNicIp":"103.30.67.197","actionCode":"deleteChain"},{"vmNicInternalName":"vnic159.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"3ffa90abe4d74ed48117db97c07c2603","vmNicMac":"fa:51:d5:3a:e7:00","vmNicIp":"103.30.67.198","actionCode":"deleteChain"},{"vmNicInternalName":"vnic72.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"63772f5bb84045e5ba3e7a3963b5340d","vmNicMac":"fa:4a:9e:2c:da:00","vmNicIp":"103.30.67.196","actionCode":"deleteChain"},{"vmNicInternalName":"vnic139.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"74ff245ce1d5430284f74ddf25c11c19","vmNicMac":"fa:b6:7b:83:9a:00","vmNicIp":"103.30.67.143","actionCode":"deleteChain"},{"vmNicInternalName":"vnic144.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"8587b06ecc5d4225bc98ee0850b3382a","vmNicMac":"fa:7e:63:f8:07:00","vmNicIp":"103.30.67.231","actionCode":"deleteChain"},{"vmNicInternalName":"vnic74.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"92dd285aa6b24b40ac3b0b31151076cf","vmNicMac":"fa:86:51:c4:e6:00","vmNicIp":"103.30.67.216","actionCode":"deleteChain"}]},{Content-Type=[application/json], Content-Length=[1432], taskuuid=[4b79ffc24b4342a19e9d622502f035b0], callbackurl=[http://103.30.54.210:8080/zstack/asyncrest/callback]}> 2016-03-23 05:55:32,162 TRACE RESTFacadeImpl [http response(url: http://103.30.54.210:7070/securitygroup/refreshrulesonhost)] {"success": true, "error": ""} 2016-03-23 05:55:32,163 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostAsyncHttpCallReply":{"response":{"success":true,"error":""},"success":true,"headers":{"isReply":"true","correlationId":"0465584655744a1c950291172e2bb2c4","schema":{}},"id":"1505a1ef8aa44ec99d017fa97341cd17","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932162}} 2016-03-23 05:55:32,164 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostAsyncHttpCallReply":{"response":{"success":true,"error":""},"success":true,"headers":{"isReply":"true","correlationId":"0465584655744a1c950291172e2bb2c4","schema":{}},"id":"1505a1ef8aa44ec99d017fa97341cd17","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932162}} 2016-03-23 05:55:32,164 DEBUG KVMSecurityGroupBackend successfully applied rules of security group rules to kvm host[uuid:7efe5ae38aed4aa49def6d80bfed1141] 2016-03-23 05:55:32,164 DEBUG SecurityGroupManagerImpl successfully applied security rules on host[uuid:7efe5ae38aed4aa49def6d80bfed1141] 2016-03-23 05:55:32,203 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostSyncHttpCallReply":{"response":{"cpuNum":16.0,"usedCpu":10752.0,"success":true,"cpuSpeed":2401.0,"totalMemory":5.0468950016E10,"usedMemory":4.7798288384E10,"error":""},"success":true,"headers":{"isReply":"true","correlationId":"40d80faca3c04bd3a9f440cbbd98cb89","schema":{}},"id":"6efbfe7338d74c99b1eb8c3954b0b044","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932203}} 2016-03-23 05:55:32,205 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostSyncHttpCallReply":{"response":{"cpuNum":16.0,"usedCpu":10752.0,"success":true,"cpuSpeed":2401.0,"totalMemory":5.0468950016E10,"usedMemory":4.7798288384E10,"error":""},"success":true,"headers":{"isReply":"true","correlationId":"40d80faca3c04bd3a9f440cbbd98cb89","schema":{}},"id":"6efbfe7338d74c99b1eb8c3954b0b044","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932203}} 2016-03-23 05:55:32,205 TRACE CloudBusImpl2 [msg send]: {"org.zstack.header.cluster.ReportHostCapacityMessage":{"totalCpu":38416,"totalMemory":50468950016,"usedCpu":10752,"usedMemory":47798288384,"hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","headers":{"correlationId":"77bf81dd6fcc4038886665bb72a7db6c","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","schema":{}},"id":"77bf81dd6fcc4038886665bb72a7db6c","serviceId":"host.allocator.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932205}} 2016-03-23 05:55:32,207 TRACE CloudBusImpl2 [msg received]: {"org.zstack.header.cluster.ReportHostCapacityMessage":{"totalCpu":38416,"totalMemory":50468950016,"usedCpu":10752,"usedMemory":47798288384,"hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","headers":{"correlationId":"77bf81dd6fcc4038886665bb72a7db6c","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","schema":{}},"id":"77bf81dd6fcc4038886665bb72a7db6c","serviceId":"host.allocator.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932205}} 2016-03-23 05:55:32,209 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostSyncHttpCallMsg":{"path":"/nfsprimarystorage/mount","command":"{\"url\":\"103.30.54.230:/mnt/fuse\",\"mountPath\":\"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370\",\"uuid\":\"a68616a39c224a419266975406d56370\"}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"timeout":1800000,"headers":{"correlationId":"eac5f46e07b44b538d4d8205316720ca","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"eac5f46e07b44b538d4d8205316720ca","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932209}} 2016-03-23 05:55:32,210 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostSyncHttpCallMsg":{"path":"/nfsprimarystorage/mount","command":"{\"url\":\"103.30.54.230:/mnt/fuse\",\"mountPath\":\"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370\",\"uuid\":\"a68616a39c224a419266975406d56370\"}","hostUuid":"7efe5ae38aed4aa49def6d80bfed1141","noStatusCheck":true,"timeout":1800000,"headers":{"correlationId":"eac5f46e07b44b538d4d8205316720ca","replyTo":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","noReply":"false","schema":{}},"id":"eac5f46e07b44b538d4d8205316720ca","serviceId":"host.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932209}} 2016-03-23 05:55:32,218 TRACE RESTFacadeImpl json post[http://103.30.54.210:7070/nfsprimarystorage/mount], <{"url":"103.30.54.230:/mnt/fuse","mountPath":"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370","uuid":"a68616a39c224a419266975406d56370"},{Content-Type=[application/json], Content-Length=[157]}> 2016-03-23 05:55:32,293 TRACE CloudBusImpl2 [msg send]: {"org.zstack.kvm.KVMHostSyncHttpCallReply":{"response":{"success":false,"error":"invalid literal for long() with base 10: \u0027\u0027"},"success":true,"headers":{"isReply":"true","correlationId":"eac5f46e07b44b538d4d8205316720ca","schema":{}},"id":"5296bcce82db480bb68cded4170f38c1","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932293}} 2016-03-23 05:55:32,295 TRACE CloudBusImpl2 [msg received]: {"org.zstack.kvm.KVMHostSyncHttpCallReply":{"response":{"success":false,"error":"invalid literal for long() with base 10: \u0027\u0027"},"success":true,"headers":{"isReply":"true","correlationId":"eac5f46e07b44b538d4d8205316720ca","schema":{}},"id":"5296bcce82db480bb68cded4170f38c1","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932293}} 2016-03-23 05:55:32,296 DEBUG SimpleFlowChain [FlowChain: connect-host-7efe5ae38aed4aa49def6d80bfed1141] start to rollback 2016-03-23 05:55:32,296 DEBUG SimpleFlowChain [FlowChain: connect-host-7efe5ae38aed4aa49def6d80bfed1141] start to rollback flow[connect-host] 2016-03-23 05:55:32,296 DEBUG SimpleFlowChain [FlowChain: connect-host-7efe5ae38aed4aa49def6d80bfed1141] rolled back all flows because errorErrorCode [code = HOST.1003, description = An error happened when connecting to host, details = invalid literal for long() with base 10: ''] 2016-03-23 05:55:32,310 DEBUG HostBase Host HOST2 [uuid:7efe5ae38aed4aa49def6d80bfed1141] changed connection state from Connecting to Disconnected 2016-03-23 05:55:32,310 TRACE CloudBusImpl2 [msg send]: {"org.zstack.header.host.ConnectHostReply":{"success":false,"error":{"code":"HOST.1003","description":"An error happened when connecting to host","details":"invalid literal for long() with base 10: \u0027\u0027","cause":{"code":"SYS.1006","description":"An operation failed","details":"invalid literal for long() with base 10: \u0027\u0027"}},"headers":{"isReply":"true","correlationId":"efafc703d880454989dd5a9f5e3e377f","schema":{}},"id":"8058d0f62f8542488110446dd21752f5","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931170}} 2016-03-23 05:55:32,311 DEBUG SimpleFlowChain [FlowChain: run-ansible-for-kvm-7efe5ae38aed4aa49def6d80bfed1141] successfully completed 2016-03-23 05:55:32,312 TRACE CloudBusImpl2 [msg received]: {"org.zstack.header.host.ConnectHostReply":{"success":false,"error":{"code":"HOST.1003","description":"An error happened when connecting to host","details":"invalid literal for long() with base 10: \u0027\u0027","cause":{"code":"SYS.1006","description":"An operation failed","details":"invalid literal for long() with base 10: \u0027\u0027"}},"headers":{"isReply":"true","correlationId":"efafc703d880454989dd5a9f5e3e377f","schema":{}},"id":"8058d0f62f8542488110446dd21752f5","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726931170}} 2016-03-23 05:55:32,312 DEBUG HostBase Failed to reconnect host[uuid:7efe5ae38aed4aa49def6d80bfed1141] because ErrorCode [code = HOST.1003, description = An error happened when connecting to host, details = invalid literal for long() with base 10: ''] 2016-03-23 05:55:32,312 TRACE CloudBusImpl2 [msg send]: {"org.zstack.header.host.ReconnectHostReply":{"success":false,"error":{"code":"HOST.1002","description":"Unable to reconnect host","details":"invalid literal for long() with base 10: \u0027\u0027","cause":{"code":"HOST.1003","description":"An error happened when connecting to host","details":"invalid literal for long() with base 10: \u0027\u0027","cause":{"code":"SYS.1006","description":"An operation failed","details":"invalid literal for long() with base 10: \u0027\u0027"}}},"headers":{"isReply":"true","correlationId":"b69f6245194c44ad95bd6ab70a45cadc","schema":{}},"id":"bb8d16bedd4a41768a5f48d28f8e8575","serviceId":"zstack.message.cloudbus.aa4594e164d04f6ba00bb35cc6268b5a","creatingTime":1458726932312}}

youyk commented 8 years ago

Thanks @fudingsheng , looks like the kvmagent report some errors. Please also find the "invalid literal for long" in /var/log/zstack/zstack-kvmagent.log in your physical host and upload the related Trace back logs.

fudingsheng commented 8 years ago

ok ,this is the log in the /var/log/zstack/zstack-kvmagent.log.Thanks

fudingsheng commented 8 years ago

DEBUG:zstacklib.utils.http:async http call[task uuid: 1e68da06385e4e3e9a62554e0f11bf01], body: {"ruleTOs":[{"vmNicInternalName":"vnic31.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"149407a353484819855f68a30ae5663b","vmNicMac":"fa:f9:93:3d:4b:00","vmNicIp":"103.30.67.197","actionCode":"deleteChain"},{"vmNicInternalName":"vnic159.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"3ffa90abe4d74ed48117db97c07c2603","vmNicMac":"fa:51:d5:3a:e7:00","vmNicIp":"103.30.67.198","actionCode":"deleteChain"},{"vmNicInternalName":"vnic72.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"63772f5bb84045e5ba3e7a3963b5340d","vmNicMac":"fa:4a:9e:2c:da:00","vmNicIp":"103.30.67.196","actionCode":"deleteChain"},{"vmNicInternalName":"vnic139.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"74ff245ce1d5430284f74ddf25c11c19","vmNicMac":"fa:b6:7b:83:9a:00","vmNicIp":"103.30.67.143","actionCode":"deleteChain"},{"vmNicInternalName":"vnic144.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"8587b06ecc5d4225bc98ee0850b3382a","vmNicMac":"fa:7e:63:f8:07:00","vmNicIp":"103.30.67.231","actionCode":"deleteChain"},{"vmNicInternalName":"vnic74.0","rules":[],"ingressDefaultPolicy":"deny","egressDefaultPolicy":"accept","vmNicUuid":"92dd285aa6b24b40ac3b0b31151076cf","vmNicMac":"fa:86:51:c4:e6:00","vmNicIp":"103.30.67.216","actionCode":"deleteChain"}]} DEBUG:zstacklib.utils.shell:cat /proc/cpuinfo | grep 'processor' | wc -l 2016-03-23 21:07:56,369 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /securitygroup/refreshrulesonhost HTTP/1.1" 200 - "" "Java/1.7.0_91" 2016-03-23 21:07:56,369 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /securitygroup/refreshrulesonhost HTTP/1.1" 200 - "" "Java/1.7.0_91" 2016-03-23 21:07:56,369 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /securitygroup/refreshrulesonhost HTTP/1.1" 200 - "" "Java/1.7.0_91" INFO:zstacklib.utils.http:103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /securitygroup/refreshrulesonhost HTTP/1.1" 200 - "" "Java/1.7.0_91" DEBUG:zstacklib.utils.shell:cat /sys/devices/system/cpu/cpu0/cpufreq/cpuinfo_max_freq DEBUG:zstacklib.utils.shell:/sbin/iptables-save 2016-03-23 21:07:56,405 DEBUG [securitygroup_plugin] deleted default chain DEBUG:securitygroup_plugin:deleted default chain DEBUG:zstacklib.utils.iptables:removed empty chains:[] DEBUG:zstacklib.utils.shell:/sbin/iptables-restore < /tmp/tmp6vGUlW INFO:urllib3.connectionpool:Starting new HTTP connection (1): 103.30.54.210 DEBUG:urllib3.connectionpool:"POST /zstack/asyncrest/callback HTTP/1.1" 200 0 DEBUG:zstacklib.utils.shell:cat /proc/meminfo | grep 'MemTotal' 2016-03-23 21:07:56,470 DEBUG [host_plugin] get host capacity: {"cpuNum": 16, "usedCpu": 10752, "success": true, "cpuSpeed": 2401, "totalMemory": 50468950016, "usedMemory": 47798288384, "error": ""} DEBUG:host_plugin:get host capacity: {"cpuNum": 16, "usedCpu": 10752, "success": true, "cpuSpeed": 2401, "totalMemory": 50468950016, "usedMemory": 47798288384, "error": ""} 2016-03-23 21:07:56,475 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /host/capacity HTTP/1.1" 200 135 "" "Java/1.7.0_91" 2016-03-23 21:07:56,475 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /host/capacity HTTP/1.1" 200 135 "" "Java/1.7.0_91" 2016-03-23 21:07:56,475 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /host/capacity HTTP/1.1" 200 135 "" "Java/1.7.0_91" INFO:zstacklib.utils.http:103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /host/capacity HTTP/1.1" 200 135 "" "Java/1.7.0_91" 2016-03-23 21:07:56,498 DEBUG [zstacklib.utils.http] sync http call: {"url":"103.30.54.230:/mnt/fuse","mountPath":"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370","uuid":"a68616a39c224a419266975406d56370"} 2016-03-23 21:07:56,498 DEBUG [zstacklib.utils.http] sync http call: {"url":"103.30.54.230:/mnt/fuse","mountPath":"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370","uuid":"a68616a39c224a419266975406d56370"} 2016-03-23 21:07:56,498 DEBUG [zstacklib.utils.http] sync http call: {"url":"103.30.54.230:/mnt/fuse","mountPath":"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370","uuid":"a68616a39c224a419266975406d56370"} DEBUG:zstacklib.utils.http:sync http call: {"url":"103.30.54.230:/mnt/fuse","mountPath":"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370","uuid":"a68616a39c224a419266975406d56370"} DEBUG:zstacklib.utils.shell:mount | grep '103.30.54.230:/mnt/fuse' | grep '/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370' 2016-03-23 21:07:56,520 DEBUG [nfs_primarystorage_plugin] /nfsprimarystorage/mount mounted 103.30.54.230:/mnt/fuse on /opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370 DEBUG:nfs_primarystorage_plugin:/nfsprimarystorage/mount mounted 103.30.54.230:/mnt/fuse on /opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370 DEBUG:zstacklib.utils.shell:df /opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370|tail -1|awk '{print $(NF-4)}' DEBUG:zstacklib.utils.shell:df /opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370|tail -1|awk '{print $(NF-2)}' 2016-03-23 21:07:56,561 WARNING [kvmagent.kvmagent] invalid literal for long() with base 10: '' Traceback (most recent call last): File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/kvmagent/kvmagent.py", line 116, in wrap return func(_args, _kwargs) File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/kvmagent/plugins/nfs_primarystorage_plugin.py", line 318, in mount self._set_capacity_to_response(cmd.uuid, rsp) File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/kvmagent/plugins/nfs_primarystorage_plugin.py", line 170, in _set_capacity_to_response rsp.totalCapacity, rsp.availableCapacity = self._get_disk_capacity(uuid) File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/kvmagent/plugins/nfs_primarystorage_plugin.py", line 164, in _get_disk_capacity return linux.get_disk_capacity_by_df(path) File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/zstacklib/utils/linux.py", line 159, in get_disk_capacity_by_df return long(total) * 1024, long(avail) \ 1024 ValueError: invalid literal for long() with base 10: ''

args:[(<nfs_primarystorageplugin.NfsPrimaryStoragePlugin object at 0x2483b10>, {'body': '{"url":"103.30.54.230:/mnt/fuse","mountPath":"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370","uuid":"a68616a39c224a419266975406d56370"}', 'header': {'Accept': 'text/plain, /_', 'Accept-Charset': 'big5, big5-hkscs, euc-jp, euc-kr, gb18030, gb2312, gbk, ibm-thai, ibm00858, ibm01140, ibm01141, ibm01142, ibm01143, ibm01144, ibm01145, ibm01146, ibm01147, ibm01148, ibm01149, ibm037, ibm1026, ibm1047, ibm273, ibm277, ibm278, ibm280, ibm284, ibm285, ibm290, ibm297, ibm420, ibm424, ibm437, ibm500, ibm775, ibm850, ibm852, ibm855, ibm857, ibm860, ibm861, ibm862, ibm863, ibm864, ibm865, ibm866, ibm868, ibm869, ibm870, ibm871, ibm918, iso-2022-cn, iso-2022-jp, iso-2022-jp-2, iso-2022-kr, iso-8859-1, iso-8859-13, iso-8859-15, iso-8859-2, iso-8859-3, iso-8859-4, iso-8859-5, iso-8859-6, iso-8859-7, iso-8859-8, iso-8859-9, jis_x0201, jis_x0212-1990, koi8-r, koi8-u, shift_jis, tis-620, us-ascii, utf-16, utf-16be, utf-16le, utf-32, utf-32be, utf-32le, utf-8, windows-1250, windows-1251, windows-1252, windows-1253, windows-1254, windows-1255, windows-1256, windows-1257, windows-1258, windows-31j, x-big5-hkscs-2001, x-big5-solaris, x-compound_text, x-euc-jp-linux, x-euc-tw, x-eucjp-open, x-ibm1006, x-ibm1025, x-ibm1046, x-ibm1097, x-ibm1098, x-ibm1112, x-ibm1122, x-ibm1123, x-ibm1124, x-ibm1364, x-ibm1381, x-ibm1383, x-ibm300, x-ibm33722, x-ibm737, x-ibm833, x-ibm834, x-ibm856, x-ibm874, x-ibm875, x-ibm921, x-ibm922, x-ibm930, x-ibm933, x-ibm935, x-ibm937, x-ibm939, x-ibm942, x-ibm942c, x-ibm943, x-ibm943c, x-ibm948, x-ibm949, x-ibm949c, x-ibm950, x-ibm964, x-ibm970, x-iscii91, x-iso-2022-cn-cns, x-iso-2022-cn-gb, x-iso-8859-11, x-jis0208, x-jisautodetect, x-johab, x-macarabic, x-maccentraleurope, x-maccroatian, x-maccyrillic, x-macdingbat, x-macgreek, x-machebrew, x-maciceland, x-macroman, x-macromania, x-macsymbol, x-macthai, x-macturkish, x-macukraine, x-ms932_0213, x-ms950-hkscs, x-ms950-hkscs-xp, x-mswin-936, x-pck, x-sjis_0213, x-utf-16le-bom, x-utf-32be-bom, x-utf-32le-bom, x-windows-50220, x-windows-50221, x-windows-874, x-windows-949, x-windows-950, x-windows-iso2022jp', 'Cache-Control': 'no-cache', 'Connection': 'keep-alive', 'Content-Length': '157', 'Content-Type': 'application/json', 'Host': '103.30.54.210:7070', 'Pragma': 'no-cache', 'Remote-Addr': '103.30.54.210', 'User-Agent': 'Java/1.7.0_91'}}), {}] WARNING:kvmagent.kvmagent:invalid literal for long() with base 10: '' Traceback (most recent call last): File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/kvmagent/kvmagent.py", line 116, in wrap return func(_args, _kwargs) File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/kvmagent/plugins/nfs_primarystorage_plugin.py", line 318, in mount self._set_capacity_to_response(cmd.uuid, rsp) File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/kvmagent/plugins/nfs_primarystorage_plugin.py", line 170, in _set_capacity_to_response rsp.totalCapacity, rsp.availableCapacity = self._get_disk_capacity(uuid) File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/kvmagent/plugins/nfs_primarystorage_plugin.py", line 164, in _get_disk_capacity return linux.get_disk_capacity_by_df(path) File "/var/lib/zstack/virtualenv/kvm/lib/python2.7/site-packages/zstacklib/utils/linux.py", line 159, in get_disk_capacity_by_df return long(total) * 1024, long(avail) \ 1024 ValueError: invalid literal for long() with base 10: ''

args:[(<nfs_primarystorageplugin.NfsPrimaryStoragePlugin object at 0x2483b10>, {'body': '{"url":"103.30.54.230:/mnt/fuse","mountPath":"/opt/zstack/nfsprimarystorage/prim-a68616a39c224a419266975406d56370","uuid":"a68616a39c224a419266975406d56370"}', 'header': {'Accept': 'text/plain, /_', 'Accept-Charset': 'big5, big5-hkscs, euc-jp, euc-kr, gb18030, gb2312, gbk, ibm-thai, ibm00858, ibm01140, ibm01141, ibm01142, ibm01143, ibm01144, ibm01145, ibm01146, ibm01147, ibm01148, ibm01149, ibm037, ibm1026, ibm1047, ibm273, ibm277, ibm278, ibm280, ibm284, ibm285, ibm290, ibm297, ibm420, ibm424, ibm437, ibm500, ibm775, ibm850, ibm852, ibm855, ibm857, ibm860, ibm861, ibm862, ibm863, ibm864, ibm865, ibm866, ibm868, ibm869, ibm870, ibm871, ibm918, iso-2022-cn, iso-2022-jp, iso-2022-jp-2, iso-2022-kr, iso-8859-1, iso-8859-13, iso-8859-15, iso-8859-2, iso-8859-3, iso-8859-4, iso-8859-5, iso-8859-6, iso-8859-7, iso-8859-8, iso-8859-9, jis_x0201, jis_x0212-1990, koi8-r, koi8-u, shift_jis, tis-620, us-ascii, utf-16, utf-16be, utf-16le, utf-32, utf-32be, utf-32le, utf-8, windows-1250, windows-1251, windows-1252, windows-1253, windows-1254, windows-1255, windows-1256, windows-1257, windows-1258, windows-31j, x-big5-hkscs-2001, x-big5-solaris, x-compound_text, x-euc-jp-linux, x-euc-tw, x-eucjp-open, x-ibm1006, x-ibm1025, x-ibm1046, x-ibm1097, x-ibm1098, x-ibm1112, x-ibm1122, x-ibm1123, x-ibm1124, x-ibm1364, x-ibm1381, x-ibm1383, x-ibm300, x-ibm33722, x-ibm737, x-ibm833, x-ibm834, x-ibm856, x-ibm874, x-ibm875, x-ibm921, x-ibm922, x-ibm930, x-ibm933, x-ibm935, x-ibm937, x-ibm939, x-ibm942, x-ibm942c, x-ibm943, x-ibm943c, x-ibm948, x-ibm949, x-ibm949c, x-ibm950, x-ibm964, x-ibm970, x-iscii91, x-iso-2022-cn-cns, x-iso-2022-cn-gb, x-iso-8859-11, x-jis0208, x-jisautodetect, x-johab, x-macarabic, x-maccentraleurope, x-maccroatian, x-maccyrillic, x-macdingbat, x-macgreek, x-machebrew, x-maciceland, x-macroman, x-macromania, x-macsymbol, x-macthai, x-macturkish, x-macukraine, x-ms932_0213, x-ms950-hkscs, x-ms950-hkscs-xp, x-mswin-936, x-pck, x-sjis_0213, x-utf-16le-bom, x-utf-32be-bom, x-utf-32le-bom, x-windows-50220, x-windows-50221, x-windows-874, x-windows-949, x-windows-950, x-windows-iso2022jp', 'Cache-Control': 'no-cache', 'Connection': 'keep-alive', 'Content-Length': '157', 'Content-Type': 'application/json', 'Host': '103.30.54.210:7070', 'Pragma': 'no-cache', 'Remote-Addr': '103.30.54.210', 'User-Agent': 'Java/1.7.0_91'}}), {}] 2016-03-23 21:07:56,566 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /nfsprimarystorage/mount HTTP/1.1" 200 74 "" "Java/1.7.0_91" 2016-03-23 21:07:56,566 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /nfsprimarystorage/mount HTTP/1.1" 200 74 "" "Java/1.7.0_91" 2016-03-23 21:07:56,566 INFO [zstacklib.utils.http] 103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /nfsprimarystorage/mount HTTP/1.1" 200 74 "" "Java/1.7.0_91" INFO:zstacklib.utils.http:103.30.54.210 - - [23/Mar/2016:21:07:56] "POST /nfsprimarystorage/mount HTTP/1.1" 200 74 "" "Java/1.7.0_91"

fudingsheng commented 8 years ago

I think i have already found the problems from the log ,it maybe i do not mount 103.30.54.230:/mnt/fuse successfully. I will go to try it ,Thank you .