openvstorage / integrationtests

Open vStorage automated integration tests.
Other
0 stars 1 forks source link

Scrubbing fails with nonzero exit status 256 #555

Open pploegaert opened 7 years ago

pploegaert commented 7 years ago

Branch: develop Env: 10.100.199.19x Testrun: http://testrail.openvstorage.com/index.php?/plans/view/38028

Stacktrace:

Traceback (most recent call last):
  File "/opt/OpenvStorage/ovs/lib/generic.py", line 353, in _execute_scrub
    backend_config=Configuration.get_configuration_path(backend_config_key))
  File "/usr/lib/python2.7/dist-packages/rpyc/core/netref.py", line 196, in __call__
    return syncreq(_self, consts.HANDLE_CALL, args, kwargs)
  File "/usr/lib/python2.7/dist-packages/rpyc/core/netref.py", line 71, in syncreq
    return conn.sync_request(handler, oid, *args)
  File "/usr/lib/python2.7/dist-packages/rpyc/core/protocol.py", line 441, in sync_request
    raise obj
RuntimeError: scrubber returned with nonzero exit status 256

scrubber.log:

2017-07-03 15:44:54 974394 +0200 - ovs-node01-1604 - 7020/0x00007fc2aab11900 - scrubber/ovs_scrubber - 0000000000000001 - notice - print_version_data: Command Line Options
2017-07-03 15:44:54 974603 +0200 - ovs-node01-1604 - 7020/0x00007fc2aab11900 - scrubber/ArakoonConfigFetcher - 0000000000000002 - info - operator(): Fetching config from arakoon://config/ovs/vpools/2aedec2c-2c90-4dfc-a0e8-ad7ed0deeb83/proxies/scrub/backend_config_3644414c-e12d-4f08-8b74-2933e7233246?ini=%2Fopt%2FOpenvStorage%2Fconfig%2Farakoon_cacc.ini
2017-07-03 15:44:54 975058 +0200 - ovs-node01-1604 - 7020/0x00007fc2aab11900 - scrubber/Cluster - 0000000000000003 - info - Cluster: Cluster ID config, proto version 0
2017-07-03 15:44:54 975094 +0200 - ovs-node01-1604 - 7020/0x00007fc2aab11900 - scrubber/Cluster - 0000000000000004 - info - add_node_: config: adding arakoon node 6gcw6XYczTxMXre9, host 10.100.199.193, service 26400
2017-07-03 15:44:54 975145 +0200 - ovs-node01-1604 - 7020/0x00007fc2aab11900 - scrubber/Cluster - 0000000000000005 - info - add_node_: config: adding arakoon node 72pa9ncqhIYYtoXd, host 10.100.199.192, service 26400
2017-07-03 15:44:54 975165 +0200 - ovs-node01-1604 - 7020/0x00007fc2aab11900 - scrubber/Cluster - 0000000000000006 - info - add_node_: config: adding arakoon node mw4dJOQDbbRFfO0j, host 10.100.199.191, service 26400
2017-07-03 15:44:54 976621 +0200 - ovs-node01-1604 - 7020/0x00007fc29decb700 - scrubber/SignalThread - 0000000000000007 - info - run_: exiting signal handler thread
2017-07-03 15:44:54 977044 +0200 - ovs-node01-1604 - 7020/0x00007fc2aab11900 - scrubber/ovs_scrubber - 0000000000000008 - fatal - operator(): caught exception: Not found
2017-07-03 15:44:54 977106 +0200 - ovs-node01-1604 - 7020/0x00007fc2aab11900 - scrubber/ovs_scrubber - 0000000000000009 - notice - at_exit: Time spent executing user instructions (seconds): 0.20000
Time spent in operating system code (seconds): 0.8000
The maximum resident set size used, in kilobytes. 19748
The number of page faults which were serviced without requiring any I/O: 1064
The number of page faults which were serviced by doing I/O: 0
The number of times PROCESSES was swapped entirely out of main memory: 0
The number of times the file system had to read from the disk: 0
The number of times the file system had to write to the disk: 8
The number of signals received: 0
The number of times PROCESSES voluntarily invoked a context switch: 11
The number of times an involuntary context switch took place: 23