Two contradicting log entries for nsm_checkup: succesful and failed

openvstorage-ci commented 7 years ago

From @JeffreyDevloo on September 15, 2016 9:15

Problem description

Executed AlbaController.nsm_checkup(backend_guid=guid, min_nsms=3) Found in /var/log/ovs/lib.log:

2016-09-15 11:05:20 78200 +0200 - perf-roub-03 - 25733/139946900580160 - lib/scheduled tasks - 0 - INFO - Ensure single CHAINED mode - ID 1473930320_g52b34S1do - Amount of jobs pending for key ovs_ensure_single_alba.nsm_checkup: 0
2016-09-15 11:05:20 79700 +0200 - perf-roub-03 - 25733/139946900580160 - lib/scheduled tasks - 1 - INFO - Ensure single CHAINED mode - ID 1473930320_g52b34S1do - New task alba.nsm_checkup with params {'backend_guid': 'fb1de670-65df-4b89-b7ba-7eb8c33dc758', 'min_nsms': 3} scheduled for execution
2016-09-15 11:05:20 80900 +0200 - perf-roub-03 - 25733/139946900580160 - lib/scheduled tasks - 2 - INFO - Ensure single CHAINED mode - ID 1473930320_g52b34S1do - Amount of jobs pending for key ovs_ensure_single_alba.nsm_checkup: 1
2016-09-15 11:05:20 80900 +0200 - perf-roub-03 - 25733/139946900580160 - lib/scheduled tasks - 3 - INFO - Ensure single CHAINED mode - ID 1473930320_g52b34S1do -   KWARGS: {'backend_guid': 'fb1de670-65df-4b89-b7ba-7eb8c33dc758', 'min_nsms': 3}
2016-09-15 11:05:20 93400 +0200 - perf-roub-03 - 25733/139946900580160 - lib/alba - 4 - DEBUG - Ensuring NSM safety for backend hdd_roub_abm
2016-09-15 11:05:21 86200 +0200 - perf-roub-03 - 25733/139946900580160 - lib/alba - 5 - DEBUG - NSM load OK
2016-09-15 11:05:21 86200 +0200 - perf-roub-03 - 25733/139946900580160 - lib/alba - 6 - DEBUG - Externally managed NSM arakoon cluster needs to be expanded
2016-09-15 11:05:22 20100 +0200 - perf-roub-03 - 25733/139946900580160 - lib/alba - 8 - WARNING - Cannot claim additional NSM clusters, because no clusters are available
2016-09-15 11:05:22 20200 +0200 - perf-roub-03 - 25733/139946900580160 - lib/scheduled tasks - 9 - INFO - Ensure single CHAINED mode - ID 1473930320_g52b34S1do - Task alba.nsm_checkup finished successfully
2016-09-15 11:05:22 20200 +0200 - perf-roub-03 - 25733/139946900580160 - lib/scheduled tasks - 10 - ERROR - Ensure single CHAINED mode - ID 1473930320_g52b34S1do - Task alba.nsm_checkup with params with params {'backend_guid': 'fb1de670-65df-4b89-b7ba-7eb8c33dc758', 'min_nsms': 3} failed
2016-09-15 11:05:22 21400 +0200 - perf-roub-03 - 25733/139946900580160 - lib/scheduled tasks - 11 - INFO - Ensure single CHAINED mode - ID 1473930320_g52b34S1do - Amount of jobs pending for key ovs_ensure_single_alba.nsm_checkup: 0

The ids of the task are identical. The job ran (as far as I know) successfully.

Setup

Geoscale setup

Package information

openvstorage 2.7.3-rev.3956.a9861c0-1 amd64 openvStorage
openvstorage-backend 1.7.3-rev.699.85f8422-1 amd64 openvStorage Backend plugin
openvstorage-backend-core 1.7.3-rev.699.85f8422-1 amd64 openvStorage Backend plugin core
openvstorage-backend-webapps 1.7.3-rev.699.85f8422-1 amd64 openvStorage Backend plugin Web Applications
openvstorage-cinder-plugin 1.2.2-rev.38.dcc3b76-1 amd64 OpenvStorage Cinder plugin for OpenStack
openvstorage-core 2.7.3-rev.3956.a9861c0-1 amd64 openvStorage core
openvstorage-hc 1.7.3-rev.699.85f8422-1 amd64 openvStorage Backend plugin HyperConverged
openvstorage-sdm 1.6.3-rev.352.76af109-1 amd64 Open vStorage Backend ASD Manager
openvstorage-webapps 2.7.3-rev.3956.a9861c0-1 amd64 openvStorage Web Applications

Copied from original issue: openvstorage/framework-alba-plugin#209

kvanhijf commented 7 years ago

openvstorage-2.7.3-rev.3958.1b99beb

JeffreyDevloo commented 7 years ago

Steps

During the reinstallation of OVH with the latest package, I could not find the same log entries as stated above. Instead found the expected outcome:

2016-09-16 11:33:42 86000 +0200 - perf-roub-03 - 24206/139624026650432 - lib/scheduled tasks - 362 - INFO - Ensure single CHAINED mode - ID 1474018416_XtqA3NdFf1 - Task alba.nsm_checkup finished successfully
2016-09-16 11:33:42 87200 +0200 - perf-roub-03 - 24206/139624026650432 - lib/scheduled tasks - 363 - INFO - Ensure single CHAINED mode - ID 1474018416_XtqA3NdFf1 - Amount of jobs pending for key ovs_ensure_single_alba.nsm_checkup: 0

Test result

Test passed.

openvstorage / framework