We currently have a flag that allows us to turn off polling for incoming kafka messages. We should also add an in-memory flag that allows us to stop the processors when we experience errors.
Is your feature request related to a problem?
If an error occurs, we want to stop processing reports/ report slices due to potential data loss.
Describe the solution you'd like
We should add an in-memory variable that allows us to turn off both the report processor and the report slice processor. > and possibly the report consumer as well
Acceptance Criteria:
[ ] Verify that when errors occur, we are able to stop yupana so that data loss doesn't happen
Feature description:
We currently have a flag that allows us to turn off polling for incoming kafka messages. We should also add an in-memory flag that allows us to stop the processors when we experience errors.
Is your feature request related to a problem?
If an error occurs, we want to stop processing reports/ report slices due to potential data loss.
Describe the solution you'd like
We should add an in-memory variable that allows us to turn off both the report processor and the report slice processor. > and possibly the report consumer as well
Acceptance Criteria:
Additional context
Potentially helpful links from Quipucords: 1) Create variable https://github.com/quipucords/quipucords/blob/master/quipucords/scanner/job.py#L42
2) Changing value of variable https://github.com/quipucords/quipucords/blob/master/quipucords/scanner/manager.py#L134-L139
3) Reading value of variable https://github.com/quipucords/quipucords/blob/master/quipucords/scanner/manager.py#L134-L139