Miscellaneous fixes for DE 2.0

[knoepfel]

This PR addresses the following issues:

• The block-while timeout now applies to the channels as a whole, and not each channel individually.
• The de-client --status command now reports the status of the channels and the sources.
• When a channel goes offline, any sources that were providing data products to it will be shutdown if no other channels require those data products.
• The de-client --product-dependencies program options has been added, which will print all products produced/consumed for each framework module.
• I have restored the queueing structure that was removed in commit https://github.com/HEPCloud/decisionengine/commit/a7dcc30d7d0d247f7d4dc32dbb518767bfd8b0fd; the difference is that the source queues are now purged after each message publish, thus removing the message bloat that was encountered before.

[codecov[bot]]

Codecov Report

Merging #637 (1d0338b) into master (aeb6b97) will increase coverage by 0.25%. The diff coverage is 99.35%.

@@            Coverage Diff             @@
##           master     #637      +/-   ##
==========================================
+ Coverage   97.26%   97.51%   +0.25%     
==========================================
  Files          49       49              
  Lines        2889     2941      +52     
  Branches      460      469       +9     
==========================================
+ Hits         2810     2868      +58     
+ Misses         53       49       -4     
+ Partials       26       24       -2     

Flag	Coverage Δ
python-3.10	97.31% <99.35%> (+0.32%)	:arrow_up:
python-3.6	97.09% <99.35%> (+0.36%)	:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
.../decisionengine/framework/engine/DecisionEngine.py	93.45% <98.79%> (+1.32%)	:arrow_up:
src/decisionengine/framework/dataspace/maintain.py	100.00% <100.00%> (ø)
.../decisionengine/framework/engine/ChannelWorkers.py	92.06% <100.00%> (+1.27%)	:arrow_up:
...c/decisionengine/framework/engine/SourceWorkers.py	100.00% <100.00%> (ø)
src/decisionengine/framework/engine/de_client.py	100.00% <100.00%> (ø)
...ecisionengine/framework/taskmanager/TaskManager.py	97.46% <100.00%> (+0.01%)	:arrow_up:

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 3d739ec...1d0338b. Read the comment docs.

[pep8speaks]

Hello @knoepfel! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! :beers:

Comment last updated at 2022-04-19 17:57:43 UTC