Agg feedz

[goodboy]

Enhances our piker.open_feed() real-time quotes and history managment layer piker.data.feed to accept multi-fqsn inputs to deliver multi-symbol quote streams and a new internal data streaming abstraction/API: .data.Flume which provides the basis for real-time stream mangement, access and measure for the needs of real-time data-flow management and orchestration.

---

Synopsis

The final core-UX feature you always wanted as a chart trader is probably something like:

mult-instrument overlayed real-time and historical data feeds with simultaneous interaction and "current symbol" selectable order mode control..

well, this is finally within reach 😎 and this patch add the "backend" work making it possible 🏄🏼

---

Notes for manual testing

Ideally reviewers run the new feeds test set with pytest tests/test_feeds.py. Note that you'll need to install the piker_pin branch of tractor in order for the test set to run green:

• the requirements file was updates in this patch: https://github.com/pikers/piker/pull/414/files#diff-4d7c51b1efe9043e44439a949dfd92e5827321b34082903477fd04876edb7552
• you can also simply switch to the remote piker_pin branch for tractor if installed in dev mode locally.

---

to land

• [x] fill out commit msg for 7abcb3e0 which was initial (half-working) patch to get basic funtionality

• [x] port all consumer code in clearing, order mode, charting/graphics layer to expect this adjusted Feed api.

• [x] add basic per-brokerd multi-symbol real-time feeds working

  • enables piker.open_feed(fqsns=['btcusdt.binance', 'ethusdt.binance']) as feed) where the delivered Feed now has a .flumes: dict[str, Flume] which enables per-fqsn data flow access, mgmt, measure (see the historical flume for idea behind this abstraction terminology)
  • [x] add a test in test_feeds.py
  • [x] binance multi-symbol case
  • [x] kraken multi-symbol case
  • [x] kraken currently seems to depend on a brokers.toml existing? we should fix this..

• [x] add cross-brokerd multi-feeds such that `piker.open_feed(fqsns=['btcusdt.binance', 'xbtusdt.kraken']) will work with an aggregate receive channel delivering quotes from both backends?

  • [x] multi-brokerdmulti-sym case (kraken+binance`)

---

Test suite TODO: see two comments below

[goodboy]

Le's try to land #421 before this.

[goodboy]

Test suite TODO:

• [x] we can't run binance tests from CI due to ip blacklisting on their end.. see the CI error
  • instead only run kraken tests in CI (using fixture logic for detection) and expect devs to run the full suite manually on PRs
• [x] the initial fix for test failures on teardown was from the combo commits in https://github.com/goodboy/tractor/pull/347, but those fixes compeletely break tractor 😂, so we need either a better fix or to adjust the feeds tests to expect the streaming teardown gunk. good news, seems like this issue went away with the new open_test_pikerd() addition