kadena-io / chainweb-node

Chainweb: A Proof-of-Work Parallel-Chain Architecture for Massive Throughput
https://docs.kadena.io/basics/whitepapers/overview
BSD 3-Clause "New" or "Revised" License
250 stars 90 forks source link

Limit concurrency when fetching dependencies from "origin" #103

Open mercadoa opened 5 years ago

mercadoa commented 5 years ago

When pulling dependencies of a Cut, it is first attempted to request those from the origin node of the cut. Dependencies are queried in parallel as they are discovered.

Due to task sharing Concurrency for block headers is (big-O) bounded by the width of the chainweb. However, block headers are small and can be queried quickly. Payloads are potentially large and fetching them could pile up parallel tasks.

This is only an issue for fetching from "origin". If the origin query fails, dependencies are queried through the P2P network with has bounded concurrency.

mercadoa commented 5 years ago

Need Lars to opine on whether this is still needed

mercadoa commented 5 years ago

As per discussion with Lars - keep issue, but not a high priority

mercadoa commented 5 years ago

Moved issue over to chainweb-node (103)