One thing I'm seeing in the unixfs exporter is single block gets over bitswap. Basically, I think that this is causing bitswap messages with only 1 block to be sent out since we're waiting for each one. I think we might be able to get a nice speed up if all the links (or a sensible subset) were requested from the blockstore (bitswap) concurrently.
achingbrain
commented
1 year ago
One thing I'm seeing in the unixfs exporter is single block gets over bitswap. Basically, I think that this is causing bitswap messages with only 1 block to be sent out since we're waiting for each one. I think we might be able to get a nice speed up if all the links (or a sensible subset) were requested from the blockstore (bitswap) concurrently.