Performance Tuning & Optimizations (PTO) - 25% improvement on 4 MB from unconstrained Gateway

[iglesiasbrandon]

Reduce the 4 MB download benchmark from an unconstrained Gateway by 25%

The goal of this Roadmap item is to move the blue line down

Milestones

• Discovery and research
• Trasmission protocol improvements
• Storage Node Performance
• Satellite Performance Improvements
• Uplink/ Gateway MT

Google Docs:

• Storj Performance Challenges: https://docs.google.com/document/d/1wRM0VczKD3ckteyEuU9dG9WsHSfJpp7EJ2xScwVMGac/edit?pli=1#heading=h.njnzyw7ebgue
• https://docs.google.com/document/d/117BcZDsZs5ajwfRmYKyQln_xL8QH7NTRYquyiikfhVQ/edit

[iglesiasbrandon]

Some Random Notes:

Rough - Latency issues

• satellite to DB work
• Uplink to satellite
• gateway to uplink
• uplink to storage node

Rough - Throughput issues

• upload code path might help
• download refactor
• improve storage node selection
  • we have a good chance of getting slow nodes

[storjrobot]

This issue has been mentioned on Storj Community Forum (official). There might be relevant details there:

https://forum.storj.io/t/lets-talk-about-the-elephant-in-the-room-the-storj-economic-model-node-operator-payout-model/20127/943

[iglesiasbrandon]

@shaupt131 you and I need to clean up the unfinished items on this roadmap item and move them to #72

[iglesiasbrandon]

Closing this issue because we have completed this.

[shaupt131]

The only outstanding items we plan on finishing under the umbrella of this milestone are Blake3, regional CRDB changes, outstanding transmission protocol improvements, and Gateway/storage node connection caching. All other work will move to new milestones/projects. @elek