Audit Scaling

[iglesiasbrandon]

Summary:

When a node joins the network they go through a vetting process. One aspect of the node vetting process is auditing the nodes for pieces they should be storing. A node must successfully complete a certain number of audits to pass the vetting process. As more and more nodes join the network the vetting process for each individual node takes longer because the satellite is limited on how many total audits it can perform.

Another item this will help ensure is that we are not adding low-quality storage nodes to the network. adding these low-quality nodes to the network will affect our object's durability in the long term.

Pain Point:

Because we are not able to scale our audit workers horizontally the satellite is limited to how many audits it can perform. This means that as we onboard new nodes and store more data on the network the node vetting process takes longer and longer.

Intended Outcome:

We are able to scale node auditing on the fly depending on how many new nodes have joined the network recently or how much more data is being stored on the network.

Milestones

• Planning Phase - Horizontally Scalable Storage Node Auditing https://github.com/storj/storj/milestone/19

[iglesiasbrandon]

Design Doc: https://storjlabs.atlassian.net/wiki/spaces/TD/pages/2343010305/Design+Audit+Scaling

[storjrobot]

This issue has been mentioned on Storj Community Forum (official). There might be relevant details there:

https://forum.storj.io/t/audits-stopped-why/20995/6

[storjrobot]

This issue has been mentioned on Storj Community Forum (official). There might be relevant details there:

https://forum.storj.io/t/audits-stopped-why/20995/50