filecoin-project / consensus

Filecoin consensus work
Other
42 stars 5 forks source link

LBP parameter setting #11

Closed sternhenri closed 5 years ago

sternhenri commented 5 years ago

Using sim

ZenGround0 commented 5 years ago

Thoughts for moving quickly

Treat simulator as the imperfect thing it is. We will never be able to get to "security" by analyzing data coming from a fixed number of simulated trials, we can only patch up huge holes that it uncovers. Let's work under the assumption that only a few trials with very specific properties are enough to start seeing patterns and use patterns that we see to drive the future focus of the project.

Plan

0. Collect the chain length data in a go data structure 1. Output this data to CSV as part of the simulation 2. Debug panic

  1. Choose a chain length say 100 or 1000 and a trial number say 5. Run sweeps on miners. For now let's say 10, 100, 1000, 10000, 100000 miners. LBP = 1 (i.e. current spec)
  2. Plot relevant statistics, for example max chain length at this LBP and miner count
  3. Now sweep LBPs. Let's say 5, 10, 25, 100 up until we see very low forking statistics.
  4. Plot data as we like. I imagine x is LBP, y is a forking statistic and different data series for miner number.
sternhenri commented 5 years ago

The plan looks great.

We need a higher trial number I expect, maybe 10.

I sort of moved to 6 straight off, but we need to do some work on performance here (I expect optimization and parallelism will suffice, as needed we can rent out compute). Let's move as you propose and I expect we'll hit this issue in doing 3 on 100000 miners.

sternhenri commented 5 years ago

Also need to graph difference round num makes with given min num and lbp. Expect: converges after a certain height. Issue is of picking a fork size (finality)

sternhenri commented 5 years ago

1: mvm (minimum viable motivation), phase 2: write down our California construction in a spec PR using phase 1 motivation. phase 3: address attacks potentially exploiting lookback parameters.

mhammersley commented 5 years ago

estimate from @sternhenri is that this is done by aug 30

sternhenri commented 5 years ago

Initial Proposal ready https://observablehq.com/d/a1f9f162194f24ad