Design testing spec - Githubissues

ethresearch / sharding-p2p-poc

Proof of Concept of Ethereum Serenity Peer-to-Peer Layer on libp2p PubSub System

40 stars 19 forks source link

Design testing spec #24

Open mhchia opened 6 years ago

mhchia commented 6 years ago

What is wrong?

The testing spec is not clear for now.

How can it be fixed?

Design a formal testing spec

Network topology
- Description for nodes(latency, connections, actor(role), …)
- Spinning up nodes at beginning or gradually?
- Deterministic simulations(can be reproduced)
- Stochastic factors(e.g. nodes arriving time, random delay between actions, ...)
- Survey if YANG helps
Failure conditions

jrhea commented 6 years ago

I think it would be good to design it to add some sort of stochastic element to the simulation. You could sample from an exponential distribution to generate the time until the next node joins or leaves. This is also nice bc you can modify the behavior of the sim by simply changing the params of the distribution.

mhchia commented 6 years ago

Agree. My thought was to start from the deterministic simulation, because it is easier to reproduce. We can also have stochastic factors specified in the spec.

mhchia commented 6 years ago

I have updated it in the issue, thanks a lot for pointing it out!

mhchia commented 5 years ago

Point to the testing plan: https://notes.ethereum.org/Q_kQKXZUQD29YCshej1qPQ