Design testing spec

[mhchia]

What is wrong?

The testing spec is not clear for now.

How can it be fixed?

Design a formal testing spec

• Network topology
  • Description for nodes(latency, connections, actor(role), …)
  • Spinning up nodes at beginning or gradually?
  • Deterministic simulations(can be reproduced)
  • Stochastic factors(e.g. nodes arriving time, random delay between actions, ...)
  • Survey if YANG helps
• Failure conditions

[jrhea]

I think it would be good to design it to add some sort of stochastic element to the simulation. You could sample from an exponential distribution to generate the time until the next node joins or leaves. This is also nice bc you can modify the behavior of the sim by simply changing the params of the distribution.

[mhchia]

Agree. My thought was to start from the deterministic simulation, because it is easier to reproduce. We can also have stochastic factors specified in the spec.

[mhchia]

I have updated it in the issue, thanks a lot for pointing it out!

[mhchia]

Point to the testing plan: https://notes.ethereum.org/Q_kQKXZUQD29YCshej1qPQ