Scaling the Waku Protocol: A Performance Analysis with Wakurtosis

Daimakaimura commented 1 year ago

Research blog post on Wakurtosis and scaling Waku.

Updated the body of the article expanding some parts
Added bandwidth multiplier heat-map figures
Commented the Discv5 section as we are still waiting for some final data
Added reference to the Tech Report addendum
Added results of last simulations for the Discv5 vs non-Discv5 comparison
Added results of simulations with 0 message rate in discussion
Updated calculations and plots
Updated the results section and plots with the last results

kaiserd commented 1 year ago

Thank you :+1: What is blocking progress here?

sembr would be appreciated :pray:

Daimakaimura commented 1 year ago

@jm-clius @fryorcraken thank you so much for your review!. I pushed some changes including addressing your comments. I also finished the Discv5 vs Non-Discv5 discussion with the latest data. Apologies if I forgot something. @kaiserd it would be nice if you could have a look.

fryorcraken commented 1 year ago

I'll let final review and approval to be handled with Vac team :)

Daimakaimura commented 1 year ago

Just pushed some more changes addressing the comments that were pending. Still waiting for the last round of simulations with a rate of 0 msg/s to expand on that. I will ask for re-review once I added those.

Daimakaimura commented 11 months ago

Just pushed the remaining changes. Also included memory vs nodes plots for clarity in the discussion of the results and to better showcase the different scaling of memory. @kaiserd please let me know if there is something I ve missed.

kaiserd commented 11 months ago

What is the status here? What is blocking? edt: Clarified in meeting, blocked on simulations. -> prio on this Simulation expected to finish towards the end of this week.

kaiserd commented 11 months ago

@Daimakaimura @AlbertoSoutullo What is the status of the simulations?

AlbertoSoutullo commented 11 months ago

@Daimakaimura @AlbertoSoutullo What is the status of the simulations?

I finished them on Thursday around 13:00pm and notified Jordi. He will probably answer about the analysis part when he reads this.

fryorcraken commented 11 months ago

@Daimakaimura could you ping me and @jm-clius once you have updated the post with the latest data please?

Daimakaimura commented 11 months ago

@Daimakaimura could you ping me and @jm-clius once you have updated the post with the latest data please?

Of course!

Daimakaimura commented 11 months ago

@fryorcraken @kaiserd @jm-clius just pushed the last changes with the results of the last round of simulations. Going to ask for re-review.

kaiserd commented 10 months ago

@jm-clius @alrevuelta @fryorcraken

The simulations were done with an older Waku version, and it seems that the ~500 MB bandwidth without sending payload messages might be caused by an anomaly/bug in this Waku version. The experiments will be re-run with an up to date Waku version to confirm this.

Also, this anomaly only appears with higher node counts. @alrevuelta What was the highest node count you tested in waku-simulator? How many peer connections did nodes have in your experiments?

alrevuelta commented 10 months ago

@alrevuelta What was the highest node count you tested in waku-simulator? How many peer connections did nodes have in your experiments?

With waku-simulator around 500 nodes, with shadow 1000. Around 50 connections per node.

vacp2p / vac.dev

Scaling the Waku Protocol: A Performance Analysis with Wakurtosis #123