thijsmie
commented
2 years ago Hi @jasonxhwu,
I have to dissapoint you: while we are doing performance tests here and there, and escpecially did so in the context of ROS for the humble middleware default selection process (see here) these are not run on AWS. The regular ROS CI does run on AWS and does some performance tests, but that is not performed by "the Eclipse team". Maybe there is another Eclipse team that did work on this, but not that we are aware.
As far as I know performance_test does do inter-host tests if you set it up right. I don't know exactly how that tool interacts with this performance_report batch testing system you mentioned. For the humble report I also scripted the use of performance_test and all that code is open and included in the repository of the report, so maybe that can help you to set this up?
Hey, I'm currently working on testing latency, throughput and other performance metrics for different RMW DDS implementations on a distributed system. I heard from a colleague that the Eclipse team spent a significant amount of time testing the performance of various DDS systems on AWS servers, and I would like to know what software was used. I'm currently using ApexAI's performance_report for batch tests, but they don't have support for testing data transfers between multiple computers and are also constrained by a maximum packet size of 8 mb.