dxos / gravity

System testing frameworks.

GNU Affero General Public License v3.0

1 stars 1 forks source link

Gravity - Halo startup test #59

Open alexwykoff opened 3 years ago

alexwykoff commented 3 years ago

[x] 5 Agents connect to the same party
[x] Each agent writes 10 messages
[x] Number of agents and number of messages should be easily configured variables
[ ] Performance graph of ECHO under this stress test
[ ] A/B comparison with and without snapshotting to compare performance
[x] 10 agents with 100 messages each

dmaretskyi commented 3 years ago

Performance graph of ECHO under this stress test

Will need to figure out how to stream metrics back to the orchestrator, but shouldn't be terribly difficult

A/B comparison with and without snapshotting to compare performance

Bot config is set by bot factory now, but I think we can expand the protocol to include it in the spawn options

dmaretskyi commented 3 years ago

I've got a scaled down version of this test to work with 5 agents * 10 messages each. The bad news are that past this point the system just stops working

dmaretskyi commented 3 years ago

63 to track that

dmaretskyi commented 3 years ago

2 200 configuration seems to work. on 2 500 sometimes I see a weird timeout #64

dmaretskyi commented 3 years ago

All of the above applies to agents running in chrome