FuelLabs / fuels-ts

Fuel Network Typescript SDK
https://docs.fuel.network/docs/fuels-ts/
Apache License 2.0
44.04k stars 1.35k forks source link

Introduce Benchmark utility to support running different SDK versions #3139

Closed maschad closed 2 months ago

maschad commented 2 months ago

If I would like to measure performance improvements/regressions between two TS SDK versions, we currently have no means of doing that. Ideally we could have a tool that would spin up an instance of two versions of the SDK and perform benchmarking tests such as sending a transaction or deploying a contract

arboleya commented 2 months ago

I think this could use a similar approach to how we do diffs of test coverage: by having two sets of results, one for the master branch and one for the current PR/commit—something like that. If we can upload/retrieve master bench results, we don't need to run things twice

maschad commented 2 months ago

I've done a bit more digging and we may not actually need such a tool as CodeSpeed can give us a historical overview, here's an example of sway

and here's an example of a historical overview of the compile step

If we are satisfied with this I think we can close this issue. Thoughts? @FuelLabs/sdk-ts

Torres-ssf commented 2 months ago

@maschad Nice, this seems to solve the problem.

No opposition from my side to close this issue.

arboleya commented 2 months ago

Agreed.