paulegradie / Sailfish

Sailfish - a production friendly performance benchmark runner for .NET
https://paulgradie.com/Sailfish/
MIT License
11 stars 4 forks source link

Enable before / after test comparison via the TestAdapter #28

Closed paulegradie closed 10 months ago

paulegradie commented 1 year ago

When running tests via the SailfishRunner, we invoke logic that writes tracking data and subsequently invoke logic that performs a comparative analysis.

This doesn't happen when using the test adapter... yet! It would be really nice to be able to define a SettingsContextObject that can be read via VS TEST and provided to the test adapter, which would then perform the comparisons as part of the tests (writing output files locally even).

Such a thing would better streamline consumption of the test results.

paulegradie commented 10 months ago

This is now implemented!

paulegradie commented 10 months ago

Addressed in https://github.com/paulegradie/Sailfish/pull/90