I want to know whether an attempted fix has worked

ably / test-observability

A web app for storing and displaying information about unit test results.

https://test-observability.herokuapp.com/

Apache License 2.0

0 stars 1 forks source link

I want to know whether an attempted fix has worked #11

Open lawrence-forooghian opened 2 years ago

lawrence-forooghian commented 2 years ago

First question would be: what would be our data storage for attempted fixes?

Git commit messages (e.g. Fixes-Test-Case: dfb2edb8-f95e-4c85-b6a4-43bc5250c06c)
Some message in a PR
Storing some info on the test observability server saying that a test case was fixed in a particular commit

lawrence-forooghian commented 2 years ago

The Git commit message would be my preference. We might want to also be able to add a file at the root of the repo for defining extra fixes, in case we forget to add one in a commit message.

lawrence-forooghian commented 2 years ago

Also, what would we do once we realise that a "fix" on main really hasn't fixed the problem? Would there be a way to mark it as un-fixed?

lawrence-forooghian commented 2 years ago

Perhaps it would be simpler to just have a file of "fixed" test case IDs at the root of the repo.