stacks-network / stacks-core

The Stacks blockchain implementation
https://docs.stacks.co
GNU General Public License v3.0
3k stars 658 forks source link

[Mutations Testing] for PR: Feat/nakamoto block push #4877 #4881

Open ASuciuX opened 2 weeks ago

ASuciuX commented 2 weeks ago

Is your feature request related to a problem? Please describe. Mutations Testing works by modifying the body of the function to a default return. eg. if i have a sum function which returns int -> the mutant would replace it with return 0

The problem with http request/response functions is that they are waiting for that request/response, but it was erased from the function as it only contains the return value. So the mutant tries to run the unit tests and timeouts.

Describe the solution you'd like These functions cannot be tested with mutants so best approach is to skip them by using skip-headers for functions or files.

Resources

ASuciuX commented 2 weeks ago

Timeout Mutants

These are the initial timed out mutants as each of the workflow jobs stopped after 360 minutes. Probably after skipping these, some new functions would be highlighted.

ASuciuX commented 2 weeks ago

Missed Mutants

These are the initial missed out mutants as each of the workflow jobs stopped after 360 minutes. They highlight these functions have cases not tested. Probably after skipping the timeouts mutants, other mutants would appear as missed/timeout/unviable.