Closed 0xalpharush closed 3 months ago
Well so this is expected behavior and also a bug at the same time.
Expected behavior: A property test that reverts or panics is still considered a test failure. I'm pretty sure this is how echidna does it as well?
Bug: We should attach an execution trace in case of reverts/panics. We should update this.
I had an overflow in the property (in an inner call) and it was failing without showing the trace or indicating that the property is false. It's not very intuitive to classify this as a failure and difficult to debug. In fact, it can obscure truly failing property tests (that return false) due to the first failing input being shown https://github.com/crytic/medusa/blob/72e9b8586ad93b37ff9063ccf3f5b471f934c264/fuzzing/test_case_property_provider.go#L101-L104
I would expect this to be configurable like assertion mode (perhaps they could just be shared?)