pschanely / hypothesis-crosshair

Level-up your Hypothesis tests with CrossHair
MIT License
8 stars 0 forks source link

Do something when argument realization fails #20

Closed pschanely closed 1 month ago

pschanely commented 1 month ago

When life gets too hard for the solver, it'll raise an UnknownSatisfiability error, and then there's a good chance that our argument realization code produce the same exception, failing to find concrete values for the draws. We probably need to extend the solver timeout during realization and/or wipe the solver state and pretend it was a useless/trivial iteration.

This is the root cause of hypothesis test failures like returning a symbolic type from provider.realize(obj) (comment, CI)

pschanely commented 1 month ago

It's more of a workaround, but have something that will hopefully help in 0.0.11