[ENH] differential testing for CI tests

sktime / skpro

A unified framework for tabular probabilistic regression, time-to-event prediction, and probability distributions in python

https://skpro.readthedocs.io/en/latest

BSD 3-Clause "New" or "Revised" License

250 stars 46 forks source link

Closed fkiraly closed 4 months ago

fkiraly commented 4 months ago

This PR introduces differential testing for the CI tests, i.e., running tests only if the object or module they test has been changed.

runs tests in benchmarking only if anything in the module has changed, or in metrics
runs tests in datatypes only if anything in the module has changed
runts tests in utils only if anything in the module has changed

Also makes the following changes