speed-up correlation selection transformers, make them deterministic

[solegalli]

closes #619 closes #648 closes #633 closes #612 closes #446 closes #684 closes #570 closes #703

FYI @dlaprins @glevv

Sorts variables alphabetically to avoid different results. Adds adaptation of @dlaprins numpy implementation to speed search.

I'd like to keep the brute force correlation plain simple. And then we add the ordering per cardinality, etc to the smart correlation, which sort of has it already.

• [x] speed up search in smartcorrelationselection
• [x] check ordering implementation in smartcorrelationselection
• [x] take care of transitivity in smart corr selection
• [x] add tests for find_single_features
• [x] fix tests for smart correlation selection - need to create specific dfs to control for variance, cardinality and missing data
• [x] sort out unrelated error (newer versions of some libraries)
• [x] update correlation documentation (rst files in user_guide)
• [x] expand user guide on smart correlation selection
• [x] improve tests for recursive feature elimination (they are failing at the moment)
• [x] check python 3.11 and 3.12 images on circle ci
• [ ] check check_classification_targets and why it fails for decision tree encoder

The unrelated error is in the recursive feature selectors. Something change in the estimators, or random state or something that now the values are different. Need to make that deterministic somehow.

[solegalli]

Observations:

I could take the opportunity to speed up the selection tests for the recursive feature elimination, those are the ones failing.

The documentation for the smart correlation selector, could also be improved by showcasing the other methodologies.

[codecov[bot]]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (3571426) 98.16% compared to head (f6163cf) 98.31%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #721 +/- ## ========================================== + Coverage 98.16% 98.31% +0.15% ========================================== Files 103 103 Lines 3930 3928 -2 Branches 771 764 -7 ========================================== + Hits 3858 3862 +4 + Misses 26 23 -3 + Partials 46 43 -3 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.