Look at different feature importance / permutation importance for each model

[jinsunij]

• Decide on one model (with a fixed set of features) and roll with it