Check what causes the difference between XGBoost and XGBoostClassifier-sklearn, when determining signals from total_dataset.pkl. Can't have "the same classifier" give you ~5% (seems ok) or for the second classifier ~40% of unknown data being signal (doesn't seem OK) #13