search

triton-inference-server / fil_backend

FIL backend for the Triton Inference Server
Apache License 2.0
68 stars 35 forks source link

[BUG] cuml binary classification models do not observe threshold #351

Open RAMitchell opened 1 year ago

RAMitchell commented 1 year ago

When setting threshold=0.9, cuml models for CPU or GPU do not appear to observe the threshold.

Other model types seem to be working.

RAMitchell commented 1 year ago

This is occurring because these binary classification models are stored by treelite as vector leaf models, which are handled differently in postprocessing code and do not account for thresholds.