search

triton-inference-server / fil_backend

FIL backend for the Triton Inference Server
Apache License 2.0
67 stars 35 forks source link

[BUG] Multiclass models must have output_class=true to predict probabilities #350

Open RAMitchell opened 1 year ago

RAMitchell commented 1 year ago

Multiclass models must have the paramers predict_proba=true AND output_class=true in order to predict probabilities, otherwise we get the following backend error:

terminate called after throwing an instance of 'raft::exception'
  what():  exception occurred! file=/rapids_triton/build/_deps/cuml-src/cpp/src/fil/treelite_import.cu line=509: output_class==true is required for multi-class models
Obtained 17 stack frames