search

triton-inference-server / fil_backend

FIL backend for the Triton Inference Server
Apache License 2.0
72 stars 36 forks source link

[WIP] [GTIL] Allow predicting with FP32 input + FP64 model #393

Closed hcho3 closed 5 months ago

hcho3 commented 5 months ago

Closes #391

TODO: Add a test to test inference with FP32 input and FP64 model using GTIL.