search

triton-inference-server / fil_backend

FIL backend for the Triton Inference Server
Apache License 2.0
67 stars 35 forks source link

[WIP] [GTIL] Allow predicting with FP32 input + FP64 model #393

Closed hcho3 closed 3 days ago

hcho3 commented 3 days ago

Closes #391

TODO: Add a test to test inference with FP32 input and FP64 model using GTIL.