GTIL with multithreading

triton-inference-server / fil_backend

FIL backend for the Triton Inference Server

Apache License 2.0

68 stars 35 forks source link

Closed hcho3 closed 2 years ago

hcho3 commented 2 years ago

Depends on dmlc/treelite#344.

wphicks commented 2 years ago

This looks fantastic! Could we just add documentation for cpu_nthread?

hcho3 commented 2 years ago

Closing this in favor of #194