[BUG] Segfault for max_batch_size 0

triton-inference-server / fil_backend

FIL backend for the Triton Inference Server

Apache License 2.0

67 stars 35 forks source link

[BUG] Segfault for max_batch_size 0 #336

Open wphicks opened 1 year ago

wphicks commented 1 year ago

The FIL backend does not currently support a non-positive max_batch_size value, but setting one results in a segfault. We should update to handle this situation cleanly.