search

Xilinx / inference-server

https://xilinx.github.io/inference-server/
Apache License 2.0
43 stars 13 forks source link

Handle bad requests in each backend #193

Open varunsh-xilinx opened 1 year ago

varunsh-xilinx commented 1 year ago

We need a robust strategy for handling bad requests in each backend. For example, if a request comes with the wrong data type or shape, it needs to be handled and then not passed on to the responder. What should happen if a subset of requests in a batch are bad?