Closed jiekechoo closed 2 weeks ago
Hi @jiekechoo This is expected behavior. https://github.com/openvinotoolkit/model_server/blob/main/docs/demultiplexing.md#dynamic-demultiply_count-parameter While there were plans to return in empty tensor like [0,3,224,224] due to other priorities those never materialized. Is that blocking your current workflow?
Yes,it's blocked. So, I have fixed my inference code call, skip the code 'log.Fatalf' if the server returns ABORTED status.
Describe the bug Error processing InferRequest: rpc error: code = Aborted desc = Pipeline execution aborted due to no content from custom node
gRPC client https://github.com/openvinotoolkit/model_server/blob/main/client/go/kserve-api/grpc_infer_resnet.go
Logs
Configuration
OVMS version: 2024.0.74d2a7cec
OVMS config.json file
CPU, accelerator's versions if applicable: Intel N100
Model metadata: