jina-ai / serve

☁️ Build multimodal AI applications with cloud-native stack
https://jina.ai/serve
Apache License 2.0
21.13k stars 2.22k forks source link

feat: return the number of shards failed (if any) in the Header proto #5349

Closed girishc13 closed 1 year ago

girishc13 commented 2 years ago

Describe the feature

5336 adds the feature to returns incomplete response if one or more shards are failing. This will allow the search functionality to function even if one shard is unavailable. The shard unavailability can be temporary or permanent. Its up to the client to react on this information about incomplete responses.

Your proposal

The shard failure count is returned in the Head Runtime call metadata. Propagating this information to the client using the Header proto enables the client to make decisions if the partial response can be utilised or not.

Environment

Screenshots

jina-bot commented 1 year ago

@jina-ai/product This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 14 days