jina-ai / jina

☁️ Build multimodal AI applications with cloud-native stack
https://docs.jina.ai
Apache License 2.0
20.54k stars 2.21k forks source link

feat: support provider endpoint in jina executor #6149

Closed zac-li closed 3 months ago

zac-li commented 4 months ago

Goals

Added --provider-endpoint in jina executor serve so that we can specify the endpoint used in SageMaker integration for /invocations.

This is needed for Colbert use case as in the Executor we have multiple endpoints, and each SageMaker model package needs to use different endpoint for /invocations from the same Executor container.

codecov[bot] commented 4 months ago

Codecov Report

Attention: Patch coverage is 11.11111% with 8 lines in your changes are missing coverage. Please review.

Project coverage is 75.02%. Comparing base (8a58dfa) to head (14dc3d1). Report is 3 commits behind head on master.

Files Patch % Lines
jina/serve/executors/__init__.py 0.00% 8 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #6149 +/- ## ========================================== - Coverage 75.04% 75.02% -0.02% ========================================== Files 152 152 Lines 14095 14100 +5 ========================================== + Hits 10577 10578 +1 - Misses 3518 3522 +4 ``` | [Flag](https://app.codecov.io/gh/jina-ai/jina/pull/6149/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=jina-ai) | Coverage Δ | | |---|---|---| | [jina](https://app.codecov.io/gh/jina-ai/jina/pull/6149/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=jina-ai) | `75.02% <11.11%> (-0.02%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=jina-ai#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.