apache / inlong

Apache InLong - a one-stop, full-scenario integration framework for massive data
https://inlong.apache.org/
Apache License 2.0
1.37k stars 533 forks source link

[Feature][SDK] InlongSDK support retry sending when failed #10464

Open vernedeng opened 3 months ago

vernedeng commented 3 months ago

Description

When InlongSDK fails to send data to DataProxy, it returns the failure to the user directly. Add the capability to retry sending.

image

Location: inlong-sdk/dataproxy-sdk/

Requirements:

  1. Choose another dataproxy node to resend data when the send fails.
  2. Able to configure max retry times.
  3. Check failures and only retry those retriable, discard those not.

This issue is a dedicated issue for the 2024 Tencent Rhino-bird Open Source Talent Training event and is only available for college students to claim 【Claim the issue】Sign up for the corresponding issue in columns M~R of the Research and Study Base "issue Camp" to be considered as successfully claimed. 【Complete the issue】For students who have claimed the issue, please also reply "Successfully claimed this issue" in the comment section of this issue; if there is no progress submitted within 7 days, including but not limited to comments, commits, or Pull Requests, it will be considered as voluntarily giving up the issue and the committee will release the issue to the next person in line.

Use case

No response

Are you willing to submit PR?

Code of Conduct

Hackerismydream commented 3 months ago

Successfully claimed this issue

github-actions[bot] commented 1 month ago

This issue is stale because it has been open for 60 days with no activity.