[Feature][Connector-v2-doris] Can Doris-Connector support multi-be for streamloding directly?

[chess3cake]

Search before asking

• [X] I had searched in the feature and found no similar feature requirement.

Description

When SeaTunnel servers and Doris BE nodes are in different network areas, the FE Stream Load API may return 307 or unauthorized error.

For example, if the SeaTunnel servers are in K8s-A and the Doris cluster is in K8s-B, the Connector v2 Doris uses the Doris FE API for streaming load. This API will be redirected to the internal IP of some Doris BE in K8s-B, causing the process to fail.

https://doris.apache.org/docs/data-operate/import/stream-load-manual?_highlight=streamload#coding-with-streamload

https://doris.apache.org/docs/faq/data-faq#q1-use-stream-load-to-access-fes-public-network-address-to-import-data-but-is-redirected-to-the-intranet-ip

https://github.com/apache/doris/issues/8100

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[chess3cake]

Also in org.apache.seatunnel.connectors.doris.rest.RestService.findPartitions(), the _query_plan API will return internal be domain.If seatunnel server can not ping the be domain, task will fail.

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.