In order to adapt the scenario of Doris storage and calculation separation , introduce copy_into load way with sink.load.mode (default stream_load).
The copy_into import method is divided into two stages:
First upload the data to object storage.
Then load the data on the object storage into Doris.
This import method is usually used for synchronization across vpc scenarios.
Problem Summary:
Describe the overview of changes.
Checklist(Required)
Does it affect the original behavior: (Yes/No/I Don't know)
Has unit tests been added: (Yes/No/No Need)
Has document been added or modified: (Yes/No/No Need)
Does it need to update dependencies: (Yes/No)
Are there any changes that cannot be rolled back: (Yes/No)
Further comments
If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...
smallhibiscus
commented
7 months ago
Proposed changes
In order to adapt the scenario of Doris storage and calculation separation , introduce
copy_intoload way withsink.load.mode(defaultstream_load). Thecopy_intoimport method is divided into two stages:This import method is usually used for synchronization across vpc scenarios.
Problem Summary:
Describe the overview of changes.
Checklist(Required)
Further comments
If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...