In order to facilitate the expansion of more writing methods in the future, the writing part has been reconstructed. The main reconstruction contents are as follows:
Loader API
The Loader API defines three behaviors:
load: write data to doris
commit: commit transaction
abort: abort transaction
TransactionHandler
The TransactionHandler component is used to process all pre-committed transactions after the task or batch ends.
When all tasks succeed, all pre-submitted tasks will be submitted; when some tasks fail, all pre-submitted tasks will be rolled back.
The execution of transaction commit and rollback depends on the specific implementation of the commit and abort methods implemented by the loader.
Other changes:
update revision to 1.4.0-SNAPSHOT
add isSuccess method for RespContent to check whether the stream load is sucess internally
Checklist(Required)
Does it affect the original behavior: (Yes/No/I Don't know)
Has unit tests been added: (Yes/No/No Need)
Has document been added or modified: (Yes/No/No Need)
Does it need to update dependencies: (Yes/No)
Are there any changes that cannot be rolled back: (Yes/No)
Further comments
If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...
Proposed changes
Issue Number: close #xxx
Problem Summary:
In order to facilitate the expansion of more writing methods in the future, the writing part has been reconstructed. The main reconstruction contents are as follows:
LoaderAPI The Loader API defines three behaviors:load: write data to doriscommit: commit transactionabort: abort transactionTransactionHandlerTheTransactionHandlercomponent is used to process all pre-committed transactions after the task or batch ends. When all tasks succeed, all pre-submitted tasks will be submitted; when some tasks fail, all pre-submitted tasks will be rolled back. The execution of transaction commit and rollback depends on the specific implementation of thecommitandabortmethods implemented by the loader.Other changes:
revisionto1.4.0-SNAPSHOTisSuccessmethod forRespContentto check whether the stream load is sucess internallyChecklist(Required)
Further comments
If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...