Improve csv import, step 3

[pnv1]

Changelog entry

• Increased ydb import file csv throughput approximately from 70 to 90 MiB/s

Changelog category

• Performance improvement

Issue: https://github.com/ydb-platform/ydb/issues/11678

[github-actions[bot]]

:white_circle: 2024-11-21 17:38:13 UTC Pre-commit check linux-x86_64-relwithdebinfo for 23a8222e2726825171135741543e00832baaec57 has started. :white_circle: 2024-11-21 17:38:24 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 17:41:26 UTC ya make is running... :black_circle: 2024-11-21 18:14:02 UTC Check cancelled

[github-actions[bot]]

:white_circle: 2024-11-21 17:38:39 UTC Pre-commit check linux-x86_64-release-asan for 23a8222e2726825171135741543e00832baaec57 has started. :white_circle: 2024-11-21 17:38:50 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 17:41:44 UTC ya make is running... :black_circle: 2024-11-21 18:14:09 UTC Check cancelled

[github-actions[bot]]

:white_circle: 2024-11-21 18:17:51 UTC Pre-commit check linux-x86_64-relwithdebinfo for 65065065ad1d736b6b2665c1ce57ba2a12873d77 has started. :white_circle: 2024-11-21 18:18:02 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 18:20:58 UTC ya make is running... :yellow_circle: 2024-11-21 19:18:00 UTC Some tests failed, follow the links below. Going to retry failed tests...

[Test history](https://nebius.testmo.net/automation/runs/view/80979) | [Ya make output](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11959183315/ya-x86-64/ya_make_output.txt) | [Test bloat](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11959183315/ya-x86-64/try_1/test_bloat/tree_map.html) | TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED^{[?](https://github.com/ydb-platform/ydb/tree/main/.github/config/muted_ya.txt "All mute rules are defined here")} | | ---: | ---: | ---: | ---: | ---: | ---: | | [40348](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11959183315/ya-x86-64/try_1/ya-test.html) | [34673](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11959183315/ya-x86-64/try_1/ya-test.html#PASS) | 0 | [1](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11959183315/ya-x86-64/try_1/ya-test.html#FAIL) | [5559](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11959183315/ya-x86-64/try_1/ya-test.html#SKIP) | [115](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11959183315/ya-x86-64/try_1/ya-test.html#MUTE) |

:white_circle: 2024-11-21 19:21:23 UTC ya make is running... (failed tests rerun, try 2) :green_circle: 2024-11-21 19:32:47 UTC Tests successful.

Test history	Ya make output	Test bloat	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
115 (only retried tests)	9	0	0	0	106

:green_circle: 2024-11-21 19:32:54 UTC Build successful. :yellow_circle: 2024-11-21 19:33:13 UTC ydbd size 2.5 GiB changed* by +103.9 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: b475488a0dd49a707628f8543e8b5a4c660c4375	merge: 65065065ad1d736b6b2665c1ce57ba2a12873d77	diff	diff %
ydbd size	2 689 793 032 Bytes	2 689 899 376 Bytes	+103.9 KiB	+0.004%
ydbd stripped size	481 860 560 Bytes	481 875 440 Bytes	+14.5 KiB	+0.003%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-21 18:18:04 UTC Pre-commit check linux-x86_64-release-asan for 65065065ad1d736b6b2665c1ce57ba2a12873d77 has started. :white_circle: 2024-11-21 18:18:14 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 18:21:11 UTC ya make is running... :yellow_circle: 2024-11-21 19:23:07 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history	Ya make output	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
9135	9059	0	23	5	48

:green_circle: 2024-11-21 19:23:56 UTC Build successful. :green_circle: 2024-11-21 19:24:22 UTC ydbd size 4.9 GiB changed* by -96 Bytes, which is <= 0 Bytes vs main: OK	ydbd size dash	main: 6f7ecd5a2607c66847adf66d71ae84f4f61ad511	merge: 65065065ad1d736b6b2665c1ce57ba2a12873d77	diff	diff %
ydbd size	5 281 436 568 Bytes	5 281 436 472 Bytes	-96 Bytes	-0.000%
ydbd stripped size	1 358 625 200 Bytes	1 358 625 136 Bytes	-64 Bytes	-0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-21 21:42:09 UTC Pre-commit check linux-x86_64-release-asan for e3ace2d41a2b27509ae1d2bb1de7404ae0fbee5a has started. :white_circle: 2024-11-21 21:42:42 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 21:46:21 UTC ya make is running... :black_circle: 2024-11-21 22:41:38 UTC Check cancelled

[github-actions[bot]]

:white_circle: 2024-11-21 21:42:59 UTC Pre-commit check linux-x86_64-relwithdebinfo for e3ace2d41a2b27509ae1d2bb1de7404ae0fbee5a has started. :white_circle: 2024-11-21 21:43:10 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 21:46:08 UTC ya make is running... :green_circle: 2024-11-21 22:40:57 UTC Tests successful.

Test history	Ya make output	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
40347	34679	0	0	5558	110

:green_circle: 2024-11-21 22:41:44 UTC ydbd size 2.5 GiB changed* by 0 Bytes, which is <= 0 Bytes vs main: OK	ydbd size dash	main: b7cfb3622d26464f73ed7b6163815495a509ffd3	merge: e3ace2d41a2b27509ae1d2bb1de7404ae0fbee5a	diff	diff %
ydbd size	2 689 924 136 Bytes	2 689 924 136 Bytes	0 Bytes	0.000%
ydbd stripped size	481 875 952 Bytes	481 875 952 Bytes	0 Bytes	0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation} :black_circle: 2024-11-21 22:41:46 UTC Check cancelled

[github-actions[bot]]

:white_circle: 2024-11-21 22:45:46 UTC Pre-commit check linux-x86_64-release-asan for ed5e35f198ffa42d900dd4b4152f3ca5dfd662c6 has started. :white_circle: 2024-11-21 22:46:47 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 22:49:44 UTC ya make is running...

[github-actions[bot]]

:white_circle: 2024-11-21 22:45:50 UTC Pre-commit check linux-x86_64-relwithdebinfo for ed5e35f198ffa42d900dd4b4152f3ca5dfd662c6 has started. :white_circle: 2024-11-21 22:47:39 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 22:50:35 UTC ya make is running...