YDB FQ: support Logging as an external data source

[vitalyisaev2]

Changelog entry

• YDB FQ: support Logging as an external data source

Changelog category

• New feature

Additional information

...

[github-actions[bot]]

:white_circle: 2024-11-19 20:59:27 UTC Pre-commit check linux-x86_64-release-asan for fb9893cd4b2994541a08258c3f62fe5273bccf0a has started. :white_circle: 2024-11-19 20:59:38 UTC Artifacts will be uploaded here :white_circle: 2024-11-19 21:03:04 UTC ya make is running... :yellow_circle: 2024-11-19 22:42:19 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history	Ya make output	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11212	11137	0	21	5	49

:green_circle: 2024-11-19 22:43:14 UTC Build successful. :yellow_circle: 2024-11-19 22:43:43 UTC ydbd size 4.9 GiB changed* by +229.5 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: 9c294d8c6c3e536454a850244386e7508b3932a1	merge: fb9893cd4b2994541a08258c3f62fe5273bccf0a	diff	diff %
ydbd size	5 264 856 832 Bytes	5 265 091 856 Bytes	+229.5 KiB	+0.004%
ydbd stripped size	1 351 626 640 Bytes	1 351 674 320 Bytes	+46.6 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-19 20:59:48 UTC Pre-commit check linux-x86_64-relwithdebinfo for fb9893cd4b2994541a08258c3f62fe5273bccf0a has started. :white_circle: 2024-11-19 20:59:59 UTC Artifacts will be uploaded here :white_circle: 2024-11-19 21:03:36 UTC ya make is running... :yellow_circle: 2024-11-19 22:42:21 UTC Some tests failed, follow the links below. Going to retry failed tests...

[Test history](https://nebius.testmo.net/automation/runs/view/80209) | [Ya make output](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11921608797/ya-x86-64/ya_make_output.txt) | [Test bloat](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11921608797/ya-x86-64/try_1/test_bloat/tree_map.html) | TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED^{[?](https://github.com/ydb-platform/ydb/tree/main/.github/config/muted_ya.txt "All mute rules are defined here")} | | ---: | ---: | ---: | ---: | ---: | ---: | | [75965](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11921608797/ya-x86-64/try_1/ya-test.html) | [61866](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11921608797/ya-x86-64/try_1/ya-test.html#PASS) | 0 | [1](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11921608797/ya-x86-64/try_1/ya-test.html#FAIL) | [13984](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11921608797/ya-x86-64/try_1/ya-test.html#SKIP) | [114](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11921608797/ya-x86-64/try_1/ya-test.html#MUTE) |

:white_circle: 2024-11-19 22:49:27 UTC ya make is running... (failed tests rerun, try 2) :green_circle: 2024-11-19 23:01:01 UTC Tests successful.

Test history	Ya make output	Test bloat	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
113 (only retried tests)	5	0	0	0	108

:green_circle: 2024-11-19 23:01:08 UTC Build successful. :yellow_circle: 2024-11-19 23:01:27 UTC ydbd size 2.5 GiB changed* by +104.0 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: 9c294d8c6c3e536454a850244386e7508b3932a1	merge: fb9893cd4b2994541a08258c3f62fe5273bccf0a	diff	diff %
ydbd size	2 686 281 088 Bytes	2 686 387 552 Bytes	+104.0 KiB	+0.004%
ydbd stripped size	481 287 216 Bytes	481 302 096 Bytes	+14.5 KiB	+0.003%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-20 08:16:43 UTC Pre-commit check linux-x86_64-release-asan for d56591e42b93e6ba79d9ac56df842b88dd525959 has started. :white_circle: 2024-11-20 08:16:55 UTC Artifacts will be uploaded here :white_circle: 2024-11-20 08:20:21 UTC ya make is running... :black_circle: 2024-11-20 08:22:48 UTC Check cancelled

[github-actions[bot]]

:white_circle: 2024-11-20 08:17:08 UTC Pre-commit check linux-x86_64-relwithdebinfo for d56591e42b93e6ba79d9ac56df842b88dd525959 has started. :white_circle: 2024-11-20 08:17:19 UTC Artifacts will be uploaded here :white_circle: 2024-11-20 08:20:49 UTC ya make is running... :black_circle: 2024-11-20 08:22:49 UTC Check cancelled

[github-actions[bot]]

:white_circle: 2024-11-20 08:24:14 UTC Pre-commit check linux-x86_64-relwithdebinfo for 683b450b85da2909f34c59f72f28c2fb96270111 has started. :white_circle: 2024-11-20 08:24:20 UTC Artifacts will be uploaded here :white_circle: 2024-11-20 08:27:44 UTC ya make is running... :black_circle: 2024-11-20 08:28:21 UTC Check cancelled

[github-actions[bot]]

:white_circle: 2024-11-20 08:26:45 UTC Pre-commit check linux-x86_64-release-asan for 683b450b85da2909f34c59f72f28c2fb96270111 has started. :white_circle: 2024-11-20 08:26:57 UTC Artifacts will be uploaded here :black_circle: 2024-11-20 08:28:20 UTC Check cancelled

[github-actions[bot]]

:white_circle: 2024-11-20 08:32:40 UTC Pre-commit check linux-x86_64-relwithdebinfo for 88dc23e873cd364f439bd8e535ac99b8c1c79152 has started. :white_circle: 2024-11-20 08:32:51 UTC Artifacts will be uploaded here :white_circle: 2024-11-20 08:36:28 UTC ya make is running... :yellow_circle: 2024-11-20 10:17:21 UTC Some tests failed, follow the links below. Going to retry failed tests...

[Test history](https://nebius.testmo.net/automation/runs/view/80305) | [Ya make output](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11929501105/ya-x86-64/ya_make_output.txt) | [Test bloat](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11929501105/ya-x86-64/try_1/test_bloat/tree_map.html) | TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED^{[?](https://github.com/ydb-platform/ydb/tree/main/.github/config/muted_ya.txt "All mute rules are defined here")} | | ---: | ---: | ---: | ---: | ---: | ---: | | [75978](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11929501105/ya-x86-64/try_1/ya-test.html) | [61873](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11929501105/ya-x86-64/try_1/ya-test.html#PASS) | 0 | [6](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11929501105/ya-x86-64/try_1/ya-test.html#FAIL) | [13984](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11929501105/ya-x86-64/try_1/ya-test.html#SKIP) | [115](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11929501105/ya-x86-64/try_1/ya-test.html#MUTE) |

:white_circle: 2024-11-20 10:24:20 UTC ya make is running... (failed tests rerun, try 2) :green_circle: 2024-11-20 10:36:16 UTC Tests successful.

Test history	Ya make output	Test bloat	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
117 (only retried tests)	9	0	0	0	108

:green_circle: 2024-11-20 10:36:22 UTC Build successful. :yellow_circle: 2024-11-20 10:36:43 UTC ydbd size 2.5 GiB changed* by +112.4 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: 509152a5675bc7cef11e90eeb815e3b9936220e1	merge: 88dc23e873cd364f439bd8e535ac99b8c1c79152	diff	diff %
ydbd size	2 686 289 944 Bytes	2 686 405 080 Bytes	+112.4 KiB	+0.004%
ydbd stripped size	481 288 816 Bytes	481 308 624 Bytes	+19.3 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-20 08:32:41 UTC Pre-commit check linux-x86_64-release-asan for 88dc23e873cd364f439bd8e535ac99b8c1c79152 has started. :white_circle: 2024-11-20 08:32:52 UTC Artifacts will be uploaded here :white_circle: 2024-11-20 08:36:19 UTC ya make is running... :yellow_circle: 2024-11-20 10:13:26 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history	Ya make output	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11224	11145	0	23	7	49

:green_circle: 2024-11-20 10:14:22 UTC Build successful. :yellow_circle: 2024-11-20 10:14:51 UTC ydbd size 4.9 GiB changed* by +240.5 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: 509152a5675bc7cef11e90eeb815e3b9936220e1	merge: 88dc23e873cd364f439bd8e535ac99b8c1c79152	diff	diff %
ydbd size	5 264 873 576 Bytes	5 265 119 824 Bytes	+240.5 KiB	+0.005%
ydbd stripped size	1 351 631 312 Bytes	1 351 680 720 Bytes	+48.2 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-21 08:03:03 UTC Pre-commit check linux-x86_64-relwithdebinfo for 2247f089fc8515d719238bd52f3040ce971cb25d has started. :white_circle: 2024-11-21 08:03:15 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 08:06:35 UTC ya make is running... :yellow_circle: 2024-11-21 09:32:56 UTC Some tests failed, follow the links below. Going to retry failed tests...

[Test history](https://nebius.testmo.net/automation/runs/view/80715) | [Ya make output](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11948957086/ya-x86-64/ya_make_output.txt) | [Test bloat](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11948957086/ya-x86-64/try_1/test_bloat/tree_map.html) | TESTS | PASSED | ERRORS | FAILED | SKIPPED | MUTED^{[?](https://github.com/ydb-platform/ydb/tree/main/.github/config/muted_ya.txt "All mute rules are defined here")} | | ---: | ---: | ---: | ---: | ---: | ---: | | [42622](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11948957086/ya-x86-64/try_1/ya-test.html) | [36948](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11948957086/ya-x86-64/try_1/ya-test.html#PASS) | 0 | [3](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11948957086/ya-x86-64/try_1/ya-test.html#FAIL) | [5559](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11948957086/ya-x86-64/try_1/ya-test.html#SKIP) | [112](https://storage.yandexcloud.net/ydb-gh-logs/ydb-platform/ydb/PR-check/11948957086/ya-x86-64/try_1/ya-test.html#MUTE) |

:white_circle: 2024-11-21 09:36:32 UTC ya make is running... (failed tests rerun, try 2) :green_circle: 2024-11-21 09:48:11 UTC Tests successful.

Test history	Ya make output	Test bloat	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
114 (only retried tests)	7	0	0	0	107

:green_circle: 2024-11-21 09:48:18 UTC Build successful. :yellow_circle: 2024-11-21 09:48:36 UTC ydbd size 2.5 GiB changed* by +110.3 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: 41baaddb6040fedb58166db7d654cfdb3fb36663	merge: 2247f089fc8515d719238bd52f3040ce971cb25d	diff	diff %
ydbd size	2 689 511 792 Bytes	2 689 624 752 Bytes	+110.3 KiB	+0.004%
ydbd stripped size	482 297 296 Bytes	482 316 976 Bytes	+19.2 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-21 08:03:22 UTC Pre-commit check linux-x86_64-release-asan for 2247f089fc8515d719238bd52f3040ce971cb25d has started. :white_circle: 2024-11-21 08:03:33 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 08:06:52 UTC ya make is running... :yellow_circle: 2024-11-21 09:41:34 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history	Ya make output	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11190	11124	0	12	5	49

:green_circle: 2024-11-21 09:42:29 UTC Build successful. :yellow_circle: 2024-11-21 09:42:57 UTC ydbd size 4.9 GiB changed* by +238.1 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: 41baaddb6040fedb58166db7d654cfdb3fb36663	merge: 2247f089fc8515d719238bd52f3040ce971cb25d	diff	diff %
ydbd size	5 280 001 744 Bytes	5 280 245 536 Bytes	+238.1 KiB	+0.005%
ydbd stripped size	1 358 852 400 Bytes	1 358 904 816 Bytes	+51.2 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-21 12:29:19 UTC Pre-commit check linux-x86_64-release-asan for 5b4eaff324eb59891189f43d73d636b4ff1a91fe has started. :white_circle: 2024-11-21 12:29:30 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 12:32:48 UTC ya make is running... :yellow_circle: 2024-11-21 14:03:45 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history	Ya make output	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11212	11148	0	9	5	50

:green_circle: 2024-11-21 14:04:40 UTC Build successful. :yellow_circle: 2024-11-21 14:05:08 UTC ydbd size 4.9 GiB changed* by +218.8 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: b76c6f851fa9f8609a3e99409ad50b962626b561	merge: 5b4eaff324eb59891189f43d73d636b4ff1a91fe	diff	diff %
ydbd size	5 281 058 344 Bytes	5 281 282 344 Bytes	+218.8 KiB	+0.004%
ydbd stripped size	1 358 551 696 Bytes	1 358 590 736 Bytes	+38.1 KiB	+0.003%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions[bot]]

:white_circle: 2024-11-21 12:29:38 UTC Pre-commit check linux-x86_64-relwithdebinfo for 5b4eaff324eb59891189f43d73d636b4ff1a91fe has started. :white_circle: 2024-11-21 12:29:50 UTC Artifacts will be uploaded here :white_circle: 2024-11-21 12:33:07 UTC ya make is running... :green_circle: 2024-11-21 14:00:35 UTC Tests successful.

Test history	Ya make output	Test bloat	TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
42674	36996	0	0	5562	116

:green_circle: 2024-11-21 14:04:13 UTC Build successful. :yellow_circle: 2024-11-21 14:04:30 UTC ydbd size 2.5 GiB changed* by +107.9 KiB, which is >= 100.0 KiB vs main: Warning	ydbd size dash	main: b76c6f851fa9f8609a3e99409ad50b962626b561	merge: 5b4eaff324eb59891189f43d73d636b4ff1a91fe	diff	diff %
ydbd size	2 689 709 824 Bytes	2 689 820 288 Bytes	+107.9 KiB	+0.004%
ydbd stripped size	481 841 136 Bytes	481 860 144 Bytes	+18.6 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}