Open UgnineSirdis opened 7 months ago
Debug info
##>> 2023-12-25 19:12:41.478 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=8&columns_preset=false 200 43708##
##<< 2023-12-25 19:12:41.531##
//Response data//
%%(json) {
"ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '('RecordsCount '\"246375\"))\n(let $39 '('ChunkCount '1))\n(let $40 '('ModifyTime '\"1703520756\"))\n(let $41 '('Revision '\"108065672391361\"))\n(let $42 (YtStat '('Id '\"6249-3e3c9-41a0191-384750c5\") $38 '('DataSize '\"20877430\") $39 $40 $41))\n(let $43 (YtOutTable '\"tmp/313476a5-b5d33092-3caef227-43051fa0\" $37 $33 $42 '()))\n(let $44 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $45 (YqlRowSpec $21 $22 $23 '('Type $44)))\n(let $46 (YtStat '('Id '\"6249-3e3c8-41a0191-5534b834\") $38 '('DataSize '\"19918575\") $39 $40 $41))\n(let $47 (YtOutTable '\"tmp/405d2dcf-b8135036-3d14a947-735fd4fb\" $45 $33 $46 '()))\n(let $48 '@@[\"StructType\";[[\"store.s_store_id\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"store.s_store_name\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"wss.Sum0\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.date_dim.d_week_seq\";[\"OptionalType\";[\"
...%%
##>> 2023-12-25 19:12:41.466 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=7&columns_preset=false 200 43708##
##<< 2023-12-25 19:12:41.572##
//Response data//
%%(json) {
"ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '('RecordsCount '\"246375\"))\n(let $39 '('ChunkCount '1))\n(let $40 '('ModifyTime '\"1703520756\"))\n(let $41 '('Revision '\"108065672391361\"))\n(let $42 (YtStat '('Id '\"6249-3e3c9-41a0191-384750c5\") $38 '('DataSize '\"20877430\") $39 $40 $41))\n(let $43 (YtOutTable '\"tmp/313476a5-b5d33092-3caef227-43051fa0\" $37 $33 $42 '()))\n(let $44 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $45 (YqlRowSpec $21 $22 $23 '('Type $44)))\n(let $46 (YtStat '('Id '\"6249-3e3c8-41a0191-5534b834\") $38 '('DataSize '\"19918575\") $39 $40 $41))\n(let $47 (YtOutTable '\"tmp/405d2dcf-b8135036-3d14a947-735fd4fb\" $45 $33 $46 '()))\n(let $48 '@@[\"StructType\";[[\"store.s_store_id\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"store.s_store_name\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"wss.Sum0\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.date_dim.d_week_seq\";[\"OptionalType\";[\"
...%%
##>> 2023-12-25 19:12:41.465 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004?version=8 200 4104##
##<< 2023-12-25 19:12:41.540##
//Response data//
%%(json) {
"clusterType": "UNKNOWN",
"createdAt": "2023-12-25T16:08:03.337Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6589a8e36455c10195ba1004",
"projectId": "6001d201dd0e49e90533b83a",
"queryData": {
"attributes": {
"user_agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.675 YaBrowser/23.11.1.675 (beta) Yowser/2.5 Safari/537.36"
},
"clusterType": "UNKNOWN",
"content": "\n\n\n-- START PARAMETERS\nuse ada;\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma CompactGroupBy;\n\npragma CostBasedOptimizer=\"Native\";\n\npragma yt.OperationSpec='{time_limit=3600000; locality_timeout=0}';\n\n-- END PARAMETERS\n\n\n\n\n-- START COMMON HEADER\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma yt.TemporaryPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.PublishedPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.IntermediateDataMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.Pool = \"tpcds\";\npragma yt.SchedulingTagFilter = \"%true\";\npragma yt.QueryCacheMode = \"disable\";\n--pragma dq.WorkerFilter='ClusterName: \"ada\"';\n--pragma DqEngine=\"auto\";\npragma yt.HybridDqExecution = \"true\";\npragma yt.AutoMerge = \"disabled\";\npragma yt.DataSizePerJob = \"16M\";\npragma yt.DataSizePerMapJob = \"24M\";\n--pragma yt.DataSizePerSortJob = \"1G\";\npragma yt.DataSizePerPartition = \"64M\";\npragma AnsiOptionalAs;\npragma AnsiInForEmptyOrNullableItemsCollections;\npragma yt.MapJoinLimit = \"33554432\";\n-- END COMMON HEADER\n\n-- NB: Subquerys\n$wss =\n (select date_dim.d_week_seq d_week_seq,\n store_sales.ss_store_sk ss_store_sk,\n sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,\n sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,\n sum(case when (d_day_name='Tuesday') then ss_sales_price else null end) tue_sales,\n sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,\n sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,\n sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,\n sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales\n from store_sales cross join date_dim\n where d_date_sk = ss_sold_date_sk\n group by date_dim.d_week_seq,store_sales.ss_store_sk\n );\n-- start query 1 in stream 0 using template query59.tpl and seed 1819994127\n select s_store_name1,s_store_id1,d_week_seq1\n ,sun_sales1/sun_sales2,mon_sales1/mon_sales2\n ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2\n ,fri_sales1/fri_sales2,sat_sales1/sat_sales2\n from\n (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1\n ,s_store_id s_store_id1,sun_sales sun_sales1\n ,mon_sales mon_sales1,tue_sales tue_sales1\n ,wed_sales wed_sales1,thu_sales thu_sales1\n ,fri_sales fri_sales1,sat_sales sat_sales1\n from $wss wss cross join store cross join date_dim d\n where d.d_week_seq = wss.d_week_seq and\n ss_store_sk = s_store_sk and\n d_month_seq between 1205 and 1205 + 11) y cross join\n (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2\n ,s_store_id s_store_id2,sun_sales sun_sales2\n ,mon_sales mon_sales2,tue_sales tue_sales2\n ,wed_sales wed_sales2,thu_sales thu_sales2\n ,fri_sales fri_sales2,sat_sales sat_sales2\n from $wss wss cross join store cross join date_dim d\n where d.d_week_seq = wss.d_week_seq and\n ss_store_sk = s_store_sk and\n d_month_seq between 1205+ 12 and 1205 + 23) x\n where s_store_id1=s_store_id2\n and d_week_seq1=d_week_seq2-52\n order by s_store_name1,s_store_id1,d_week_seq1\nlimit 100;\n\n-- end query 1 in stream 0 using template query59.tpl",
"files": [],
"parameters": {},
"type": "SQLv1"
},
"queryType": "SQLv1",
"status": "RUNNING",
"updatedAt": "2023-12-25T16:12:41.378Z",
"username": "psushin",
"version": 8,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
"workerPid": "508933",
"workerVersion": "13148296"
}%%
##>> 2023-12-25 19:12:34.908 GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(status%3DPENDING%7Cstatus%3DRUNNING%7Cstatus%3DABORTING),(username%3Dpsushin) 200 470##
##<< 2023-12-25 19:12:34.977##
//Response data//
%%(json) {
"page": {
"count": 1,
"current": 0
},
"result": [
{
"clusterType": "UNKNOWN",
"createdAt": "2023-12-25T16:08:03.337Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6589a8e36455c10195ba1004",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "RUNNING",
"updatedAt": "2023-12-25T16:12:26.429Z",
"username": "psushin",
"version": 7,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
"workerPid": "508933",
"workerVersion": "13148296"
}
]
}%%
##>> 2023-12-25 19:12:33.610 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=&columns_preset=false 200 394##
##<< 2023-12-25 19:12:33.690##
//Response data//
%%(json) {
"errors": [],
"id": "6589a8e36455c10195ba1004",
"issues": [
{
"code": 1070,
"column": 0,
"file": "<main>",
"issues": [
{
"code": 0,
"column": 0,
"file": "<main>",
"issues": [],
"message": "DQ cannot execute the query. Cause: unsupported yt pragma: operationspec",
"row": 0,
"severity": "S_INFO"
}
],
"message": "Optimization",
"row": 0,
"severity": "S_INFO"
}
],
"status": "RUNNING",
"updatedAt": "2023-12-25T16:12:26.408Z",
"version": 7
}%%
##>> 2023-12-25 19:12:26.515 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=7&columns_preset=false 200 40204##
##<< 2023-12-25 19:12:26.570##
//Response data//
%%(json) {
"ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%
##>> 2023-12-25 19:12:26.504 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=6&columns_preset=false 200 40204##
##<< 2023-12-25 19:12:26.598##
//Response data//
%%(json) {
"ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%
##>> 2023-12-25 19:12:26.503 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004?version=7 200 4104##
##<< 2023-12-25 19:12:26.592##
//Response data//
%%(json) {
"clusterType": "UNKNOWN",
"createdAt": "2023-12-25T16:08:03.337Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6589a8e36455c10195ba1004",
"projectId": "6001d201dd0e49e90533b83a",
"queryData": {
"attributes": {
"user_agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.675 YaBrowser/23.11.1.675 (beta) Yowser/2.5 Safari/537.36"
},
"clusterType": "UNKNOWN",
"content": "\n\n\n-- START PARAMETERS\nuse ada;\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma CompactGroupBy;\n\npragma CostBasedOptimizer=\"Native\";\n\npragma yt.OperationSpec='{time_limit=3600000; locality_timeout=0}';\n\n-- END PARAMETERS\n\n\n\n\n-- START COMMON HEADER\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma yt.TemporaryPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.PublishedPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.IntermediateDataMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.Pool = \"tpcds\";\npragma yt.SchedulingTagFilter = \"%true\";\npragma yt.QueryCacheMode = \"disable\";\n--pragma dq.WorkerFilter='ClusterName: \"ada\"';\n--pragma DqEngine=\"auto\";\npragma yt.HybridDqExecution = \"true\";\npragma yt.AutoMerge = \"disabled\";\npragma yt.DataSizePerJob = \"16M\";\npragma yt.DataSizePerMapJob = \"24M\";\n--pragma yt.DataSizePerSortJob = \"1G\";\npragma yt.DataSizePerPartition = \"64M\";\npragma AnsiOptionalAs;\npragma AnsiInForEmptyOrNullableItemsCollections;\npragma yt.MapJoinLimit = \"33554432\";\n-- END COMMON HEADER\n\n-- NB: Subquerys\n$wss =\n (select date_dim.d_week_seq d_week_seq,\n store_sales.ss_store_sk ss_store_sk,\n sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,\n sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,\n sum(case when (d_day_name='Tuesday') then ss_sales_price else null end) tue_sales,\n sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,\n sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,\n sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,\n sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales\n from store_sales cross join date_dim\n where d_date_sk = ss_sold_date_sk\n group by date_dim.d_week_seq,store_sales.ss_store_sk\n );\n-- start query 1 in stream 0 using template query59.tpl and seed 1819994127\n select s_store_name1,s_store_id1,d_week_seq1\n ,sun_sales1/sun_sales2,mon_sales1/mon_sales2\n ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2\n ,fri_sales1/fri_sales2,sat_sales1/sat_sales2\n from\n (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1\n ,s_store_id s_store_id1,sun_sales sun_sales1\n ,mon_sales mon_sales1,tue_sales tue_sales1\n ,wed_sales wed_sales1,thu_sales thu_sales1\n ,fri_sales fri_sales1,sat_sales sat_sales1\n from $wss wss cross join store cross join date_dim d\n where d.d_week_seq = wss.d_week_seq and\n ss_store_sk = s_store_sk and\n d_month_seq between 1205 and 1205 + 11) y cross join\n (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2\n ,s_store_id s_store_id2,sun_sales sun_sales2\n ,mon_sales mon_sales2,tue_sales tue_sales2\n ,wed_sales wed_sales2,thu_sales thu_sales2\n ,fri_sales fri_sales2,sat_sales sat_sales2\n from $wss wss cross join store cross join date_dim d\n where d.d_week_seq = wss.d_week_seq and\n ss_store_sk = s_store_sk and\n d_month_seq between 1205+ 12 and 1205 + 23) x\n where s_store_id1=s_store_id2\n and d_week_seq1=d_week_seq2-52\n order by s_store_name1,s_store_id1,d_week_seq1\nlimit 100;\n\n-- end query 1 in stream 0 using template query59.tpl",
"files": [],
"parameters": {},
"type": "SQLv1"
},
"queryType": "SQLv1",
"status": "RUNNING",
"updatedAt": "2023-12-25T16:12:26.429Z",
"username": "psushin",
"version": 7,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
"workerPid": "508933",
"workerVersion": "13148296"
}%%
##>> 2023-12-25 19:12:11.900 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=6&columns_preset=false 200 39260##
##<< 2023-12-25 19:12:11.988##
//Response data//
%%(json) {
"ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%
##>> 2023-12-25 19:12:11.888 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=5&columns_preset=false 200 39260##
##<< 2023-12-25 19:12:12.114##
//Response data//
%%(json) {
"ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%
##>> 2023-12-25 19:12:11.887 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=5&columns_preset=false 200 39260##
##<< 2023-12-25 19:12:12.033##
//Response data//
%%(json) {
"ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%
##>> 2023-12-25 19:12:11.867 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=5&columns_preset=false 200 39260##
##<< 2023-12-25 19:12:11.959##
//Response data//
%%(json) {
"ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%
##>> 2023-12-25 19:12:11.866 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004?version=6 200 4104##
##<< 2023-12-25 19:12:11.945##
//Response data//
%%(json) {
"clusterType": "UNKNOWN",
"createdAt": "2023-12-25T16:08:03.337Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6589a8e36455c10195ba1004",
"projectId": "6001d201dd0e49e90533b83a",
"queryData": {
"attributes": {
"user_agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.675 YaBrowser/23.11.1.675 (beta) Yowser/2.5 Safari/537.36"
},
"clusterType": "UNKNOWN",
"content": "\n\n\n-- START PARAMETERS\nuse ada;\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma CompactGroupBy;\n\npragma CostBasedOptimizer=\"Native\";\n\npragma yt.OperationSpec='{time_limit=3600000; locality_timeout=0}';\n\n-- END PARAMETERS\n\n\n\n\n-- START COMMON HEADER\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma yt.TemporaryPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.PublishedPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.IntermediateDataMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.Pool = \"tpcds\";\npragma yt.SchedulingTagFilter = \"%true\";\npragma yt.QueryCacheMode = \"disable\";\n--pragma dq.WorkerFilter='ClusterName: \"ada\"';\n--pragma DqEngine=\"auto\";\npragma yt.HybridDqExecution = \"true\";\npragma yt.AutoMerge = \"disabled\";\npragma yt.DataSizePerJob = \"16M\";\npragma yt.DataSizePerMapJob = \"24M\";\n--pragma yt.DataSizePerSortJob = \"1G\";\npragma yt.DataSizePerPartition = \"64M\";\npragma AnsiOptionalAs;\npragma AnsiInForEmptyOrNullableItemsCollections;\npragma yt.MapJoinLimit = \"33554432\";\n-- END COMMON HEADER\n\n-- NB: Subquerys\n$wss =\n (select date_dim.d_week_seq d_week_seq,\n store_sales.ss_store_sk ss_store_sk,\n sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,\n sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,\n sum(case when (d_day_name='Tuesday') then ss_sales_price else null end) tue_sales,\n sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,\n sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,\n sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,\n sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales\n from store_sales cross join date_dim\n where d_date_sk = ss_sold_date_sk\n group by date_dim.d_week_seq,store_sales.ss_store_sk\n );\n-- start query 1 in stream 0 using template query59.tpl and seed 1819994127\n select s_store_name1,s_store_id1,d_week_seq1\n ,sun_sales1/sun_sales2,mon_sales1/mon_sales2\n ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2\n ,fri_sales1/fri_sales2,sat_sales1/sat_sales2\n from\n (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1\n ,s_store_id s_store_id1,sun_sales sun_sales1\n ,mon_sales mon_sales1,tue_sales tue_sales1\n ,wed_sales wed_sales1,thu_sales thu_sales1\n ,fri_sales fri_sales1,sat_sales sat_sales1\n from $wss wss cross join store cross join date_dim d\n where d.d_week_seq = wss.d_week_seq and\n ss_store_sk = s_store_sk and\n d_month_seq between 1205 and 1205 + 11) y cross join\n (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2\n ,s_store_id s_store_id2,sun_sales sun_sales2\n ,mon_sales mon_sales2,tue_sales tue_sales2\n ,wed_sales wed_sales2,thu_sales thu_sales2\n ,fri_sales fri_sales2,sat_sales sat_sales2\n from $wss wss cross join store cross join date_dim d\n where d.d_week_seq = wss.d_week_seq and\n ss_store_sk = s_store_sk and\n d_month_seq between 1205+ 12 and 1205 + 23) x\n where s_store_id1=s_store_id2\n and d_week_seq1=d_week_seq2-52\n order by s_store_name1,s_store_id1,d_week_seq1\nlimit 100;\n\n-- end query 1 in stream 0 using template query59.tpl",
"files": [],
"parameters": {},
"type": "SQLv1"
},
"queryType": "SQLv1",
"status": "RUNNING",
"updatedAt": "2023-12-25T16:12:11.683Z",
"username": "psushin",
"version": 6,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
"workerPid": "508933",
"workerVersion": "13148296"
}%%
##>> 2023-12-25 19:12:04.826 GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(status%3DPENDING%7Cstatus%3DRUNNING%7Cstatus%3DABORTING),(username%3Dpsushin) 200 470##
##<< 2023-12-25 19:12:04.908##
//Response data//
%%(json) {
"page": {
"count": 1,
"current": 0
},
"result": [
{
"clusterType": "UNKNOWN",
"createdAt": "2023-12-25T16:08:03.337Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6589a8e36455c10195ba1004",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "RUNNING",
"updatedAt": "2023-12-25T16:09:56.349Z",
"username": "psushin",
"version": 5,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
"workerPid": "508933",
"workerVersion": "13148296"
}
]
}%%
##>> 2023-12-25 19:12:03.610 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=&columns_preset=false 200 394##
##<< 2023-12-25 19:12:03.712##
//Response data//
%%(json) {
"errors": [],
"id": "6589a8e36455c10195ba1004",
"issues": [
{
"code": 1070,
"column": 0,
"file": "<main>",
"issues": [
{
"code": 0,
"column": 0,
"file": "<main>",
"issues": [],
"message": "DQ cannot execute the query. Cause: unsupported yt pragma: operationspec",
"row": 0,
"severity": "S_INFO"
}
],
"message": "Optimization",
"row": 0,
"severity": "S_INFO"
}
],
"status": "RUNNING",
"updatedAt": "2023-12-25T16:09:56.309Z",
"version": 5
}%%
##>> 2023-12-25 19:11:35.186 GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(username%3Dpsushin),(queryTitle~%3D%27tpcds-1%27%7Ctitle~%3D%27tpcds-1%27) 200 24042##
##<< 2023-12-25 19:11:35.280##
//Response data//
%%(json) {
"page": {
"count": 2,
"current": 0,
"next": 1
},
"result": [
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-26T17:17:58.794Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "65637dc6ced8c52a70f777e4",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "COMPLETED",
"title": "[YQL] YT benchmark tpcds-11",
"updatedAt": "2023-11-26T17:41:17.751Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test03.search.yandex.net",
"workerId": "cd7e9331-587d0fee-fa09ea24-c9766bf9",
"workerPid": "739428",
"workerVersion": "12966812"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-26T17:17:48.968Z",
"execMode": "OPTIMIZE",
"externalQueryIds": [],
"id": "65637dbc93b1cd63559d4c52",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "COMPLETED",
"title": "[YQL] YT benchmark tpcds-11",
"updatedAt": "2023-11-26T17:17:51.333Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test03.search.yandex.net",
"workerId": "cd7e9331-587d0fee-fa09ea24-c9766bf9",
"workerPid": "738984",
"workerVersion": "12966812"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-24T14:50:24.118Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6560b830637b741248eb5cdd",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "ABORTED",
"title": "[YQL] YT benchmark tpcds-11",
"updatedAt": "2023-11-24T14:59:57.582Z",
"username": "psushin",
"version": 1000000,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "d27a5c52-53b81007-a5a4c919-dd757b2a",
"workerPid": "372450",
"workerVersion": "12958092"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-12T21:40:51.479Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6551466324c9596c77206323",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "COMPLETED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-12T21:43:55.596Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test04.search.yandex.net",
"workerId": "1ebe2eb1-9c975cba-f5b576e1-2445c944",
"workerPid": "389917",
"workerVersion": "12878071"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-12T21:36:58.869Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6551457a19caeb697355c221",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "ABORTED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-12T21:40:49.521Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test04.search.yandex.net",
"workerId": "1ebe2eb1-9c975cba-f5b576e1-2445c944",
"workerPid": "382629",
"workerVersion": "12878071"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-12T21:34:35.032Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "655144ebe20a0f3ea4b23016",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "ABORTED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-12T21:36:57.944Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test01.search.yandex.net",
"workerId": "f354c37e-88cf7cf3-9e46228c-54c54db8",
"workerPid": "226041",
"workerVersion": "12878071"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-12T21:31:31.279Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "65514433e20a0f3ea4b22ef0",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "ABORTED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-12T21:33:14.766Z",
"username": "psushin",
"version": 999999,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "5578f6fd-72600263-71702421-16b484a0",
"workerPid": "100981",
"workerVersion": "12878071"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-10T16:28:54.028Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "654e5a46d0a03f00a5d95e39",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "COMPLETED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-10T16:32:14.126Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test04.search.yandex.net",
"workerId": "907e2664-2f04e716-3f59e796-d02edd0a",
"workerPid": "212086",
"workerVersion": "12869149"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-10T13:23:34.020Z",
"execMode": "RUN",
"externa
...%%
##>> 2023-12-25 19:11:34.745 GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(status%3DPENDING%7Cstatus%3DRUNNING%7Cstatus%3DABORTING),(username%3Dpsushin) 200 470##
##<< 2023-12-25 19:11:34.826##
//Response data//
%%(json) {
"page": {
"count": 1,
"current": 0
},
"result": [
{
"clusterType": "UNKNOWN",
"createdAt": "2023-12-25T16:08:03.337Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6589a8e36455c10195ba1004",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "RUNNING",
"updatedAt": "2023-12-25T16:09:56.349Z",
"username": "psushin",
"version": 5,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
"workerPid": "508933",
"workerVersion": "13148296"
}
]
}%%
##>> 2023-12-25 19:11:33.610 GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=&columns_preset=false 200 394##
##<< 2023-12-25 19:11:33.701##
//Response data//
%%(json) {
"errors": [],
"id": "6589a8e36455c10195ba1004",
"issues": [
{
"code": 1070,
"column": 0,
"file": "<main>",
"issues": [
{
"code": 0,
"column": 0,
"file": "<main>",
"issues": [],
"message": "DQ cannot execute the query. Cause: unsupported yt pragma: operationspec",
"row": 0,
"severity": "S_INFO"
}
],
"message": "Optimization",
"row": 0,
"severity": "S_INFO"
}
],
"status": "RUNNING",
"updatedAt": "2023-12-25T16:09:56.309Z",
"version": 5
}%%
##>> 2023-12-25 19:11:11.995 GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(username%3Dpsushin),(queryTitle~%3D%27tpcds-1%27%7Ctitle~%3D%27tpcds-1%27) 200 24042##
##<< 2023-12-25 19:11:12.088##
//Response data//
%%(json) {
"page": {
"count": 2,
"current": 0,
"next": 1
},
"result": [
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-26T17:17:58.794Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "65637dc6ced8c52a70f777e4",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "COMPLETED",
"title": "[YQL] YT benchmark tpcds-11",
"updatedAt": "2023-11-26T17:41:17.751Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test03.search.yandex.net",
"workerId": "cd7e9331-587d0fee-fa09ea24-c9766bf9",
"workerPid": "739428",
"workerVersion": "12966812"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-26T17:17:48.968Z",
"execMode": "OPTIMIZE",
"externalQueryIds": [],
"id": "65637dbc93b1cd63559d4c52",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "COMPLETED",
"title": "[YQL] YT benchmark tpcds-11",
"updatedAt": "2023-11-26T17:17:51.333Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test03.search.yandex.net",
"workerId": "cd7e9331-587d0fee-fa09ea24-c9766bf9",
"workerPid": "738984",
"workerVersion": "12966812"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-24T14:50:24.118Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6560b830637b741248eb5cdd",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "ABORTED",
"title": "[YQL] YT benchmark tpcds-11",
"updatedAt": "2023-11-24T14:59:57.582Z",
"username": "psushin",
"version": 1000000,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "d27a5c52-53b81007-a5a4c919-dd757b2a",
"workerPid": "372450",
"workerVersion": "12958092"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-12T21:40:51.479Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6551466324c9596c77206323",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "COMPLETED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-12T21:43:55.596Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test04.search.yandex.net",
"workerId": "1ebe2eb1-9c975cba-f5b576e1-2445c944",
"workerPid": "389917",
"workerVersion": "12878071"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-12T21:36:58.869Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6551457a19caeb697355c221",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "ABORTED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-12T21:40:49.521Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test04.search.yandex.net",
"workerId": "1ebe2eb1-9c975cba-f5b576e1-2445c944",
"workerPid": "382629",
"workerVersion": "12878071"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-12T21:34:35.032Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "655144ebe20a0f3ea4b23016",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "ABORTED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-12T21:36:57.944Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test01.search.yandex.net",
"workerId": "f354c37e-88cf7cf3-9e46228c-54c54db8",
"workerPid": "226041",
"workerVersion": "12878071"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-12T21:31:31.279Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "65514433e20a0f3ea4b22ef0",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "ABORTED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-12T21:33:14.766Z",
"username": "psushin",
"version": 999999,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "5578f6fd-72600263-71702421-16b484a0",
"workerPid": "100981",
"workerVersion": "12878071"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-10T16:28:54.028Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "654e5a46d0a03f00a5d95e39",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "COMPLETED",
"title": "[YQL] YT benchmark tpcds-1",
"updatedAt": "2023-11-10T16:32:14.126Z",
"username": "psushin",
"version": 1000000,
"workerHost": "yql-front-test04.search.yandex.net",
"workerId": "907e2664-2f04e716-3f59e796-d02edd0a",
"workerPid": "212086",
"workerVersion": "12869149"
},
{
"clusterType": "UNKNOWN",
"createdAt": "2023-11-10T13:23:34.020Z",
"execMode": "RUN",
"externa
...%%
##>> 2023-12-25 19:11:04.665 GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(status%3DPENDING%7Cstatus%3DRUNNING%7Cstatus%3DABORTING),(username%3Dpsushin) 200 470##
##<< 2023-12-25 19:11:04.744##
//Response data//
%%(json) {
"page": {
"count": 1,
"current": 0
},
"result": [
{
"clusterType": "UNKNOWN",
"createdAt": "2023-12-25T16:08:03.337Z",
"execMode": "RUN",
"externalQueryIds": [],
"id": "6589a8e36455c10195ba1004",
"projectId": "6001d201dd0e49e90533b83a",
"queryType": "SQLv1",
"status": "RUNNING",
"updatedAt": "2023-12-25T16:09:56.349Z",
"username": "psushin",
"version": 5,
"workerHost": "kikimr0002.search.yandex.net",
"workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
"workerPid": "508933",
"workerVersion": "13148296"
}
]
}%%
Additional info
%%(json){
"version": "66096587d16db9fec08c82c6c8b361bf67b7ca71",
"requestId": "1703519252015392-15761627488946880158",
"url": "https://yql-test.yandex-team.ru/Operations/6589a8e36455c10195ba1004",
"language": "en",
"widowSize": {
"width": 2490,
"height": 1413
},
"screenSize": {
"width": 2560,
"height": 1440
},
"userAgent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.675 YaBrowser/23.11.1.675 (beta) Yowser/2.5 Safari/537.36",
"userAgentData": {
"architecture": "x86",
"bitness": "64",
"brands": [
{
"brand": "Chromium",
"version": "118"
},
{
"brand": "YaBrowser",
"version": "23"
},
{
"brand": "Not=A?Brand",
"version": "99"
}
],
"mobile": false,
"model": "",
"platform": "Linux",
"platformVersion": "6.2.0",
"uaFullVersion": "23.11.1.675"
}
}%%
Хочу сделать тест, для этого нужны схемы таблиц:
store_sales
date_dim
store
Смотрю на логи, как проходит оптимизация этого запроса.
В итоговом запросе мы сначала считаем агрегацию в $wss, а затем фильтруем по d_month_seq в следующем мапе.
Что мы в итоге хотим сделать? Прокинуть фильтр
(d_month_seq >= 1205 && d_month_seq <= 1205 + 11) || (d_month_seq >= 1205 + 12 && d_month_seq <= 1205 + 23)
в map-reduce-операцию, где делается агрегация?
Как у нас делаются такие оптимизации? Видим OrderedFlatMap/FlatMap с фильтром (фильтр - это наличие OptionalIf?), у которого на входе EquiJoin => смотрим на поля, от которых зависит фильтр в Map. Если фильтр устроен как And и в ветке у этого And есть условие, зависящее только от одного из источников EquiJoin, то пушдауним на вход этому EquiJoin условие? Чтобы запушдаунить условие, нужно:
(Right! (YtReadTable! ...))
, то делаем новый Map с фильтром.В нашем запросе мы читаем таблицу date_dim два раза с разными фильтрами по d_month_seq. При описанном мной алгоритме вроде должно получиться две разные промежуточные таблицы. Мы так и хотим или можно попытаться сделать обобщённое условие-объединение (
(d_month_seq >= 1205 && d_month_seq <= 1205 + 11) || (d_month_seq >= 1205 + 12 && d_month_seq <= 1205 + 23)
- как я писал в начале)?
На правильные ли callable'ы я смотрю или нужно смотреть на что-то другое? Это должен быть логический оптимизатор, верно?
mrrun log: issue-1677.log
Problem type: yt Username: @psushin Url: https://yql-test.yandex-team.ru/Operations/6589a8e36455c10195ba1004 Timestamp: Mon Dec 25 2023 19:12:48 GMT+0300 (Moscow Standard Time) User description: <[Фильтрацию таблицы date_dim хотелось бы прокинуть в самый первый джойн, после чего заменить его на lookup join (вероятно)]>