ydb-platform / ydb

YDB is an open source Distributed SQL Database that combines high availability and scalability with strong consistency and ACID transactions
https://ydb.tech
Apache License 2.0
3.83k stars 531 forks source link

YQL-17475: [tpcds-59] не смогли прокинуть фильтрацию в подзапрос через group by #1677

Open UgnineSirdis opened 7 months ago

UgnineSirdis commented 7 months ago

Problem type: yt Username: @psushin Url: https://yql-test.yandex-team.ru/Operations/6589a8e36455c10195ba1004 Timestamp: Mon Dec 25 2023 19:12:48 GMT+0300 (Moscow Standard Time) User description: <[Фильтрацию таблицы date_dim хотелось бы прокинуть в самый первый джойн, после чего заменить его на lookup join (вероятно)]>


-- START PARAMETERS
use ada;
pragma TablePathPrefix = "home/tpcds/3Tb";
pragma CompactGroupBy;

pragma CostBasedOptimizer="Native";

pragma yt.OperationSpec='{time_limit=3600000; locality_timeout=0}';

-- END PARAMETERS

-- START COMMON HEADER
pragma TablePathPrefix = "home/tpcds/3Tb";
pragma yt.TemporaryPrimaryMedium = "ssd_blobs_tpcds_bench";
pragma yt.PublishedPrimaryMedium = "ssd_blobs_tpcds_bench";
pragma yt.IntermediateDataMedium = "ssd_blobs_tpcds_bench";
pragma yt.Pool = "tpcds";
pragma yt.SchedulingTagFilter = "%true";
pragma yt.QueryCacheMode = "disable";
--pragma dq.WorkerFilter='ClusterName: "ada"';
--pragma DqEngine="auto";
pragma yt.HybridDqExecution = "true";
pragma yt.AutoMerge = "disabled";
pragma yt.DataSizePerJob = "16M";
pragma yt.DataSizePerMapJob = "24M";
--pragma yt.DataSizePerSortJob = "1G";
pragma yt.DataSizePerPartition = "64M";
pragma AnsiOptionalAs;
pragma AnsiInForEmptyOrNullableItemsCollections;
pragma yt.MapJoinLimit = "33554432";
-- END COMMON HEADER

-- NB: Subquerys
$wss =
 (select date_dim.d_week_seq d_week_seq,
        store_sales.ss_store_sk ss_store_sk,
        sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,
        sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,
        sum(case when (d_day_name='Tuesday') then ss_sales_price else  null end) tue_sales,
        sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,
        sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,
        sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,
        sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales
 from store_sales cross join date_dim
 where d_date_sk = ss_sold_date_sk
 group by date_dim.d_week_seq,store_sales.ss_store_sk
 );
-- start query 1 in stream 0 using template query59.tpl and seed 1819994127
  select  s_store_name1,s_store_id1,d_week_seq1
       ,sun_sales1/sun_sales2,mon_sales1/mon_sales2
       ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2
       ,fri_sales1/fri_sales2,sat_sales1/sat_sales2
 from
 (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1
        ,s_store_id s_store_id1,sun_sales sun_sales1
        ,mon_sales mon_sales1,tue_sales tue_sales1
        ,wed_sales wed_sales1,thu_sales thu_sales1
        ,fri_sales fri_sales1,sat_sales sat_sales1
  from $wss wss cross join store cross join date_dim d
  where d.d_week_seq = wss.d_week_seq and
        ss_store_sk = s_store_sk and
        d_month_seq between 1205 and 1205 + 11) y cross join
 (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2
        ,s_store_id s_store_id2,sun_sales sun_sales2
        ,mon_sales mon_sales2,tue_sales tue_sales2
        ,wed_sales wed_sales2,thu_sales thu_sales2
        ,fri_sales fri_sales2,sat_sales sat_sales2
  from $wss wss cross join store cross join date_dim d
  where d.d_week_seq = wss.d_week_seq and
        ss_store_sk = s_store_sk and
        d_month_seq between 1205+ 12 and 1205 + 23) x
 where s_store_id1=s_store_id2
   and d_week_seq1=d_week_seq2-52
 order by s_store_name1,s_store_id1,d_week_seq1
limit 100;

-- end query 1 in stream 0 using template query59.tpl
UgnineSirdis commented 7 months ago
Debug info
##>> 2023-12-25 19:12:41.478    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=8&columns_preset=false 200   43708##
##<< 2023-12-25 19:12:41.531##
//Response data//
%%(json) {
  "ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '('RecordsCount '\"246375\"))\n(let $39 '('ChunkCount '1))\n(let $40 '('ModifyTime '\"1703520756\"))\n(let $41 '('Revision '\"108065672391361\"))\n(let $42 (YtStat '('Id '\"6249-3e3c9-41a0191-384750c5\") $38 '('DataSize '\"20877430\") $39 $40 $41))\n(let $43 (YtOutTable '\"tmp/313476a5-b5d33092-3caef227-43051fa0\" $37 $33 $42 '()))\n(let $44 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $45 (YqlRowSpec $21 $22 $23 '('Type $44)))\n(let $46 (YtStat '('Id '\"6249-3e3c8-41a0191-5534b834\") $38 '('DataSize '\"19918575\") $39 $40 $41))\n(let $47 (YtOutTable '\"tmp/405d2dcf-b8135036-3d14a947-735fd4fb\" $45 $33 $46 '()))\n(let $48 '@@[\"StructType\";[[\"store.s_store_id\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"store.s_store_name\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"wss.Sum0\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.date_dim.d_week_seq\";[\"OptionalType\";[\"
...%%

##>> 2023-12-25 19:12:41.466    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=7&columns_preset=false 200   43708##
##<< 2023-12-25 19:12:41.572##
//Response data//
%%(json) {
  "ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '('RecordsCount '\"246375\"))\n(let $39 '('ChunkCount '1))\n(let $40 '('ModifyTime '\"1703520756\"))\n(let $41 '('Revision '\"108065672391361\"))\n(let $42 (YtStat '('Id '\"6249-3e3c9-41a0191-384750c5\") $38 '('DataSize '\"20877430\") $39 $40 $41))\n(let $43 (YtOutTable '\"tmp/313476a5-b5d33092-3caef227-43051fa0\" $37 $33 $42 '()))\n(let $44 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $45 (YqlRowSpec $21 $22 $23 '('Type $44)))\n(let $46 (YtStat '('Id '\"6249-3e3c8-41a0191-5534b834\") $38 '('DataSize '\"19918575\") $39 $40 $41))\n(let $47 (YtOutTable '\"tmp/405d2dcf-b8135036-3d14a947-735fd4fb\" $45 $33 $46 '()))\n(let $48 '@@[\"StructType\";[[\"store.s_store_id\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"store.s_store_name\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"wss.Sum0\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.Sum6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wss.date_dim.d_week_seq\";[\"OptionalType\";[\"
...%%

##>> 2023-12-25 19:12:41.465    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004?version=8 200   4104##
##<< 2023-12-25 19:12:41.540##
//Response data//
%%(json) {
  "clusterType": "UNKNOWN",
  "createdAt": "2023-12-25T16:08:03.337Z",
  "execMode": "RUN",
  "externalQueryIds": [],
  "id": "6589a8e36455c10195ba1004",
  "projectId": "6001d201dd0e49e90533b83a",
  "queryData": {
    "attributes": {
      "user_agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.675 YaBrowser/23.11.1.675 (beta) Yowser/2.5 Safari/537.36"
    },
    "clusterType": "UNKNOWN",
    "content": "\n\n\n-- START PARAMETERS\nuse ada;\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma CompactGroupBy;\n\npragma CostBasedOptimizer=\"Native\";\n\npragma yt.OperationSpec='{time_limit=3600000; locality_timeout=0}';\n\n-- END PARAMETERS\n\n\n\n\n-- START COMMON HEADER\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma yt.TemporaryPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.PublishedPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.IntermediateDataMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.Pool = \"tpcds\";\npragma yt.SchedulingTagFilter = \"%true\";\npragma yt.QueryCacheMode = \"disable\";\n--pragma dq.WorkerFilter='ClusterName: \"ada\"';\n--pragma DqEngine=\"auto\";\npragma yt.HybridDqExecution = \"true\";\npragma yt.AutoMerge = \"disabled\";\npragma yt.DataSizePerJob = \"16M\";\npragma yt.DataSizePerMapJob = \"24M\";\n--pragma yt.DataSizePerSortJob = \"1G\";\npragma yt.DataSizePerPartition = \"64M\";\npragma AnsiOptionalAs;\npragma AnsiInForEmptyOrNullableItemsCollections;\npragma yt.MapJoinLimit = \"33554432\";\n-- END COMMON HEADER\n\n-- NB: Subquerys\n$wss =\n (select date_dim.d_week_seq d_week_seq,\n        store_sales.ss_store_sk ss_store_sk,\n        sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,\n        sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,\n        sum(case when (d_day_name='Tuesday') then ss_sales_price else  null end) tue_sales,\n        sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,\n        sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,\n        sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,\n        sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales\n from store_sales cross join date_dim\n where d_date_sk = ss_sold_date_sk\n group by date_dim.d_week_seq,store_sales.ss_store_sk\n );\n-- start query 1 in stream 0 using template query59.tpl and seed 1819994127\n  select  s_store_name1,s_store_id1,d_week_seq1\n       ,sun_sales1/sun_sales2,mon_sales1/mon_sales2\n       ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2\n       ,fri_sales1/fri_sales2,sat_sales1/sat_sales2\n from\n (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1\n        ,s_store_id s_store_id1,sun_sales sun_sales1\n        ,mon_sales mon_sales1,tue_sales tue_sales1\n        ,wed_sales wed_sales1,thu_sales thu_sales1\n        ,fri_sales fri_sales1,sat_sales sat_sales1\n  from $wss wss cross join store cross join date_dim d\n  where d.d_week_seq = wss.d_week_seq and\n        ss_store_sk = s_store_sk and\n        d_month_seq between 1205 and 1205 + 11) y cross join\n (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2\n        ,s_store_id s_store_id2,sun_sales sun_sales2\n        ,mon_sales mon_sales2,tue_sales tue_sales2\n        ,wed_sales wed_sales2,thu_sales thu_sales2\n        ,fri_sales fri_sales2,sat_sales sat_sales2\n  from $wss wss cross join store cross join date_dim d\n  where d.d_week_seq = wss.d_week_seq and\n        ss_store_sk = s_store_sk and\n        d_month_seq between 1205+ 12 and 1205 + 23) x\n where s_store_id1=s_store_id2\n   and d_week_seq1=d_week_seq2-52\n order by s_store_name1,s_store_id1,d_week_seq1\nlimit 100;\n\n-- end query 1 in stream 0 using template query59.tpl",
    "files": [],
    "parameters": {},
    "type": "SQLv1"
  },
  "queryType": "SQLv1",
  "status": "RUNNING",
  "updatedAt": "2023-12-25T16:12:41.378Z",
  "username": "psushin",
  "version": 8,
  "workerHost": "kikimr0002.search.yandex.net",
  "workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
  "workerPid": "508933",
  "workerVersion": "13148296"
}%%

##>> 2023-12-25 19:12:34.908    GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(status%3DPENDING%7Cstatus%3DRUNNING%7Cstatus%3DABORTING),(username%3Dpsushin) 200   470##
##<< 2023-12-25 19:12:34.977##
//Response data//
%%(json) {
  "page": {
    "count": 1,
    "current": 0
  },
  "result": [
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-12-25T16:08:03.337Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6589a8e36455c10195ba1004",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "RUNNING",
      "updatedAt": "2023-12-25T16:12:26.429Z",
      "username": "psushin",
      "version": 7,
      "workerHost": "kikimr0002.search.yandex.net",
      "workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
      "workerPid": "508933",
      "workerVersion": "13148296"
    }
  ]
}%%

##>> 2023-12-25 19:12:33.610    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=&columns_preset=false 200   394##
##<< 2023-12-25 19:12:33.690##
//Response data//
%%(json) {
  "errors": [],
  "id": "6589a8e36455c10195ba1004",
  "issues": [
    {
      "code": 1070,
      "column": 0,
      "file": "<main>",
      "issues": [
        {
          "code": 0,
          "column": 0,
          "file": "<main>",
          "issues": [],
          "message": "DQ cannot execute the query. Cause: unsupported yt pragma: operationspec",
          "row": 0,
          "severity": "S_INFO"
        }
      ],
      "message": "Optimization",
      "row": 0,
      "severity": "S_INFO"
    }
  ],
  "status": "RUNNING",
  "updatedAt": "2023-12-25T16:12:26.408Z",
  "version": 7
}%%

##>> 2023-12-25 19:12:26.515    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=7&columns_preset=false 200   40204##
##<< 2023-12-25 19:12:26.570##
//Response data//
%%(json) {
  "ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%

##>> 2023-12-25 19:12:26.504    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=6&columns_preset=false 200   40204##
##<< 2023-12-25 19:12:26.598##
//Response data//
%%(json) {
  "ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%

##>> 2023-12-25 19:12:26.503    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004?version=7 200   4104##
##<< 2023-12-25 19:12:26.592##
//Response data//
%%(json) {
  "clusterType": "UNKNOWN",
  "createdAt": "2023-12-25T16:08:03.337Z",
  "execMode": "RUN",
  "externalQueryIds": [],
  "id": "6589a8e36455c10195ba1004",
  "projectId": "6001d201dd0e49e90533b83a",
  "queryData": {
    "attributes": {
      "user_agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.675 YaBrowser/23.11.1.675 (beta) Yowser/2.5 Safari/537.36"
    },
    "clusterType": "UNKNOWN",
    "content": "\n\n\n-- START PARAMETERS\nuse ada;\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma CompactGroupBy;\n\npragma CostBasedOptimizer=\"Native\";\n\npragma yt.OperationSpec='{time_limit=3600000; locality_timeout=0}';\n\n-- END PARAMETERS\n\n\n\n\n-- START COMMON HEADER\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma yt.TemporaryPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.PublishedPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.IntermediateDataMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.Pool = \"tpcds\";\npragma yt.SchedulingTagFilter = \"%true\";\npragma yt.QueryCacheMode = \"disable\";\n--pragma dq.WorkerFilter='ClusterName: \"ada\"';\n--pragma DqEngine=\"auto\";\npragma yt.HybridDqExecution = \"true\";\npragma yt.AutoMerge = \"disabled\";\npragma yt.DataSizePerJob = \"16M\";\npragma yt.DataSizePerMapJob = \"24M\";\n--pragma yt.DataSizePerSortJob = \"1G\";\npragma yt.DataSizePerPartition = \"64M\";\npragma AnsiOptionalAs;\npragma AnsiInForEmptyOrNullableItemsCollections;\npragma yt.MapJoinLimit = \"33554432\";\n-- END COMMON HEADER\n\n-- NB: Subquerys\n$wss =\n (select date_dim.d_week_seq d_week_seq,\n        store_sales.ss_store_sk ss_store_sk,\n        sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,\n        sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,\n        sum(case when (d_day_name='Tuesday') then ss_sales_price else  null end) tue_sales,\n        sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,\n        sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,\n        sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,\n        sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales\n from store_sales cross join date_dim\n where d_date_sk = ss_sold_date_sk\n group by date_dim.d_week_seq,store_sales.ss_store_sk\n );\n-- start query 1 in stream 0 using template query59.tpl and seed 1819994127\n  select  s_store_name1,s_store_id1,d_week_seq1\n       ,sun_sales1/sun_sales2,mon_sales1/mon_sales2\n       ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2\n       ,fri_sales1/fri_sales2,sat_sales1/sat_sales2\n from\n (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1\n        ,s_store_id s_store_id1,sun_sales sun_sales1\n        ,mon_sales mon_sales1,tue_sales tue_sales1\n        ,wed_sales wed_sales1,thu_sales thu_sales1\n        ,fri_sales fri_sales1,sat_sales sat_sales1\n  from $wss wss cross join store cross join date_dim d\n  where d.d_week_seq = wss.d_week_seq and\n        ss_store_sk = s_store_sk and\n        d_month_seq between 1205 and 1205 + 11) y cross join\n (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2\n        ,s_store_id s_store_id2,sun_sales sun_sales2\n        ,mon_sales mon_sales2,tue_sales tue_sales2\n        ,wed_sales wed_sales2,thu_sales thu_sales2\n        ,fri_sales fri_sales2,sat_sales sat_sales2\n  from $wss wss cross join store cross join date_dim d\n  where d.d_week_seq = wss.d_week_seq and\n        ss_store_sk = s_store_sk and\n        d_month_seq between 1205+ 12 and 1205 + 23) x\n where s_store_id1=s_store_id2\n   and d_week_seq1=d_week_seq2-52\n order by s_store_name1,s_store_id1,d_week_seq1\nlimit 100;\n\n-- end query 1 in stream 0 using template query59.tpl",
    "files": [],
    "parameters": {},
    "type": "SQLv1"
  },
  "queryType": "SQLv1",
  "status": "RUNNING",
  "updatedAt": "2023-12-25T16:12:26.429Z",
  "username": "psushin",
  "version": 7,
  "workerHost": "kikimr0002.search.yandex.net",
  "workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
  "workerPid": "508933",
  "workerVersion": "13148296"
}%%

##>> 2023-12-25 19:12:11.900    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=6&columns_preset=false 200   39260##
##<< 2023-12-25 19:12:11.988##
//Response data//
%%(json) {
  "ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%

##>> 2023-12-25 19:12:11.888    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=5&columns_preset=false 200   39260##
##<< 2023-12-25 19:12:12.114##
//Response data//
%%(json) {
  "ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%

##>> 2023-12-25 19:12:11.887    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=5&columns_preset=false 200   39260##
##<< 2023-12-25 19:12:12.033##
//Response data//
%%(json) {
  "ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%

##>> 2023-12-25 19:12:11.867    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=DATA,EXEC_STATISTICS,PLAN,PROGRESS,AST&version=5&columns_preset=false 200   39260##
##<< 2023-12-25 19:12:11.959##
//Response data//
%%(json) {
  "ast": "(\n(let $1 (DataSource '\"yt\" '\"$all\"))\n(let $2 (YtConfigure! world $1 '\"Attr\" '\"operationspec\" '\"{time_limit=3600000; locality_timeout=0}\"))\n(let $3 '\"ssd_blobs_tpcds_bench\")\n(let $4 (YtConfigure! $2 $1 '\"Attr\" '\"temporaryprimarymedium\" $3))\n(let $5 (YtConfigure! $4 $1 '\"Attr\" '\"publishedprimarymedium\" $3))\n(let $6 (YtConfigure! $5 $1 '\"Attr\" '\"intermediatedatamedium\" $3))\n(let $7 (YtConfigure! $6 $1 '\"Attr\" '\"pool\" '\"tpcds\"))\n(let $8 (YtConfigure! $7 $1 '\"Attr\" '\"schedulingtagfilter\" '\"%true\"))\n(let $9 (YtConfigure! $8 $1 '\"Attr\" '\"querycachemode\" '\"disable\"))\n(let $10 (YtConfigure! $9 $1 '\"Attr\" '\"hybriddqexecution\" 'true))\n(let $11 (YtConfigure! $10 $1 '\"Attr\" '\"automerge\" '\"disabled\"))\n(let $12 (YtConfigure! $11 $1 '\"Attr\" '\"datasizeperjob\" '\"16M\"))\n(let $13 (YtConfigure! $12 $1 '\"Attr\" '\"datasizepermapjob\" '\"24M\"))\n(let $14 (YtConfigure! $13 $1 '\"Attr\" '\"datasizeperpartition\" '\"64M\"))\n(let $15 (YtConfigure! $14 $1 '\"Attr\" '\"mapjoinlimit\" '\"33554432\"))\n(let $16 (DataSource '\"config\"))\n(let $17 (Configure! world $16 '\"DqEngine\" '\"auto\"))\n(let $18 (Configure! $17 $16 '\"CostBasedOptimizer\" '\"native\"))\n(let $19 (DataSink 'result))\n(let $20 (DataSink '\"yt\" '\"ada\"))\n(let $21 '('NativeYtTypeFlags '0))\n(let $22 '('StrictSchema '1))\n(let $23 '('UniqueKeys '0))\n(let $24 '@@[\"StructType\";[[\"column3\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column4\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column5\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column6\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column7\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column8\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"column9\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]]]]@@)\n(let $25 '('Type $24))\n(let $26 (Bool 'true))\n(let $27 '($26 $26 $26))\n(let $28 '('\"s_store_name1\" '\"s_store_id1\" '\"d_week_seq1\"))\n(let $29 (OptionalType (DataType 'String)))\n(let $30 (OptionalType (DataType 'Int64)))\n(let $31 '($29 $29 $30))\n(let $32 (YqlRowSpec $21 $22 $23 $25 '('SortDirections $27) '('SortMembers $28) '('SortedBy $28) '('SortedByTypes $31)))\n(let $33 (YtMeta '('CanWrite '1) '('DoesExist '1) '('YqlCompatibleScheme '1) '('InferredScheme '0) '('IsDynamic '0)))\n(let $34 '((YtOutTable '\"\" $32 $33 (Void) '())))\n(let $35 (YqlRowSpec $21 $22 $23 $25))\n(let $36 '@@[\"StructType\";[[\"x.d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"x.fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"x.wed_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"y.fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"y.sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"y.wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $37 (YqlRowSpec $21 $22 $23 '('Type $36)))\n(let $38 '@@[\"StructType\";[[\"d_week_seq1\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"s_store_name1\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"wed_sales1\";[\"OptionalType\";[\"DataType\";\"Float\"]]]]]@@)\n(let $39 (YqlRowSpec $21 $22 $23 '('Type $38)))\n(let $40 (YtOutTable '\"\" $39 $33 (Void) '()))\n(let $41 '@@[\"StructType\";[[\"d_week_seq2\";[\"OptionalType\";[\"DataType\";\"Int64\"]]];[\"fri_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"mon_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"s_store_id2\";[\"OptionalType\";[\"DataType\";\"String\"]]];[\"sat_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"sun_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"thu_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"tue_sales2\";[\"OptionalType\";[\"DataType\";\"Float\"]]];[\"
...%%

##>> 2023-12-25 19:12:11.866    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004?version=6 200   4104##
##<< 2023-12-25 19:12:11.945##
//Response data//
%%(json) {
  "clusterType": "UNKNOWN",
  "createdAt": "2023-12-25T16:08:03.337Z",
  "execMode": "RUN",
  "externalQueryIds": [],
  "id": "6589a8e36455c10195ba1004",
  "projectId": "6001d201dd0e49e90533b83a",
  "queryData": {
    "attributes": {
      "user_agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.675 YaBrowser/23.11.1.675 (beta) Yowser/2.5 Safari/537.36"
    },
    "clusterType": "UNKNOWN",
    "content": "\n\n\n-- START PARAMETERS\nuse ada;\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma CompactGroupBy;\n\npragma CostBasedOptimizer=\"Native\";\n\npragma yt.OperationSpec='{time_limit=3600000; locality_timeout=0}';\n\n-- END PARAMETERS\n\n\n\n\n-- START COMMON HEADER\npragma TablePathPrefix = \"home/tpcds/3Tb\";\npragma yt.TemporaryPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.PublishedPrimaryMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.IntermediateDataMedium = \"ssd_blobs_tpcds_bench\";\npragma yt.Pool = \"tpcds\";\npragma yt.SchedulingTagFilter = \"%true\";\npragma yt.QueryCacheMode = \"disable\";\n--pragma dq.WorkerFilter='ClusterName: \"ada\"';\n--pragma DqEngine=\"auto\";\npragma yt.HybridDqExecution = \"true\";\npragma yt.AutoMerge = \"disabled\";\npragma yt.DataSizePerJob = \"16M\";\npragma yt.DataSizePerMapJob = \"24M\";\n--pragma yt.DataSizePerSortJob = \"1G\";\npragma yt.DataSizePerPartition = \"64M\";\npragma AnsiOptionalAs;\npragma AnsiInForEmptyOrNullableItemsCollections;\npragma yt.MapJoinLimit = \"33554432\";\n-- END COMMON HEADER\n\n-- NB: Subquerys\n$wss =\n (select date_dim.d_week_seq d_week_seq,\n        store_sales.ss_store_sk ss_store_sk,\n        sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales,\n        sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales,\n        sum(case when (d_day_name='Tuesday') then ss_sales_price else  null end) tue_sales,\n        sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales,\n        sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales,\n        sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales,\n        sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales\n from store_sales cross join date_dim\n where d_date_sk = ss_sold_date_sk\n group by date_dim.d_week_seq,store_sales.ss_store_sk\n );\n-- start query 1 in stream 0 using template query59.tpl and seed 1819994127\n  select  s_store_name1,s_store_id1,d_week_seq1\n       ,sun_sales1/sun_sales2,mon_sales1/mon_sales2\n       ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2\n       ,fri_sales1/fri_sales2,sat_sales1/sat_sales2\n from\n (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1\n        ,s_store_id s_store_id1,sun_sales sun_sales1\n        ,mon_sales mon_sales1,tue_sales tue_sales1\n        ,wed_sales wed_sales1,thu_sales thu_sales1\n        ,fri_sales fri_sales1,sat_sales sat_sales1\n  from $wss wss cross join store cross join date_dim d\n  where d.d_week_seq = wss.d_week_seq and\n        ss_store_sk = s_store_sk and\n        d_month_seq between 1205 and 1205 + 11) y cross join\n (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2\n        ,s_store_id s_store_id2,sun_sales sun_sales2\n        ,mon_sales mon_sales2,tue_sales tue_sales2\n        ,wed_sales wed_sales2,thu_sales thu_sales2\n        ,fri_sales fri_sales2,sat_sales sat_sales2\n  from $wss wss cross join store cross join date_dim d\n  where d.d_week_seq = wss.d_week_seq and\n        ss_store_sk = s_store_sk and\n        d_month_seq between 1205+ 12 and 1205 + 23) x\n where s_store_id1=s_store_id2\n   and d_week_seq1=d_week_seq2-52\n order by s_store_name1,s_store_id1,d_week_seq1\nlimit 100;\n\n-- end query 1 in stream 0 using template query59.tpl",
    "files": [],
    "parameters": {},
    "type": "SQLv1"
  },
  "queryType": "SQLv1",
  "status": "RUNNING",
  "updatedAt": "2023-12-25T16:12:11.683Z",
  "username": "psushin",
  "version": 6,
  "workerHost": "kikimr0002.search.yandex.net",
  "workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
  "workerPid": "508933",
  "workerVersion": "13148296"
}%%

##>> 2023-12-25 19:12:04.826    GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(status%3DPENDING%7Cstatus%3DRUNNING%7Cstatus%3DABORTING),(username%3Dpsushin) 200   470##
##<< 2023-12-25 19:12:04.908##
//Response data//
%%(json) {
  "page": {
    "count": 1,
    "current": 0
  },
  "result": [
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-12-25T16:08:03.337Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6589a8e36455c10195ba1004",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "RUNNING",
      "updatedAt": "2023-12-25T16:09:56.349Z",
      "username": "psushin",
      "version": 5,
      "workerHost": "kikimr0002.search.yandex.net",
      "workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
      "workerPid": "508933",
      "workerVersion": "13148296"
    }
  ]
}%%

##>> 2023-12-25 19:12:03.610    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=&columns_preset=false 200   394##
##<< 2023-12-25 19:12:03.712##
//Response data//
%%(json) {
  "errors": [],
  "id": "6589a8e36455c10195ba1004",
  "issues": [
    {
      "code": 1070,
      "column": 0,
      "file": "<main>",
      "issues": [
        {
          "code": 0,
          "column": 0,
          "file": "<main>",
          "issues": [],
          "message": "DQ cannot execute the query. Cause: unsupported yt pragma: operationspec",
          "row": 0,
          "severity": "S_INFO"
        }
      ],
      "message": "Optimization",
      "row": 0,
      "severity": "S_INFO"
    }
  ],
  "status": "RUNNING",
  "updatedAt": "2023-12-25T16:09:56.309Z",
  "version": 5
}%%

##>> 2023-12-25 19:11:35.186    GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(username%3Dpsushin),(queryTitle~%3D%27tpcds-1%27%7Ctitle~%3D%27tpcds-1%27) 200   24042##
##<< 2023-12-25 19:11:35.280##
//Response data//
%%(json) {
  "page": {
    "count": 2,
    "current": 0,
    "next": 1
  },
  "result": [
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-26T17:17:58.794Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "65637dc6ced8c52a70f777e4",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "COMPLETED",
      "title": "[YQL] YT benchmark tpcds-11",
      "updatedAt": "2023-11-26T17:41:17.751Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test03.search.yandex.net",
      "workerId": "cd7e9331-587d0fee-fa09ea24-c9766bf9",
      "workerPid": "739428",
      "workerVersion": "12966812"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-26T17:17:48.968Z",
      "execMode": "OPTIMIZE",
      "externalQueryIds": [],
      "id": "65637dbc93b1cd63559d4c52",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "COMPLETED",
      "title": "[YQL] YT benchmark tpcds-11",
      "updatedAt": "2023-11-26T17:17:51.333Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test03.search.yandex.net",
      "workerId": "cd7e9331-587d0fee-fa09ea24-c9766bf9",
      "workerPid": "738984",
      "workerVersion": "12966812"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-24T14:50:24.118Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6560b830637b741248eb5cdd",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "ABORTED",
      "title": "[YQL] YT benchmark tpcds-11",
      "updatedAt": "2023-11-24T14:59:57.582Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "kikimr0002.search.yandex.net",
      "workerId": "d27a5c52-53b81007-a5a4c919-dd757b2a",
      "workerPid": "372450",
      "workerVersion": "12958092"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-12T21:40:51.479Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6551466324c9596c77206323",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "COMPLETED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-12T21:43:55.596Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test04.search.yandex.net",
      "workerId": "1ebe2eb1-9c975cba-f5b576e1-2445c944",
      "workerPid": "389917",
      "workerVersion": "12878071"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-12T21:36:58.869Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6551457a19caeb697355c221",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "ABORTED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-12T21:40:49.521Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test04.search.yandex.net",
      "workerId": "1ebe2eb1-9c975cba-f5b576e1-2445c944",
      "workerPid": "382629",
      "workerVersion": "12878071"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-12T21:34:35.032Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "655144ebe20a0f3ea4b23016",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "ABORTED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-12T21:36:57.944Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test01.search.yandex.net",
      "workerId": "f354c37e-88cf7cf3-9e46228c-54c54db8",
      "workerPid": "226041",
      "workerVersion": "12878071"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-12T21:31:31.279Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "65514433e20a0f3ea4b22ef0",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "ABORTED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-12T21:33:14.766Z",
      "username": "psushin",
      "version": 999999,
      "workerHost": "kikimr0002.search.yandex.net",
      "workerId": "5578f6fd-72600263-71702421-16b484a0",
      "workerPid": "100981",
      "workerVersion": "12878071"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-10T16:28:54.028Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "654e5a46d0a03f00a5d95e39",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "COMPLETED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-10T16:32:14.126Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test04.search.yandex.net",
      "workerId": "907e2664-2f04e716-3f59e796-d02edd0a",
      "workerPid": "212086",
      "workerVersion": "12869149"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-10T13:23:34.020Z",
      "execMode": "RUN",
      "externa
...%%

##>> 2023-12-25 19:11:34.745    GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(status%3DPENDING%7Cstatus%3DRUNNING%7Cstatus%3DABORTING),(username%3Dpsushin) 200   470##
##<< 2023-12-25 19:11:34.826##
//Response data//
%%(json) {
  "page": {
    "count": 1,
    "current": 0
  },
  "result": [
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-12-25T16:08:03.337Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6589a8e36455c10195ba1004",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "RUNNING",
      "updatedAt": "2023-12-25T16:09:56.349Z",
      "username": "psushin",
      "version": 5,
      "workerHost": "kikimr0002.search.yandex.net",
      "workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
      "workerPid": "508933",
      "workerVersion": "13148296"
    }
  ]
}%%

##>> 2023-12-25 19:11:33.610    GET https://yql-api-test.yandex-team.ru/api/v2/operations/6589a8e36455c10195ba1004/results?filters=&columns_preset=false 200   394##
##<< 2023-12-25 19:11:33.701##
//Response data//
%%(json) {
  "errors": [],
  "id": "6589a8e36455c10195ba1004",
  "issues": [
    {
      "code": 1070,
      "column": 0,
      "file": "<main>",
      "issues": [
        {
          "code": 0,
          "column": 0,
          "file": "<main>",
          "issues": [],
          "message": "DQ cannot execute the query. Cause: unsupported yt pragma: operationspec",
          "row": 0,
          "severity": "S_INFO"
        }
      ],
      "message": "Optimization",
      "row": 0,
      "severity": "S_INFO"
    }
  ],
  "status": "RUNNING",
  "updatedAt": "2023-12-25T16:09:56.309Z",
  "version": 5
}%%

##>> 2023-12-25 19:11:11.995    GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(username%3Dpsushin),(queryTitle~%3D%27tpcds-1%27%7Ctitle~%3D%27tpcds-1%27) 200   24042##
##<< 2023-12-25 19:11:12.088##
//Response data//
%%(json) {
  "page": {
    "count": 2,
    "current": 0,
    "next": 1
  },
  "result": [
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-26T17:17:58.794Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "65637dc6ced8c52a70f777e4",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "COMPLETED",
      "title": "[YQL] YT benchmark tpcds-11",
      "updatedAt": "2023-11-26T17:41:17.751Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test03.search.yandex.net",
      "workerId": "cd7e9331-587d0fee-fa09ea24-c9766bf9",
      "workerPid": "739428",
      "workerVersion": "12966812"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-26T17:17:48.968Z",
      "execMode": "OPTIMIZE",
      "externalQueryIds": [],
      "id": "65637dbc93b1cd63559d4c52",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "COMPLETED",
      "title": "[YQL] YT benchmark tpcds-11",
      "updatedAt": "2023-11-26T17:17:51.333Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test03.search.yandex.net",
      "workerId": "cd7e9331-587d0fee-fa09ea24-c9766bf9",
      "workerPid": "738984",
      "workerVersion": "12966812"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-24T14:50:24.118Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6560b830637b741248eb5cdd",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "ABORTED",
      "title": "[YQL] YT benchmark tpcds-11",
      "updatedAt": "2023-11-24T14:59:57.582Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "kikimr0002.search.yandex.net",
      "workerId": "d27a5c52-53b81007-a5a4c919-dd757b2a",
      "workerPid": "372450",
      "workerVersion": "12958092"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-12T21:40:51.479Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6551466324c9596c77206323",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "COMPLETED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-12T21:43:55.596Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test04.search.yandex.net",
      "workerId": "1ebe2eb1-9c975cba-f5b576e1-2445c944",
      "workerPid": "389917",
      "workerVersion": "12878071"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-12T21:36:58.869Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6551457a19caeb697355c221",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "ABORTED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-12T21:40:49.521Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test04.search.yandex.net",
      "workerId": "1ebe2eb1-9c975cba-f5b576e1-2445c944",
      "workerPid": "382629",
      "workerVersion": "12878071"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-12T21:34:35.032Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "655144ebe20a0f3ea4b23016",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "ABORTED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-12T21:36:57.944Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test01.search.yandex.net",
      "workerId": "f354c37e-88cf7cf3-9e46228c-54c54db8",
      "workerPid": "226041",
      "workerVersion": "12878071"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-12T21:31:31.279Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "65514433e20a0f3ea4b22ef0",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "ABORTED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-12T21:33:14.766Z",
      "username": "psushin",
      "version": 999999,
      "workerHost": "kikimr0002.search.yandex.net",
      "workerId": "5578f6fd-72600263-71702421-16b484a0",
      "workerPid": "100981",
      "workerVersion": "12878071"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-10T16:28:54.028Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "654e5a46d0a03f00a5d95e39",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "COMPLETED",
      "title": "[YQL] YT benchmark tpcds-1",
      "updatedAt": "2023-11-10T16:32:14.126Z",
      "username": "psushin",
      "version": 1000000,
      "workerHost": "yql-front-test04.search.yandex.net",
      "workerId": "907e2664-2f04e716-3f59e796-d02edd0a",
      "workerPid": "212086",
      "workerVersion": "12869149"
    },
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-11-10T13:23:34.020Z",
      "execMode": "RUN",
      "externa
...%%

##>> 2023-12-25 19:11:04.665    GET https://yql-api-test.yandex-team.ru/api/v2/operations?project_service_slug=psushin&page_size=50&sort=-createdAt&page=0&filters=(status%3DPENDING%7Cstatus%3DRUNNING%7Cstatus%3DABORTING),(username%3Dpsushin) 200   470##
##<< 2023-12-25 19:11:04.744##
//Response data//
%%(json) {
  "page": {
    "count": 1,
    "current": 0
  },
  "result": [
    {
      "clusterType": "UNKNOWN",
      "createdAt": "2023-12-25T16:08:03.337Z",
      "execMode": "RUN",
      "externalQueryIds": [],
      "id": "6589a8e36455c10195ba1004",
      "projectId": "6001d201dd0e49e90533b83a",
      "queryType": "SQLv1",
      "status": "RUNNING",
      "updatedAt": "2023-12-25T16:09:56.349Z",
      "username": "psushin",
      "version": 5,
      "workerHost": "kikimr0002.search.yandex.net",
      "workerId": "6732b8c7-232e2dd9-e61e2409-83e91f3b",
      "workerPid": "508933",
      "workerVersion": "13148296"
    }
  ]
}%%
Additional info
%%(json){
  "version": "66096587d16db9fec08c82c6c8b361bf67b7ca71",
  "requestId": "1703519252015392-15761627488946880158",
  "url": "https://yql-test.yandex-team.ru/Operations/6589a8e36455c10195ba1004",
  "language": "en",
  "widowSize": {
    "width": 2490,
    "height": 1413
  },
  "screenSize": {
    "width": 2560,
    "height": 1440
  },
  "userAgent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.675 YaBrowser/23.11.1.675 (beta) Yowser/2.5 Safari/537.36",
  "userAgentData": {
    "architecture": "x86",
    "bitness": "64",
    "brands": [
      {
        "brand": "Chromium",
        "version": "118"
      },
      {
        "brand": "YaBrowser",
        "version": "23"
      },
      {
        "brand": "Not=A?Brand",
        "version": "99"
      }
    ],
    "mobile": false,
    "model": "",
    "platform": "Linux",
    "platformVersion": "6.2.0",
    "uaFullVersion": "23.11.1.675"
  }
}%%
UgnineSirdis commented 7 months ago

Хочу сделать тест, для этого нужны схемы таблиц:

store_sales
date_dim
store
UgnineSirdis commented 7 months ago

Смотрю на логи, как проходит оптимизация этого запроса. В итоговом запросе мы сначала считаем агрегацию в $wss, а затем фильтруем по d_month_seq в следующем мапе. Что мы в итоге хотим сделать? Прокинуть фильтр (d_month_seq >= 1205 && d_month_seq <= 1205 + 11) || (d_month_seq >= 1205 + 12 && d_month_seq <= 1205 + 23) в map-reduce-операцию, где делается агрегация?

Как у нас делаются такие оптимизации? Видим OrderedFlatMap/FlatMap с фильтром (фильтр - это наличие OptionalIf?), у которого на входе EquiJoin => смотрим на поля, от которых зависит фильтр в Map. Если фильтр устроен как And и в ветке у этого And есть условие, зависящее только от одного из источников EquiJoin, то пушдауним на вход этому EquiJoin условие? Чтобы запушдаунить условие, нужно:

В нашем запросе мы читаем таблицу date_dim два раза с разными фильтрами по d_month_seq. При описанном мной алгоритме вроде должно получиться две разные промежуточные таблицы. Мы так и хотим или можно попытаться сделать обобщённое условие-объединение ( (d_month_seq >= 1205 && d_month_seq <= 1205 + 11) || (d_month_seq >= 1205 + 12 && d_month_seq <= 1205 + 23) - как я писал в начале)?

На правильные ли callable'ы я смотрю или нужно смотреть на что-то другое? Это должен быть логический оптимизатор, верно?

UgnineSirdis commented 7 months ago

mrrun log: issue-1677.log