search

DataLinkDC / dinky

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
http://www.dinky.org.cn
Apache License 2.0
3.08k stars 1.13k forks source link

[Bug] Flinksqlbatch is called by CURL every two minutes，The number of threads continues to grow without being released #3530

Open WeiZhang-bigdata opened 4 months ago

WeiZhang-bigdata commented 4 months ago

Search before asking

What happened

Flinksqlbatch is called by CURL every two minutes，The number of threads continues to grow without being released

What you expected to happen

Flinksqlbatch is called by CURL every two minutes，The number of threads continues to grow without being released

How to reproduce

Flinksqlbatch is called by CURL every two minutes，The number of threads continues to grow without being released

Anything else

Flinksqlbatch is called by CURL every two minutes，The number of threads continues to grow without being released

Version

1.0.2

Are you willing to submit PR?

Code of Conduct

WeiZhang-bigdata commented 4 months ago

1716528786646 如上图 从监控看出 线程数一直在增加，不释放。我重启dinky后才释放的线程。

WeiZhang-bigdata commented 4 months ago

image 到了后面批作业的状态已经未知了。但是作业能执行成功。 后面再用curl调这个任务，任务是被调起来了，但是curl返回的确实执行失败。

gaoyan1998 commented 4 months ago

请贴出失败日志

WeiZhang-bigdata commented 4 months ago

Contributor

    "datas": {
        "id": 3976,
        "jobConfig": {
            "type": "yarn-per-job",
            "step": 2,
            "useResult": false,
            "useChangeLog": false,
            "useAutoCancel": false,
            "useSession": false,
            "session": null,
            "useRemote": true,
            "clusterId": 0,
            "clusterConfigurationId": 2,
            "jarId": 0,
            "address": null,
            "taskId": 11,
            "jarFiles": null,
            "pyFiles": null,
            "jobName": "dwd_pos_brch_biz_pick_di_GroupBy_Mysql2Kafka",
            "useSqlFragment": true,
            "useStatementSet": true,
            "useBatchModel": true,
            "maxRowNum": null,
            "checkpoint": 0,
            "parallelism": 1,
            "savePointStrategy": "NONE",
            "savePointPath": null,
            "gatewayConfig": {
                "taskId": 11,
                "jarPaths": [],
                "type": "YARN_PER_JOB",
                "clusterConfig": {
                    "flinkConfigPath": "/mnt/disk0/env/flink-1.16.1/conf",
                    "flinkLibPath": "hdfs:///user/flink_1_16/lib_alllink",
                    "yarnConfigPath": "/etc/hadoop/conf",
                    "appId": null
                },
                "flinkConfig": {
                    "jobName": "dwd_pos_brch_biz_pick_di_GroupBy_Mysql2Kafka",
                    "jobId": null,
                    "action": null,
                    "savePointType": null,
                    "savePoint": null,
                    "configuration": {
                        "taskmanager.memory.process.size": "4g",
                        "execution.checkpointing.mode": "EXACTLY_ONCE",
                        "pipeline.name": "dwd_pos_brch_biz_pick_di_GroupBy_Mysql2Kafka",
                        "execution.checkpointing.tolerable-failed-checkpoints": "5",
                        "execution.checkpointing.unaligned": "true",
                        "restart-strategy.failure-rate.delay": "120s",
                        "env.java.opts": "\"-Dfile.encoding=UTF-8\"",
                        "restart-strategy.failure-rate.max-failures-per-interval": "96",
                        "table.local-time-zone": "Asia/Shanghai",
                        "jobmanager.memory.process.size": "2g",
                        "execution.runtime-mode": "batch",
                        "table.planner": "BLINK",
                        "execution.checkpointing.interval": "60s",
                        "execution.checkpointing.timeout": "300s",
                        "execution.checkpointing.externalized-checkpoint-retention": "RETAIN_ON_CANCELLATION",
                        "parallelism.default": "1",
                        "taskmanager.numberOfTaskSlots": "1",
                        "taskmanager.memory.managed.fraction": "0.1",
                        "execution.checkpointing.min-pause": "60s",
                        "restart-strategy": "failure-rate",
                        "restart-strategy.failure-rate.failure-rate-interval": "20min",
                        "execution.checkpointing.max-concurrent-checkpoints": "1"
                    }
                },
                "appConfig": {
                    "userJarPath": null,
                    "userJarParas": null,
                    "userJarMainAppClass": null
                }
            },
            "variables": {
                "kafka_all_link_should_pick_warning_dtl_rec_field": "  `sh_pick_dt` date,\n  `ship_id` bigint,\n  `cust_nm` string,\n  `addr_start_sup_org` int,\n  `time_flag` tinyint,\n  `addr_start_org` int,\n  `sh_pick_tm` timestamp,\n  `sys_tm` timestamp,\n  `pick_tm` timestamp,\n  `ship_status` tinyint,\n  `src` string,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `fresh_flag` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `dacu_flag` tinyint,\n  `entr_site_area` int,\n  `addr_start_tsf` int,\n  `start_prov_cd` int,\n  `end_prov_cd` int,\n  `start_tsf_cd` int,\n  `end_tsf_cd` int,\n  `start_brch_cd` int,\n  `end_brch_cd` int,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `delay_org_id` int,\n  `delay_super_org_id` int,\n  `delay_tsf_id` int,\n  `delay_12h_status` tinyint,\n  `delay_18h_status` tinyint,\n  `delay_24h_status` tinyint,\n  `delay_48h_status` tinyint,\n  `delay_72h_status` tinyint,\n  `stats_tm` timestamp,\n  `scan_typ` int,\n  `remark_id` string,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int",
                "kafka_all_link_should_delv_sign_dtl_rec_field": "  `arv_dt` date,\n  `ship_id` bigint,\n  `fcst_co` int,\n  `fcst_brch` int,\n  `ot_flag` int,\n  `fcst_co_busi_prov` int,\n  `addr_end_tsf` int,\n  `fcst_co_area` int,\n  `cust_nm` string,\n  `src` string,\n  `fresh_flag` tinyint,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `dacu_flag` tinyint,\n  `stat_tm` timestamp,\n  `earliest_tm` timestamp,\n  `earliest_delv_tm` timestamp,\n  `delay_occ_tm` timestamp,\n  `start_prov_cd` int,\n  `end_prov_cd` int,\n  `start_tsf_cd` int,\n  `end_tsf_cd` int,\n  `start_brch_cd` int,\n  `end_brch_cd` int,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `scan_typ` int,\n  `remark_id` string,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int,\n  `detain_dt` date,\n  `warning_dttm` timestamp",
                "kafka_all_link_should_arv_sign_dtl_rec_field": "  `arv_dt` date,\n  `ship_id` bigint,\n  `fcst_co` int,\n  `fcst_brch` int,\n  `ot_flag` int,\n  `fcst_co_busi_prov` int,\n  `addr_end_tsf` int,\n  `fcst_co_area` int,\n  `cust_nm` string,\n  `src` string,\n  `fresh_flag` tinyint,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `dacu_flag` tinyint,\n  `stat_tm` timestamp,\n  `earliest_tm` timestamp,\n  `if_scan_tm` timestamp,\n  `delay_occ_tm` timestamp,\n  `start_prov_cd` int,\n  `end_prov_cd` int,\n  `start_tsf_cd` int,\n  `end_tsf_cd` int,\n  `start_brch_cd` int,\n  `end_brch_cd` int,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `scan_typ` int,\n  `remark_id` string,\n  `erp_goods_nm` string,\n  `wgt_erp` decimal(18,2),\n  `length_erp` decimal(18,2),\n  `width_erp` decimal(18,2),\n  `height_erp` decimal(18,2),\n  `volume_erp` decimal(18,2),\n  `wgt_yd` decimal(18,2),\n  `length_yd` decimal(18,2),\n  `width_yd` decimal(18,2),\n  `height_yd` decimal(18,2),\n  `volume_yd` decimal(18,2),\n  `package_num` int,\n  `if_packaged` int,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int,\n  `detain_dt` date,\n  `warning_dttm` timestamp",
                "kafka_itm_delay_warning_dtl_rec_field": "  `detain_dt` date,\n  `ship_id` bigint,\n  `detain_flg` tinyint,\n  `cust_id` string,\n  `sys_tm` timestamp,\n  `pick_tm` timestamp,\n  `detain_tm` timestamp,\n  `unload_tm` timestamp,\n  `ship_status` tinyint,\n  `src` string,\n  `fresh_flag` tinyint,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `start_prov_cd` int,\n  `end_prov_cd` int,\n  `start_tsf_cd` int,\n  `end_tsf_cd` int,\n  `start_brch_cd` int,\n  `end_brch_cd` int,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `scan_typ` int,\n  `delay_site` int,\n  `delay_super_site` int,\n  `delay_tsf_id` int,\n  `delay_prov_cd` int,\n  `delay_region_id` int,\n  `stats_tm` timestamp,\n  `remark_id` string,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int",
                "kafka_branch_line_detain_dtl_rec_field": "  `detain_dt` date,\n  `ship_id` bigint,\n  `delay_site` int,\n  `detain_flg` tinyint,\n  `delay_busi_prov_cd` int,\n  `delay_grtr_cd` int,\n  `detain_tm` timestamp,\n  `start_tsf_out_dt` timestamp,\n  `arv_end_tsf_dt` timestamp,\n  `sys_tm` timestamp,\n  `strt_brch_cd` int,\n  `dest_brch_cd` int,\n  `start_tsf` int,\n  `end_tsf` int,\n  `start_prov` int,\n  `end_prov` int,\n  `scan_typ` int,\n  `rmk_id` string,\n  `cust_id` string,\n  `src` string,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `category` tinyint,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `erp_goods_nm` string,\n  `erp_wt` decimal(18,2),\n  `erp_length` decimal(18,2),\n  `erp_width` decimal(18,2),\n  `erp_height` decimal(18,2),\n  `erp_volume_wt` decimal(18,2),\n  `weight` decimal(18,2),\n  `length` decimal(18,2),\n  `width` decimal(18,2),\n  `height` decimal(18,2),\n  `volume_wt` decimal(18,2),\n  `pkg_ship_qty` int,\n  `volume_type_cd` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int,\n  `delay_site_typ` int,\n `end_tsf_out_dttm` timestamp,\n `warning_dttm` timestamp",
                "doris-fenbo1-realtime": "'connector' = 'doris',\n'fenodes' = '10.131.44.32:18030,10.131.37.16:18030,10.131.45.11:18030',\n'username' = 'uetl',\n'password' = 'MTJAoQ8PVM4yi11g',\n'doris.request.retries' = '10' ,\n'sink.max-retries' = '10' , ",
                "kafka_all_link_should_arv_sign_dtl_rec_field_v2": "  `arv_dt` date,\n  `ship_id` bigint,\n  `fcst_co` int,\n  `fcst_brch` int,\n  `ot_flag` int,\n  `fcst_co_busi_prov` int,\n  `addr_end_tsf` int,\n  `fcst_co_area` int,\n  `cust_nm` string,\n  `src` string,\n  `fresh_flag` tinyint,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `dacu_flag` tinyint,\n  `stat_tm` timestamp,\n  `earliest_tm` timestamp,\n  `if_scan_tm` timestamp,\n  `delay_occ_tm` timestamp,\n  `start_prov_cd` int,\n  `end_prov_cd` int,\n  `start_tsf_cd` int,\n  `end_tsf_cd` int,\n  `start_brch_cd` int,\n  `end_brch_cd` int,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `scan_typ` int,\n  `remark_id` string,\n  `erp_goods_nm` string,\n  `wgt_erp` decimal(18,2),\n  `length_erp` decimal(18,2),\n  `width_erp` decimal(18,2),\n  `height_erp` decimal(18,2),\n  `volume_erp` decimal(18,2),\n  `wgt_yd` decimal(18,2),\n  `length_yd` decimal(18,2),\n  `width_yd` decimal(18,2),\n  `height_yd` decimal(18,2),\n  `volume_yd` decimal(18,2),\n  `package_num` int,\n  `if_packaged` int,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int,\n  `detain_dt` date,\n  `warning_dttm` timestamp,\n  `over_tmly_flag` int",
                "kafka_itm_delay_warning_dtl_rec_field_v2": "  `detain_dt` date,\n  `ship_id` bigint,\n  `detain_flg` tinyint,\n  `cust_id` string,\n  `sys_tm` timestamp,\n  `pick_tm` timestamp,\n  `detain_tm` timestamp,\n  `unload_tm` timestamp,\n  `ship_status` tinyint,\n  `src` string,\n  `fresh_flag` tinyint,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `start_prov_cd` int,\n  `end_prov_cd` int,\n  `start_tsf_cd` int,\n  `end_tsf_cd` int,\n  `start_brch_cd` int,\n  `end_brch_cd` int,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `scan_typ` int,\n  `delay_site` int,\n  `delay_super_site` int,\n  `delay_tsf_id` int,\n  `delay_prov_cd` int,\n  `delay_region_id` int,\n  `stats_tm` timestamp,\n  `remark_id` string,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int,\n  `over_tmly_flag` int",
                "kafka_all_link_should_delv_sign_dtl_rec_field_v2": "  `arv_dt` date,\n  `ship_id` bigint,\n  `fcst_co` int,\n  `fcst_brch` int,\n  `ot_flag` int,\n  `fcst_co_busi_prov` int,\n  `addr_end_tsf` int,\n  `fcst_co_area` int,\n  `cust_nm` string,\n  `src` string,\n  `fresh_flag` tinyint,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `dacu_flag` tinyint,\n  `stat_tm` timestamp,\n  `earliest_tm` timestamp,\n  `earliest_delv_tm` timestamp,\n  `delay_occ_tm` timestamp,\n  `start_prov_cd` int,\n  `end_prov_cd` int,\n  `start_tsf_cd` int,\n  `end_tsf_cd` int,\n  `start_brch_cd` int,\n  `end_brch_cd` int,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `scan_typ` int,\n  `remark_id` string,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int,\n  `detain_dt` date,\n  `warning_dttm` timestamp,\n  `over_tmly_flag` tinyint",
                "kafka_branch_line_detain_dtl_rec_field_v2": "  `detain_dt` date,\n  `ship_id` bigint,\n  `delay_site` int,\n  `detain_flg` tinyint,\n  `delay_busi_prov_cd` int,\n  `delay_grtr_cd` int,\n  `detain_tm` timestamp,\n  `start_tsf_out_dt` timestamp,\n  `arv_end_tsf_dt` timestamp,\n  `sys_tm` timestamp,\n  `strt_brch_cd` int,\n  `dest_brch_cd` int,\n  `start_tsf` int,\n  `end_tsf` int,\n  `start_prov` int,\n  `end_prov` int,\n  `scan_typ` int,\n  `rmk_id` string,\n  `cust_id` string,\n  `src` string,\n  `prod_typ` tinyint,\n  `serv_typ` tinyint,\n  `category` tinyint,\n  `pick_emp_cd` string,\n  `delv_emp_cd` string,\n  `erp_goods_nm` string,\n  `erp_wt` decimal(18,2),\n  `erp_length` decimal(18,2),\n  `erp_width` decimal(18,2),\n  `erp_height` decimal(18,2),\n  `erp_volume_wt` decimal(18,2),\n  `weight` decimal(18,2),\n  `length` decimal(18,2),\n  `width` decimal(18,2),\n  `height` decimal(18,2),\n  `volume_wt` decimal(18,2),\n  `pkg_ship_qty` int,\n  `volume_type_cd` tinyint,\n  `zk_flag` tinyint,\n  `ysps_flag` tinyint,\n  `curr_scan_tm` timestamp,\n  `delay_nxt_site` int,\n  `delay_nxt_site_typ` int,\n  `delay_nxt_sup_site` int,\n  `delay_nxt_tsf` int,\n  `delay_nxt_busi_prov` int,\n  `delay_nxt_region_id` int,\n  `dt` date,\n  `cfg_dur` int,\n  `batch_id` int,\n  `delay_site_typ` int,\n `end_tsf_out_dttm` timestamp,\n `warning_dttm` timestamp,\n `over_tmly_flag` tinyint"
            },
            "config": {
                "env.java.opts": "\"-Dfile.encoding=UTF-8\""
            },
            "jarTask": false,
            "executorSetting": {
                "useBatchModel": true,
                "checkpoint": 0,
                "parallelism": 1,
                "useSqlFragment": true,
                "useStatementSet": true,
                "savePointPath": null,
                "jobName": "dwd_pos_brch_biz_pick_di_GroupBy_Mysql2Kafka",
                "config": {
                    "env.java.opts": "\"-Dfile.encoding=UTF-8\""
                },
                "validParallelism": true,
                "validJobName": true
            }
        },
        "jobManagerAddress": "Unknown address.",
        "status": "FAILED",
        "success": false,
        "statement": "--以下为配置好的参数不需要改动\r\nset parallelism.default = 1;\r\nset table.local-time-zone = Asia/Shanghai;\r\nset table.planner = BLINK;\r\nset execution.runtime-mode = batch;\r\nset jobmanager.memory.process.size = 2g;\r\nset taskmanager.memory.process.size = 4g;\r\nset taskmanager.numberOfTaskSlots = 1;\r\nset taskmanager.memory.managed.fraction = 0.1;\r\nset execution.checkpointing.interval = 60s;\r\nset execution.checkpointing.timeout = 300s;\r\nset execution.checkpointing.tolerable-failed-checkpoints = 5;\r\nset execution.checkpointing.externalized-checkpoint-retention = RETAIN_ON_CANCELLATION;\r\nset execution.checkpointing.mode = EXACTLY_ONCE;\r\nset execution.checkpointing.max-concurrent-checkpoints = 1;\r\nset execution.checkpointing.min-pause = 60s;\r\nset execution.checkpointing.unaligned = true;\r\nset restart-strategy = failure-rate;\r\nset restart-strategy.failure-rate.max-failures-per-interval = 96;\r\nset restart-strategy.failure-rate.failure-rate-interval=  20min;\r\nset restart-strategy.failure-rate.delay= 120s;\r\n\r\n\r\nCREATE TABLE dwd_pos_brch_biz_pick_di_src (\r\n  `stats_dt` date   COMMENT '统计日期',\r\n  `brch_id` int   COMMENT '网点编码',\r\n  `sub_brch_id` int   COMMENT '分部服务部编码',\r\n  `scan_typ` String   COMMENT '扫描类型',\r\n  `count_flg` int   COMMENT '订单数',\r\n  `update_dttm` timestamp   COMMENT '更新时间',\r\n  PRIMARY KEY (`stats_dt`,`brch_id`,`sub_brch_id`,`scan_typ`) NOT ENFORCED\r\n) WITH (\r\n    'connector' = 'jdbc',\r\n    'url' = 'jdbc:mysql://10.181.27.13:3413/db_com?allowMultiQueries=true&useUnicode=true&characterEncoding=UTF-8&useSSL=false&autoReconnect=true&allowPublicKeyRetrieval=true',\r\n    'username'='etl_flink',\r\n    'password'='Gf8sFhPmdkL5ip6lN6mh',\r\n    'table-name'='dwd_pos_brch_biz_pick_di',\r\n    'driver' = 'com.mysql.jdbc.Driver'\r\n);\r\n\r\ncreate table kafka_sink (\r\n  `stat_dt` date   COMMENT '数据日期',\r\n  `update_tm` string   COMMENT '更新时间',\r\n  `brch_cd` int   COMMENT '网点',\r\n  `index_id` int   COMMENT '指标编码',\r\n  `val1` int   COMMENT '订单数'\r\n) WITH (\r\n    --连接kafka的配置信息 , 苏州1号机房 填： ${upsert_kafka-su1-all-link}  ,  苏州2号机房 填： ${upsert_kafka-su2-all-link} \r\n    'connector' = 'kafka',\r\n    'topic' = 'ods_bigboss_homepage_new',\r\n    'properties.bootstrap.servers' = '10.181.41.17:9030,10.181.41.18:9030,10.181.41.19:9030,10.181.41.20:9030,10.181.41.21:9030',\r\n    'format' = 'json',\r\n    'key.format' = 'csv',\r\n    'key.fields' = 'stat_dt;brch_cd',\r\n    --'properties.sasl.jaas.config' = 'org.apache.kafka.common.security.scram.ScramLoginModule required username=\"x01-realtime\" password=\"OTY3MmMwOWJkNDdk\";', \r\n    --'properties.sasl.mechanism' = 'SCRAM-SHA-512',\r\n    --'properties.security.protocol' = 'SASL_PLAINTEXT',\r\n    'properties.compression.type' = 'lz4'\r\n);\r\n\r\n\r\n\r\ninsert into kafka_sink \r\nselect `stats_dt` AS `stat_dt`,\r\n       date_format(CURRENT_TIMESTAMP,'yyyy-MM-dd HH:mm:ss') AS `update_tm`,\r\n       `brch_id` as `brch_cd`,\r\n       20100102 AS `index_id`,\r\n       sum(count_flg) AS `val1`\r\n  from  dwd_pos_brch_biz_pick_di_src\r\nwhere   \r\ncast(`stats_dt` as string) >= date_format(TIMESTAMPADD(DAY, -1, CURRENT_TIMESTAMP),'yyyy-MM-dd')  and\r\n`scan_typ` = '0'\r\ngroup by stats_dt ,brch_id \r\n;\r\n\r\n\r\n\r\n\r\n\r\n",
        "jobId": "application_1708670406042_26678",
        "jobInstanceId": null,
        "error": "java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException\n\tat java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)\n\tat java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)\n\tat com.dlink.gateway.yarn.YarnPerJobGateway.submitJobGraph(YarnPerJobGateway.java:106)\n\tat com.dlink.job.JobManager.submitByGateway(JobManager.java:646)\n\tat com.dlink.job.JobManager.executeSql(JobManager.java:441)\n\tat com.dlink.service.impl.TaskServiceImpl.submitTask(TaskServiceImpl.java:253)\n\tat com.dlink.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$168bea78.invoke(<generated>)\n\tat org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)\n\tat com.dlink.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:65)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)\n\tat org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708)\n\tat com.dlink.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$7b8445ab.submitTask(<generated>)\n\tat com.dlink.controller.APIController.submitTask(APIController.java:68)\n\tat com.dlink.controller.APIController$$FastClassBySpringCGLIB$$9c627201.invoke(<generated>)\n\tat org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708)\n\tat com.dlink.controller.APIController$$EnhancerBySpringCGLIB$$41c17b02.submitTask(<generated>)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)\n\tat org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)\n\tat org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)\n\tat org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)\n\tat org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)\n\tat org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)\n\tat org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1071)\n\tat org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:964)\n\tat org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)\n\tat org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:670)\n\tat org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:779)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:124)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)\n\tat org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)\n\tat org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)\n\tat org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197)\n\tat org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)\n\tat org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:541)\n\tat org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135)\n\tat org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)\n\tat org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)\n\tat org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:360)\n\tat org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399)\n\tat org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)\n\tat org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:893)\n\tat org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1789)\n\tat org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)\n\tat org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)\n\tat org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)\n\tat org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: java.util.concurrent.TimeoutException\n\tat org.apache.flink.util.concurrent.FutureUtils$Timeout.run(FutureUtils.java:1125)\n\tat org.apache.flink.util.concurrent.DirectExecutorService.execute(DirectExecutorService.java:217)\n\tat org.apache.flink.util.concurrent.FutureUtils.lambda$orTimeout$12(FutureUtils.java:489)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\t... 1 more\n",
        "result": {
            "success": true,
            "startTime": null,
            "endTime": "2024-05-24T13:24:00.476",
            "time": 0,
            "error": null,
            "jobId": "application_1708670406042_26678"
        },
        "startTime": "2024-05-24T13:23:17.439",
        "endTime": "2024-05-24T13:24:00.476"
    },
    "code": 1,
    "msg": "java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException\n\tat java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)\n\tat java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)\n\tat com.dlink.gateway.yarn.YarnPerJobGateway.submitJobGraph(YarnPerJobGateway.java:106)\n\tat com.dlink.job.JobManager.submitByGateway(JobManager.java:646)\n\tat com.dlink.job.JobManager.executeSql(JobManager.java:441)\n\tat com.dlink.service.impl.TaskServiceImpl.submitTask(TaskServiceImpl.java:253)\n\tat com.dlink.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$168bea78.invoke(<generated>)\n\tat org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)\n\tat com.dlink.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:65)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)\n\tat org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708)\n\tat com.dlink.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$7b8445ab.submitTask(<generated>)\n\tat com.dlink.controller.APIController.submitTask(APIController.java:68)\n\tat com.dlink.controller.APIController$$FastClassBySpringCGLIB$$9c627201.invoke(<generated>)\n\tat org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)\n\tat org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708)\n\tat com.dlink.controller.APIController$$EnhancerBySpringCGLIB$$41c17b02.submitTask(<generated>)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)\n\tat org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)\n\tat org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)\n\tat org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)\n\tat org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)\n\tat org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)\n\tat org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1071)\n\tat org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:964)\n\tat org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)\n\tat org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:670)\n\tat org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:779)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:124)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)\n\tat org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)\n\tat org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)\n\tat org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197)\n\tat org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)\n\tat org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:541)\n\tat org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135)\n\tat org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)\n\tat org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)\n\tat org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:360)\n\tat org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399)\n\tat org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)\n\tat org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:893)\n\tat org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1789)\n\tat org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)\n\tat org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)\n\tat org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)\n\tat org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: java.util.concurrent.TimeoutException\n\tat org.apache.flink.util.concurrent.FutureUtils$Timeout.run(FutureUtils.java:1125)\n\tat org.apache.flink.util.concurrent.DirectExecutorService.execute(DirectExecutorService.java:217)\n\tat org.apache.flink.util.concurrent.FutureUtils.lambda$orTimeout$12(FutureUtils.java:489)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\t... 1 more\n",
    "time": "2024-05-24 13:24:00"
}
WeiZhang-bigdata commented 4 months ago

像这种CURL,调多了会出现timeout的情况。最终导致定时的curl调批作业后续全部失败。必须重启dinky才能恢复正常。在0.7.5版本和最新的1.0.x都有这种情况。

Zzm0809 commented 4 months ago

像这种CURL,调多了会出现timeout的情况。最终导致定时的curl调批作业后续全部失败。必须重启dinky才能恢复正常。在0.7.5版本和最新的1.0.x都有这种情况。

curl 完整命令发一下

WeiZhang-bigdata commented 4 months ago

像这种CURL,调多了会出现timeout的情况。最终导致定时的curl调批作业后续全部失败。必须重启dinky才能恢复正常。在0.7.5版本和最新的1.0.x都有这种情况。

curl 完整命令发一下 这个是 0.7.5中的查看异步提交的命令： curl http://10.181.88.11:18888/openapi/submitTask?id=93

Zzm0809 commented 4 months ago

像这种CURL,调多了会出现timeout的情况。最终导致定时的curl调批作业后续全部失败。必须重启dinky才能恢复正常。在0.7.5版本和最新的1.0.x都有这种情况。

curl 完整命令发一下 这个是 0.7.5中的查看异步提交的命令： curl http://10.181.88.11:18888/openapi/submitTask?id=93

0.7 不维护了 , 请使用 1.x 复现,并提供在 curl 之后过程中的全部详细日志

WeiZhang-bigdata commented 4 months ago

像这种CURL,调多了会出现timeout的情况。最终导致定时的curl调批作业后续全部失败。必须重启dinky才能恢复正常。在0.7.5版本和最新的1.0.x都有这种情况。

curl 完整命令发一下 这个是 0.7.5中的查看异步提交的命令： curl http://10.181.88.11:18888/openapi/submitTask?id=93

0.7 不维护了 , 请使用 1.x 复现,并提供在 curl 之后过程中的全部详细日志

这是 1.0.2中curl的命令 ： curl -X POST -H "Accept:/" -H "Content-Type:application/json" -d "{\"id\":8,\"isOnline\":true,\"savePointPath\":\"/savepoints\",\"variables\":{\"key\":\"value\"}}" "http://10.131.40.11:19000/openapi/submitTask"

WeiZhang-bigdata commented 4 months ago

像这种CURL,调多了会出现timeout的情况。最终导致定时的curl调批作业后续全部失败。必须重启dinky才能恢复正常。在0.7.5版本和最新的1.0.x都有这种情况。

curl 完整命令发一下 这个是 0.7.5中的查看异步提交的命令： curl http://10.181.88.11:18888/openapi/submitTask?id=93

0.7 不维护了 , 请使用 1.x 复现,并提供在 curl 之后过程中的全部详细日志

这是 1.0.2中curl的命令 ： curl -X POST -H "Accept:/" -H "Content-Type:application/json" -d "{"id":8,"isOnline":true,"savePointPath":"/savepoints","variables":{"key":"value"}}" "http://10.131.40.11:19000/openapi/submitTask"

这是 1.0.2中的返回详细日志：

WeiZhang-bigdata commented 4 months ago

Web URL is: Unknown address. , Log content: No history log found yet. so can't get log url, please check yarn cluster status or check if the flink job is running in yarn cluster or please go to yarn interface to view the log.\n\tat org.dinky.gateway.yarn.YarnGateway.getWebUrl(YarnGateway.java:384)\n\tat

这是任务后面调度截图： ![Uploading EsdcJnyITG.jpg…]()

github-actions[bot] commented 2 months ago

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃，7 天后将关闭，如需回复，可以评论回复。