apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.83k stars 1.76k forks source link

[Bug] [seatunnel-engine] After starting, submit the task 'classloader' and keep creating and releasing it #7301

Open Xuzhengz opened 1 month ago

Xuzhengz commented 1 month ago

Search before asking

What happened

In separated-cluster-deployment Mode,After starting, submit the task 'classloader' and keep creating and releasing it,The task cannot be executed normally

SeaTunnel Version

2.3.6 and dev

SeaTunnel Config

{
  "env": {
    "parallelism": 1,
    "job.name": "向量转换测试",
    "job.mode": "batch"
  },
  "preHandler": [

  ],
  "source": [
    {
      "plugin_name": "Jdbc",
      "driver": "com.mysql.cj.jdbc.Driver",
      "connection_check_timeout_sec": 100,
      "table_list": [
        {
          "table_path": "source.device",
          "query": "SELECT\n `device_id`,\n `name`,\n `type`,\n `longitude`,\n `latitude`,\n `height`,\n `radius`,\n `distance`,\n `service_address`,\n `status`,\n `term_type`,\n `properties`,\n `runway_name`,\n `direction`,\n `runway_code`,\n `delay`\nFROM\n `source`.`device`"
        }
      ],
      "database": "source",
      "url": "jdbc:mysql://******:3306/source?remarks=true&useInformationSchema=true&useCursorFetch=true&defaultFetchSize=2048&rewriteBatchedStatements=true",
      "user": "******",
      "password": "******",
      "result_table_name": "ot_3f1ffe7a58024aec96c08b126a9ce922"
    }
  ],
  "transform": [
  ],
  "sink": [
    {
      "plugin_name": "Console",
      "source_table_name": "ot_3643fbe81c48436292d70479ca388b11"
    }
  ]
}

Running Command

bin/seatunnel.sh -c demo.json

Error Exception

[.c.c.Defaultclasloaderservice] [hz.main.cached.thread-19]- Create classloader for job 871672417141915649 with jars [file:opt/module/seatunel/plugins/jdbc/lib/inceptor-driver-6.8.3.jar, file:/opt/module/seatunnel/connectors/connector-redis-2.3.6-SpsHoT.jar, file:/opt/modul/seatunnel/connectors/connector-jdbc-2.3.6-SNAPSHOT.jar]

Zeta or Flink or Spark Version

No response

Java or Scala Version

1.8

Screenshots

image

Are you willing to submit PR?

Code of Conduct

Hisoka-X commented 1 month ago

cc @EricJoy2048