bytedance / bitsail

BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.
https://bytedance.github.io/bitsail/
Apache License 2.0
1.6k stars 328 forks source link

[Bug][Maven] Fails to clean maven #461

Closed Jake-00 closed 1 year ago

Jake-00 commented 1 year ago

What happened

After pulling the newest commit [BitSail-447][Core]Support Flink 1.16 and running command mvn clean -f pom.xml, it fails and show below error message.

[INFO] Scanning for projects...
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-hadoop-compatibility_2.11:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-hadoop:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hadoop\pom.xml, line 84, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-hadoop-compatibility_2.11:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-hudi:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hudi\pom.xml, line 214, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-json:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-hudi:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hudi\pom.xml, line 221, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-csv:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-hudi:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hudi\pom.xml, line 521, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-table-common:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-kafka:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-kafka\pom.xml, line 54, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-json:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-kafka:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-kafka\pom.xml, line 61, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-json:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-rocketmq:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-rocketmq\pom.xml, line 49, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-json:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-streamingfile-core:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml, line 84, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-csv:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-streamingfile-core:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml, line 90, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-hadoop-compatibility_2.11:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-streamingfile-core:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml, line 97, column 22
[ERROR] 'dependencies.dependency.version' for org.apache.flink:flink-connector-hive_2.11:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-streamingfile-core:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml, line 139, column 22
 @ 
[ERROR] The build could not read 5 projects -> [Help 1]
[ERROR]   
[ERROR]   The project com.bytedance.bitsail:bitsail-connector-hadoop:0.2.0-SNAPSHOT (D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hadoop\pom.xml) has 1 error
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-hadoop-compatibility_2.11:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-hadoop:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hadoop\pom.xml, line 84, column 22
[ERROR]   
[ERROR]   The project com.bytedance.bitsail:bitsail-connector-hudi:0.2.0-SNAPSHOT (D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hudi\pom.xml) has 3 errors
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-hadoop-compatibility_2.11:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-hudi:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hudi\pom.xml, line 214, column 22
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-json:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-hudi:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hudi\pom.xml, line 221, column 22
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-csv:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-hudi:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-hudi\pom.xml, line 521, column 22
[ERROR]   
[ERROR]   The project com.bytedance.bitsail:bitsail-connector-kafka:0.2.0-SNAPSHOT (D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-kafka\pom.xml) has 2 errors
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-table-common:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-kafka:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-kafka\pom.xml, line 54, column 22
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-json:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-kafka:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-kafka\pom.xml, line 61, column 22
[ERROR]   
[ERROR]   The project com.bytedance.bitsail:bitsail-connector-rocketmq:0.2.0-SNAPSHOT (D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-rocketmq\pom.xml) has 1 error
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-json:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-rocketmq:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-rocketmq\pom.xml, line 49, column 22
[ERROR]   
[ERROR]   The project com.bytedance.bitsail:bitsail-connector-streamingfile-core:0.2.0-SNAPSHOT (D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml) has 4 errors
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-json:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-streamingfile-core:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml, line 84, column 22
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-csv:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-streamingfile-core:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml, line 90, column 22
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-hadoop-compatibility_2.11:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-streamingfile-core:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml, line 97, column 22
[ERROR]     'dependencies.dependency.version' for org.apache.flink:flink-connector-hive_2.11:jar must be a valid version but is '${flink.version}'. @ com.bytedance.bitsail:bitsail-connector-streamingfile-core:${revision}, D:\projects\bitsail\bitsail-connectors\bitsail-connectors-legacy\bitsail-connector-streamingfile\bitsail-connector-streamingfile-core\pom.xml, line 139, column 22
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException

Process finished with exit code 1

What do you expect to happen

No response

How to reproduce

To make git's head point to commit [BitSail-447][Core]Support Flink 1.16, then run mvn clean -f pom.xml or click clean button of maven plugin.

Build Environment

No response

Execution Environment

No response

BitSail version

master

BitSail Component or Code Module

BitSail Pom

Are you willing to submit PR?

Code of Conduct

Jake-00 commented 1 year ago

My maven env info shows below

Apache Maven 3.6.3
Java version: 1.8.0-262, vendor: OpenLogic-OpenJDK, runtime: D:\download\openlogic-openjdk-8u262-b10-windows-x64\openlogic-openjdk-8u262-b10-win-64\jre
Default locale: zh_CN, platform encoding: UTF-8
OS name: "windows 10", version: "10.0", arch: "amd64", family: "windows"