GoogleCloudPlatform / DataflowTemplates

Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
https://cloud.google.com/dataflow/docs/guides/templates/provided-templates
Apache License 2.0
1.11k stars 929 forks source link

[Bug]: mvn clean package v2 FAILED due to splunk.jfrog.io repo #1548

Open mataralhawiti opened 1 month ago

mataralhawiti commented 1 month ago

Related Template(s)

MySQL_to_BigQuery

Template Version

v2

What happened?

Following the provided documentation here to build MySQL_to_BigQuery (v2), I keep getting the following error :

Relevant log output

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  8.145 s
[INFO] Finished at: 2024-05-11T10:58:22+03:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project mysql-to-googlecloud: Could not resolve dependencies for project com.google.cloud.teleport.v2:mysql-to-googlecloud:jar:1.0-SNAPSHOT: Failed to collect dependencies at com.google.cloud.teleport.v2:jdbc-to-googlecloud:jar:1.0-SNAPSHOT: Failed to read artifact descriptor for com.google.cloud.teleport.v2:jdbc-to-googlecloud:jar:1.0-SNAPSHOT: The following artifacts could not be resolved: com.google.cloud.teleport.v2:jdbc-to-googlecloud:pom:1.0-SNAPSHOT (absent): Could not transfer artifact com.google.cloud.teleport.v2:jdbc-to-googlecloud:pom:1.0-SNAPSHOT from/to splunk-artifactory (https://splunk.jfrog.io/splunk/ext-releases-local): status code: 409, reason phrase:  (409) -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
seanstory commented 3 days ago

I have a similar issue just trying to mvn clean compile from the top level.

[ERROR] The following artifacts could not be resolved: io.confluent:kafka-schema-registry-client:jar:7.6.0 (present, but unavailable), io.confluent:kafka-avro-serializer:jar:7.6.0 (present, but unavailable), io.confluent:common-utils:jar:7.6.0 (present, but unavailable), io.confluent:kafka-schema-serializer:jar:7.6.0 (present, but unavailable): 
Could not find artifact io.confluent:kafka-schema-registry-client:jar:7.6.0 in splunk-artifactory (https://splunk.jfrog.io/splunk/ext-releases-local)
expanded output ``` [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary for Google Cloud Dataflow Templates 1.0-SNAPSHOT: [INFO] [INFO] Google Cloud Dataflow Templates .................... SUCCESS [ 0.137 s] [INFO] Templates Metadata Module .......................... SUCCESS [ 0.783 s] [INFO] Templates Plugins Project .......................... SUCCESS [ 0.003 s] [INFO] Templates Core Plugin .............................. SUCCESS [ 0.588 s] [INFO] Templates Maven Plugin ............................. SUCCESS [ 2.010 s] [INFO] integration-testing-lib ............................ SUCCESS [ 0.094 s] [INFO] it-google-cloud-platform ........................... SUCCESS [ 1.518 s] [INFO] it-datadog ......................................... SUCCESS [ 0.565 s] [INFO] it-conditions ...................................... SUCCESS [ 0.235 s] [INFO] it-jdbc ............................................ SUCCESS [ 0.362 s] [INFO] it-splunk .......................................... SUCCESS [ 0.345 s] [INFO] Google Cloud Teleport Classic ...................... SUCCESS [ 9.109 s] [INFO] structured-logging ................................. SUCCESS [ 0.070 s] [INFO] plaintext-logging .................................. SUCCESS [ 0.005 s] [INFO] Google Cloud Teleport Dynamic ...................... SUCCESS [ 0.778 s] [INFO] common ............................................. SUCCESS [ 2.082 s] [INFO] AstraDB To BigQuery ................................ SUCCESS [ 2.296 s] [INFO] kafka-common ....................................... FAILURE [ 2.594 s] [INFO] azure-eventhub-to-pubsub ........................... SKIPPED [INFO] bigtable-common .................................... SKIPPED [INFO] bigtable-changestreams-to-hbase .................... SKIPPED [INFO] bigquery-to-bigtable ............................... SKIPPED [INFO] bigquery-to-parquet ................................ SKIPPED [INFO] cdc-parent ......................................... SKIPPED [INFO] cdc-common ......................................... SKIPPED [INFO] cdc-embedded-connector ............................. SKIPPED [INFO] cdc-change-applier ................................. SKIPPED [INFO] cdc-agg ............................................ SKIPPED [INFO] jdbc-common ........................................ SKIPPED [INFO] dataplex ........................................... SKIPPED [INFO] datastream-common .................................. SKIPPED [INFO] datastream-to-bigquery ............................. SKIPPED [INFO] datastream-to-mongodb .............................. SKIPPED [INFO] datastream-to-postgres ............................. SKIPPED [INFO] spanner-migrations-sdk ............................. SKIPPED [INFO] spanner-common ..................................... SKIPPED [INFO] datastream-to-spanner .............................. SKIPPED [INFO] datastream-to-sql .................................. SKIPPED [INFO] elasticsearch-common ............................... SKIPPED [INFO] file-format-conversion ............................. SKIPPED [INFO] gcs-to-sourcedb .................................... SKIPPED [INFO] googlecloud-to-elasticsearch ....................... SKIPPED [INFO] googlecloud-to-googlecloud ......................... SKIPPED [INFO] Google Cloud To MongoDB ............................ SKIPPED [INFO] googlecloud-to-neo4j ............................... SKIPPED [INFO] googlecloud-to-splunk .............................. SKIPPED [INFO] google-ads-to-googlecloud .......................... SKIPPED [INFO] jdbc-to-googlecloud ................................ SKIPPED [INFO] jms-to-pubsub ...................................... SKIPPED [INFO] kafka-to-bigquery .................................. SKIPPED [INFO] kafka-to-gcs ....................................... SKIPPED [INFO] kafka-to-kafka ..................................... SKIPPED [INFO] kafka-to-pubsub .................................... SKIPPED [INFO] kinesis-to-pubsub .................................. SKIPPED [INFO] kudu-to-bigquery ................................... SKIPPED [INFO] MongoDB To Googlecloud ............................. SKIPPED [INFO] mqtt-to-pubsub ..................................... SKIPPED [INFO] mysql-to-googlecloud ............................... SKIPPED [INFO] oracle-to-googlecloud .............................. SKIPPED [INFO] postgresql-to-googlecloud .......................... SKIPPED [INFO] pubsub-binary-to-bigquery .......................... SKIPPED [INFO] pubsub-cdc-to-bigquery ............................. SKIPPED [INFO] pubsub-to-jms ...................................... SKIPPED [INFO] pubsub-to-kafka .................................... SKIPPED [INFO] PubSub To MongoDB .................................. SKIPPED [INFO] PubSub To Redis .................................... SKIPPED [INFO] sourcedb-to-spanner ................................ SKIPPED [INFO] spanner-change-streams-to-sharded-file-sink ........ SKIPPED [INFO] spanner-custom-shard ............................... SKIPPED [INFO] sqlserver-to-googlecloud ........................... SKIPPED [INFO] streaming-data-generator ........................... SKIPPED [INFO] Templates Python Wrapper Module .................... SKIPPED [INFO] Templates Yaml Wrapper Module ...................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 24.131 s [INFO] Finished at: 2024-07-02T15:14:03-05:00 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:3.5.0:enforce (enforce) on project kafka-common: [ERROR] Rule 0: org.codehaus.mojo.extraenforcer.dependencies.EnforceBytecodeVersion failed with message: [ERROR] The following artifacts could not be resolved: io.confluent:kafka-schema-registry-client:jar:7.6.0 (present, but unavailable), io.confluent:kafka-avro-serializer:jar:7.6.0 (present, but unavailable), io.confluent:common-utils:jar:7.6.0 (present, but unavailable), io.confluent:kafka-schema-serializer:jar:7.6.0 (present, but unavailable): Could not find artifact io.confluent:kafka-schema-registry-client:jar:7.6.0 in splunk-artifactory (https://splunk.jfrog.io/splunk/ext-releases-local) ```