search

StarRocks / starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
https://starrocks.io
Apache License 2.0
8.96k stars 1.8k forks source link

Cannot build and integrate AirByte connector #23714

Closed alberttwong closed 1 year ago

alberttwong commented 1 year ago

per https://github.com/StarRocks/starrocks/tree/main/contrib/destination-starrocks. The instructions says 

From the Airbyte repository root, run:

./gradlew :airbyte-integrations:connectors:destination-starrocks:build

I did git clone https://github.com/airbytehq/airbyte.git and ran the gradlew command and it doesn't work. 

atwong@Alberts-MacBook-Pro airbyte % ./gradlew :airbyte-integrations:connectors:destination-starrocks:build
Building all of Airbyte.
/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors

FAILURE: Build failed with an exception.

* What went wrong:
Cannot locate tasks that match ':airbyte-integrations:connectors:destination-starrocks:build' as project 'destination-starrocks' not found in project ':airbyte-integrations:connectors'.

* Try:
> Run gradlew projects to get a list of available projects.
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3s
10 actionable tasks: 10 up-to-date
atwong@Alberts-MacBook-Pro airbyte %
alberttwong commented 1 year ago 
atwong@Alberts-MacBook-Pro airbyte % ./gradlew :airbyte-integrations:connectors:destination-starrocks:airbyteDocker
Building all of Airbyte.
/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors

FAILURE: Build failed with an exception.

* What went wrong:
Cannot locate tasks that match ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' as project 'destination-starrocks' not found in project ':airbyte-integrations:connectors'.

* Try:
> Run gradlew projects to get a list of available projects.
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2s
10 actionable tasks: 10 up-to-date
atwong@Alberts-MacBook-Pro airbyte %
alberttwong commented 1 year ago

copied cp -R ~/sandbox/starrocks/contrib/destination-starrocks . to airbyte-integrations/connectors/

atwong@Alberts-MacBook-Pro airbyte % ./gradlew :airbyte-integrations:connectors:destination-starrocks:build
Building all of Airbyte.
/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors

FAILURE: Build failed with an exception.

* Where:
Build file '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build.gradle' line: 17

* What went wrong:
A problem occurred evaluating project ':airbyte-integrations:connectors:destination-starrocks'.
> Project with path ':airbyte-config:config-models' could not be found in project ':airbyte-integrations:connectors:destination-starrocks'.

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1s
10 actionable tasks: 10 up-to-date
liuzhongjun89 commented 1 year ago

dependencies in build.gradle(destination-starrocks) already changed from "airbyte-config:config-models" to "airbyte-config-oss:config-models-oss" in current airbyte version

alberttwong commented 1 year ago 
atwong@Alberts-MBP airbyte % ./gradlew :airbyte-integrations:connectors:destination-starrocks:build
Starting a Gradle Daemon (subsequent builds will be faster)
Building all of Airbyte.
/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors

> Task :airbyte-api:generateApiClient
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/client

> Task :airbyte-api:generateApiDocs
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/docs

> Task :airbyte-api:generateApiServer
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/server

> Task :airbyte-api:generateApiServerLegacy
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/server

> Task :airbyte-commons:compileJava FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':airbyte-commons:compileJava'.
> error: invalid source release: 17

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 19s
22 actionable tasks: 12 executed, 10 up-to-date
S3 cache 978ms wasted on misses, reads: 4, elapsed: 978ms
atwong@Alberts-MBP airbyte %
alberttwong commented 1 year ago

https://github.com/airbytehq/airbyte/issues/26370

liuzhongjun89 commented 1 year ago

need jdk17? I will try it

liuzhongjun89 commented 1 year ago

https://docs.airbyte.com/contributing-to-airbyte/developing-locally

alberttwong commented 1 year ago 
atwong@Alberts-MBP airbyte % jenv local openjdk64-17.0.7
atwong@Alberts-MBP airbyte % java -version
openjdk version "17.0.7" 2023-04-18
OpenJDK Runtime Environment Homebrew (build 17.0.7+0)
OpenJDK 64-Bit Server VM Homebrew (build 17.0.7+0, mixed mode, sharing)
atwong@Alberts-MBP airbyte % ./gradlew :airbyte-integrations:connectors:destination-starrocks:build
Starting a Gradle Daemon (subsequent builds will be faster)
Building all of Airbyte.
/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors

> Configure project :airbyte-cdk:python
Cannot connect to the Docker daemon at unix:///Users/atwong/.docker/run/docker.sock. Is the docker daemon running?

FAILURE: Build failed with an exception.

* Where:
Build file '/Users/atwong/sandbox/airbyte/airbyte-cdk/python/build.gradle' line: 3

* What went wrong:
An exception occurred applying plugin request [id: 'airbyte-docker']
> Failed to apply plugin 'airbyte-docker'.
   > Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9s
10 actionable tasks: 6 executed, 4 up-to-date

after starting docker desktop

atwong@Alberts-MBP airbyte % ./gradlew :airbyte-integrations:connectors:destination-starrocks:build
Building all of Airbyte.
/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors

> Task :airbyte-commons:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: /Users/atwong/sandbox/airbyte/airbyte-commons/src/main/java/io/airbyte/commons/util/MoreIterators.java uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-api:generateApiClient
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/client

> Task :airbyte-api:generateApiDocs
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/docs

> Task :airbyte-api:generateApiServer
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/server

> Task :airbyte-api:generateApiServerLegacy
################################################################################
# Thanks for using OpenAPI Generator.                                          #
# Please consider donation to help us maintain this project 🙏                 #
# https://opencollective.com/openapi_generator/donate                          #
################################################################################
Successfully generated code to /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/server

> Task :airbyte-integrations:bases:base:airbyteDocker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 262B done
#1 DONE 0.0s

#2 [internal] load .dockerignore
#2 transferring context: 46B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/amazonlinux:2022.0.20220831.1
#3 ...

#4 [auth] library/amazonlinux:pull token for registry-1.docker.io
#4 DONE 0.0s

#3 [internal] load metadata for docker.io/library/amazonlinux:2022.0.20220831.1
#3 DONE 1.8s

#5 [internal] load build context
#5 transferring context: 1.24kB done
#5 DONE 0.0s

#6 [1/3] FROM docker.io/library/amazonlinux:2022.0.20220831.1@sha256:d26e31b5b4bb811a12cb868453a980a9ae53338020130521b67068cec9cabcc8
#6 resolve docker.io/library/amazonlinux:2022.0.20220831.1@sha256:d26e31b5b4bb811a12cb868453a980a9ae53338020130521b67068cec9cabcc8 0.0s done
#6 sha256:d26e31b5b4bb811a12cb868453a980a9ae53338020130521b67068cec9cabcc8 547B / 547B done
#6 sha256:5a12fea5a2f227cd2abb0dca3227e3aab5d8685b301a291334bfff984057ee86 529B / 529B done
#6 sha256:d33ed3691d9394a4bc76c2dbb71ea8b2b65e6e0d1cef0ed5f537f5e89f501718 1.49kB / 1.49kB done
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 0B / 56.65MB 0.2s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 4.19MB / 56.65MB 0.6s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 8.39MB / 56.65MB 0.7s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 15.73MB / 56.65MB 0.9s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 18.87MB / 56.65MB 1.0s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 23.07MB / 56.65MB 1.2s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 26.21MB / 56.65MB 1.4s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 29.36MB / 56.65MB 1.7s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 32.51MB / 56.65MB 2.3s

> Task :airbyte-api:compileJava
Note: /Users/atwong/sandbox/airbyte/airbyte-api/build/generated/api/client/src/main/java/io/airbyte/api/client/invoker/generated/JSON.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.

> Task :airbyte-integrations:bases:base:airbyteDocker
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 35.65MB / 56.65MB 3.0s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 38.80MB / 56.65MB 3.3s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 41.94MB / 56.65MB 3.8s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 45.09MB / 56.65MB 5.8s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 48.23MB / 56.65MB 6.5s

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

> Task :airbyte-commons-protocol:compileJava
Note: Creating bean classes for 8 type elements
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-config-oss:config-models-oss:compileJava
Note: Creating bean classes for 18 type elements
Note: /Users/atwong/sandbox/airbyte/airbyte-config-oss/config-models-oss/src/main/java/io/airbyte/configoss/ConfigSchema.java uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-integrations:bases:base:airbyteDocker
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 52.43MB / 56.65MB 6.9s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 55.57MB / 56.65MB 7.1s
#6 sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 56.65MB / 56.65MB 7.2s done
#6 extracting sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

> Task :airbyte-integrations:bases:base:airbyteDocker
#6 extracting sha256:00ee01a8a4f0d3d97470c0d349a8ee4b534ef5a20a1c1abec5e0697493d8c08d 2.0s done
#6 DONE 9.4s

#7 [2/3] WORKDIR /airbyte
#7 DONE 0.2s

#8 [3/3] COPY base.sh .
#8 DONE 0.0s

#9 exporting to image
#9 exporting layers 0.0s done
#9 writing image sha256:105129f783ff9532281be61396ecb669939b93bbf0ce1de1e62035e7f47520e6 done
#9 naming to docker.io/airbyte/integration-base:dev done
#9 DONE 0.0s

> Task :airbyte-config-oss:init-oss:compileJava
Note: Creating bean classes for 1 type elements

> Task :airbyte-db:db-lib:compileJava
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-config-oss:specs-oss:downloadConnectorRegistry
2023-05-23 10:11:46,477 main ERROR Unable to load mask data from '/seed/specs_secrets_mask.yaml': null.
2023-05-23 17:11:46 INFO i.a.c.s.ConnectorRegistryDownloader(main):40 - Downloading OSS connector registry from https://connectors.airbyte.com/files/registries/v0/oss_registry.json to /Users/atwong/sandbox/airbyte/airbyte-config-oss/init-oss/src/main/resources/seed/oss_registry.jsonLE

> Task :airbyte-integrations:bases:base-java:compileJava
Note: /Users/atwong/sandbox/airbyte/airbyte-integrations/bases/base-java/src/main/java/io/airbyte/integrations/destination/StandardNameTransformer.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: /Users/atwong/sandbox/airbyte/airbyte-integrations/bases/base-java/src/main/java/io/airbyte/integrations/base/ssh/SshBastionContainer.java uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :airbyte-config-oss:specs-oss:downloadConnectorSpecsMask
2023-05-23 10:11:47,455 main ERROR Unable to load mask data from '/seed/specs_secrets_mask.yaml': null.
2023-05-23 17:11:47 INFO i.a.c.s.ConnectorSpecMaskDownloader(main):36 - Downloading Spec Secret Mask from https://connectors.airbyte.com/files/registries/v0/specs_secrets_mask.yaml to /Users/atwong/sandbox/airbyte/airbyte-config-oss/init-oss/src/main/resources/seed/specs_secrets_mask.yaml

> Task :airbyte-integrations:bases:base-java:airbyteDocker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 818B done
#1 DONE 0.0s

#2 [internal] load .dockerignore
#2 transferring context: 101B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/airbyte/integration-base:dev
#3 DONE 0.0s

#4 [internal] load metadata for docker.io/library/amazoncorretto:17.0.4
#4 ...

#5 [auth] library/amazoncorretto:pull token for registry-1.docker.io
#5 DONE 0.0s

#4 [internal] load metadata for docker.io/library/amazoncorretto:17.0.4
#4 DONE 1.5s

#6 [internal] load build context
#6 transferring context: 2.32kB done
#6 DONE 0.0s

#7 FROM docker.io/airbyte/integration-base:dev
#7 DONE 0.0s

#8 [stage-0 1/7] FROM docker.io/library/amazoncorretto:17.0.4@sha256:4c5b6c73aaa0b39c8be05e7b444c13db55bfe88b6044a2854f3e2f5f03df6fb1
#8 resolve docker.io/library/amazoncorretto:17.0.4@sha256:4c5b6c73aaa0b39c8be05e7b444c13db55bfe88b6044a2854f3e2f5f03df6fb1 done
#8 sha256:339ffb19a2c617bb5b4635620146560d766b1ad1783cd34b620fbd3fedb57810 3.08kB / 3.08kB done
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 0B / 63.91MB 0.1s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 0B / 150.14MB 0.1s
#8 sha256:4c5b6c73aaa0b39c8be05e7b444c13db55bfe88b6044a2854f3e2f5f03df6fb1 547B / 547B done
#8 sha256:a92e481e863a05b833595f07f752c64026327fc544a25e9610636925669386f1 742B / 742B done
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 5.24MB / 63.91MB 0.3s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 12.58MB / 63.91MB 0.5s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 16.78MB / 63.91MB 0.6s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 26.21MB / 63.91MB 0.9s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 30.41MB / 63.91MB 1.1s

> Task :airbyte-connector-test-harnesses:acceptance-test-harness:compileJava
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

> Task :airbyte-integrations:bases:base-java:airbyteDocker
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 36.70MB / 63.91MB 1.4s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 9.44MB / 150.14MB 1.4s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 40.89MB / 63.91MB 1.7s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 45.09MB / 63.91MB 2.2s
#8 ...

#9 https://dtdg.co/latest-java-tracer
#9 DONE 2.3s

#8 [stage-0 1/7] FROM docker.io/library/amazoncorretto:17.0.4@sha256:4c5b6c73aaa0b39c8be05e7b444c13db55bfe88b6044a2854f3e2f5f03df6fb1
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 17.83MB / 150.14MB 2.3s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 49.28MB / 63.91MB 2.6s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 53.48MB / 63.91MB 2.8s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 26.21MB / 150.14MB 2.9s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 57.67MB / 63.91MB 3.0s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 62.91MB / 63.91MB 3.2s
#8 sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 63.91MB / 63.91MB 3.3s done
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 35.65MB / 150.14MB 3.4s
#8 extracting sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 0.1s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 44.04MB / 150.14MB 3.7s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 55.57MB / 150.14MB 4.0s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 63.96MB / 150.14MB 4.2s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 73.15MB / 150.14MB 4.4s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 81.79MB / 150.14MB 4.6s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 90.18MB / 150.14MB 4.8s
#8 extracting sha256:f5371f42f94d8ba2c9559448b8e36de82d246f179760ec911f594632d3545611 1.4s done
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 99.61MB / 150.14MB 5.0s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 108.00MB / 150.14MB 5.2s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 120.59MB / 150.14MB 5.5s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 130.02MB / 150.14MB 5.7s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 138.41MB / 150.14MB 5.9s
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 146.80MB / 150.14MB 6.1s
#8 extracting sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2
#8 sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 150.14MB / 150.14MB 6.2s done
#8 extracting sha256:ac5c3af597190989e4162b4bf3b723b7e4490c561b8d62afd46e71089d9e76c2 1.1s done
#8 DONE 7.4s

#10 [stage-0 2/7] COPY --from=airbyte/integration-base:dev /airbyte /airbyte
#10 DONE 0.3s

#11 [stage-0 3/7] RUN yum install -y tar openssl && yum clean all
#11 0.213 Loaded plugins: ovl, priorities
#11 3.435 9 packages excluded due to repository priority protections
#11 3.777 Resolving Dependencies
#11 3.777 --> Running transaction check
#11 3.777 ---> Package openssl.aarch64 1:1.0.2k-24.amzn2.0.6 will be installed
#11 3.784 --> Processing Dependency: openssl-libs(aarch-64) = 1:1.0.2k-24.amzn2.0.6 for package: 1:openssl-1.0.2k-24.amzn2.0.6.aarch64
#11 3.797 --> Processing Dependency: make for package: 1:openssl-1.0.2k-24.amzn2.0.6.aarch64
#11 3.798 ---> Package tar.aarch64 2:1.26-35.amzn2.0.1 will be installed
#11 3.799 --> Running transaction check
#11 3.799 ---> Package make.aarch64 1:3.82-24.amzn2 will be installed
#11 3.799 ---> Package openssl-libs.aarch64 1:1.0.2k-24.amzn2.0.4 will be updated
#11 3.801 ---> Package openssl-libs.aarch64 1:1.0.2k-24.amzn2.0.6 will be an update
#11 3.825 --> Finished Dependency Resolution
#11 3.845
#11 3.845 Dependencies Resolved
#11 3.846
#11 3.846 ================================================================================
#11 3.846  Package          Arch        Version                      Repository      Size
#11 3.846 ================================================================================
#11 3.846 Installing:
#11 3.846  openssl          aarch64     1:1.0.2k-24.amzn2.0.6        amzn2-core     485 k
#11 3.846  tar              aarch64     2:1.26-35.amzn2.0.1          amzn2-core     850 k
#11 3.846 Installing for dependencies:
#11 3.846  make             aarch64     1:3.82-24.amzn2              amzn2-core     418 k
#11 3.846 Updating for dependencies:
#11 3.846  openssl-libs     aarch64     1:1.0.2k-24.amzn2.0.6        amzn2-core     1.0 M
#11 3.846
#11 3.846 Transaction Summary
#11 3.846 ================================================================================
#11 3.846 Install  2 Packages (+1 Dependent package)
#11 3.846 Upgrade             ( 1 Dependent package)
#11 3.846
#11 3.846 Total download size: 2.7 M
#11 3.846 Downloading packages:
#11 3.847 Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
#11 4.144 --------------------------------------------------------------------------------
#11 4.144 Total                                              9.1 MB/s | 2.7 MB  00:00
#11 4.149 Running transaction check
#11 4.155 Running transaction test
#11 4.162 Transaction test succeeded
#11 4.162 Running transaction
#11 4.234   Updating   : 1:openssl-libs-1.0.2k-24.amzn2.0.6.aarch64                   1/5
#11 4.281   Installing : 1:make-3.82-24.amzn2.aarch64                                 2/5
#11 4.319   Installing : 1:openssl-1.0.2k-24.amzn2.0.6.aarch64                        3/5
#11 4.371   Installing : 2:tar-1.26-35.amzn2.0.1.aarch64                              4/5
#11 4.383   Cleanup    : 1:openssl-libs-1.0.2k-24.amzn2.0.4.aarch64                   5/5
#11 4.393   Verifying  : 1:openssl-1.0.2k-24.amzn2.0.6.aarch64                        1/5
#11 4.398   Verifying  : 2:tar-1.26-35.amzn2.0.1.aarch64                              2/5
#11 4.401   Verifying  : 1:make-3.82-24.amzn2.aarch64                                 3/5
#11 4.404   Verifying  : 1:openssl-libs-1.0.2k-24.amzn2.0.6.aarch64                   4/5
#11 4.407   Verifying  : 1:openssl-libs-1.0.2k-24.amzn2.0.4.aarch64                   5/5
#11 4.416
#11 4.416 Installed:
#11 4.416   openssl.aarch64 1:1.0.2k-24.amzn2.0.6     tar.aarch64 2:1.26-35.amzn2.0.1
#11 4.416
#11 4.416 Dependency Installed:
#11 4.416   make.aarch64 1:3.82-24.amzn2
#11 4.416
#11 4.416 Dependency Updated:
#11 4.416   openssl-libs.aarch64 1:1.0.2k-24.amzn2.0.6
#11 4.416
#11 4.416 Complete!
#11 4.508 Loaded plugins: ovl, priorities
#11 4.512 Cleaning repos: AmazonCorretto amzn2-core
#11 4.512 Cleaning up everything
#11 4.512 Maybe you want: rm -rf /var/cache/yum, to also free up space taken by orphaned data from disabled or removed repos
#11 DONE 4.6s

#12 [stage-0 4/7] WORKDIR /airbyte
#12 DONE 0.0s

#13 [stage-0 5/7] ADD https://dtdg.co/latest-java-tracer dd-java-agent.jar
#13 DONE 0.0s

#14 [stage-0 6/7] COPY javabase.sh .
#14 DONE 0.0s

#15 [stage-0 7/7] COPY run_with_normalization.sh .
#15 DONE 0.0s

#16 exporting to image
#16 exporting layers 0.1s done
#16 writing image sha256:5106193de46f981c5b0add875ede049902707a325ca89e6cf4f0a680ebd8ab34 done
#16 naming to docker.io/airbyte/integration-base-java:dev done
#16 DONE 0.1s

> Task :airbyte-integrations:connectors:destination-starrocks:compileJava
Note: /Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/src/main/java/io/airbyte/integrations/destination/starrocks/StarRocksBufferedConsumerFactory.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.

> Task :airbyte-integrations:connectors:destination-starrocks:airbyteDocker
Execution optimizations have been disabled for task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:processIntegrationTestJavaResources' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:processTestResources' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
#1 [internal] load .dockerignore
#1 transferring context: 61B done
#1 DONE 0.0s

#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 506B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/airbyte/integration-base-java:dev
#3 DONE 0.0s

#4 [build 1/4] FROM docker.io/airbyte/integration-base-java:dev
#4 DONE 0.1s

#5 [build 2/4] WORKDIR /airbyte
#5 DONE 0.0s

#6 [internal] load build context
#6 transferring context: 135.93MB 1.0s done
#6 DONE 1.1s

#7 [build 3/4] COPY build/distributions/destination-starrocks*.tar destination-starrocks.tar
#7 DONE 0.2s

#8 [build 4/4] RUN tar xf destination-starrocks.tar --strip-components=1 && rm -rf destination-starrocks.tar
#8 DONE 0.3s

#9 [stage-1 3/3] COPY --from=build /airbyte /airbyte
#9 DONE 0.2s

#10 exporting to image
#10 exporting layers
#10 exporting layers 0.2s done
#10 writing image sha256:4ca540253200e9f98e4adff9ca2dc46c13d72b9563b18ea0c1eaf60bf7d88fad done
#10 naming to docker.io/airbyte/destination-starrocks:dev done
#10 DONE 0.2s

> Task :airbyte-integrations:connectors:destination-starrocks:compileIntegrationTestJavaJava
Execution optimizations have been disabled for task ':airbyte-integrations:connectors:destination-starrocks:compileIntegrationTestJavaJava' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/generated/sources/annotationProcessor/java/integrationTestJava'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:compileIntegrationTestJavaJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/classes/java/integrationTestJava'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:compileIntegrationTestJavaJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/tmp/compileIntegrationTestJavaJava/previous-compilation-data.bin'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:compileIntegrationTestJavaJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/generated/sources/headers/java/integrationTestJava'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:compileIntegrationTestJavaJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
Note: /Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/src/test-integration/java/io/airbyte/integrations/destination/starrocks/StarrocksDestinationAcceptanceTest.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.

> Task :airbyte-integrations:connectors:destination-starrocks:pmdIntegrationTestJava
Execution optimizations have been disabled for task ':airbyte-integrations:connectors:destination-starrocks:pmdIntegrationTestJava' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/tmp/pmdIntegrationTestJava/incremental.cache'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:pmdIntegrationTestJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/reports/pmd/integrationTestJava.html'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:pmdIntegrationTestJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/reports/pmd/integrationTestJava.xml'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:pmdIntegrationTestJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :airbyte-integrations:connectors:destination-starrocks:pmdMain
Execution optimizations have been disabled for task ':airbyte-integrations:connectors:destination-starrocks:pmdMain' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/reports/pmd/main.html'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:pmdMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/tmp/pmdMain/incremental.cache'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:pmdMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/reports/pmd/main.xml'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:pmdMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :airbyte-integrations:connectors:destination-starrocks:spotbugsIntegrationTestJava
Execution optimizations have been disabled for task ':airbyte-integrations:connectors:destination-starrocks:spotbugsIntegrationTestJava' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/spotbugsIntegrationTestJava-analyse-class-file.txt'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:spotbugsIntegrationTestJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/reports/spotbugs/integrationTestJava.html'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:spotbugsIntegrationTestJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :airbyte-integrations:connectors:destination-starrocks:spotbugsMain
Execution optimizations have been disabled for task ':airbyte-integrations:connectors:destination-starrocks:spotbugsMain' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/reports/spotbugs/main.html'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:spotbugsMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/Users/atwong/sandbox/airbyte/airbyte-integrations/connectors/destination-starrocks/build/spotbugsMain-analyse-class-file.txt'. Reason: Task ':airbyte-integrations:connectors:destination-starrocks:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:destination-starrocks:spotbugsMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6/userguide/validation_problems.html#implicit_dependency for more details about this problem.
The following classes needed for analysis were missing:
  makeConcatWithConstants
  apply
  voidCall
  accept

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 6 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD SUCCESSFUL in 1m 11s
62 actionable tasks: 46 executed, 16 up-to-date
S3 cache 3s wasted on misses, reads: 15, elapsed: 2s