search

markhoerth / dremio-cloudwatch-exporter

3 stars 3 forks source link

Apparent conflict with updated AWS SDK in Dremio v24 #5

Open adamdodev opened 1 year ago

adamdodev commented 1 year ago

We're getting a number of errors when this jar is deployed with Dremio 24.1.3.

These include service startup:

023-08-07 10:18:01,668 [main] ERROR ROOT - Dremio is exiting. Failure while starting services.
java.lang.NoSuchMethodError: software.amazon.awssdk.utils.CollectionUtils.uniqueIndex(Ljava/lang/Iterable;Ljava/util/function/Function;)Ljava/util/Map;

and S3 queries:

"NoSuchFieldError: DUALSTACK_ENDPOINT_ENABLED".

Removing this jar and YAML fixes all issues. My assumption is that this 3 year old build now causes a conflict with the AWS SDK used by Dremio itself.

I'm guessing either a newer build is needed, or this repo should only include the Cloudwatch SDK, not the full AWS SDK, to avoid conflicts.

nickbrennan1 commented 9 months ago

@adamdodev I faced the same issue. Provided you clean down your cloned repo with an explicit mvn clean and ensure you are using JDK11 rather than 8, this will build out successfully. We've had successful compiles at both 24.1.0 and 24.3.0