search

Azure / azure-sdk-for-java

This repository is for active development of the Azure SDK for Java. For consumers of the SDK we recommend visiting our public developer docs at https://docs.microsoft.com/java/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-java.
MIT License
2.35k stars 1.99k forks source link

[BUG] Messages aren't picked from the Service Bus Subscription after 11 days of deployment #21017

Closed sudharsan2020 closed 3 years ago

sudharsan2020 commented 3 years ago

Describe the bug

Exception or Stack Trace No exceptions were found in AppInsights logging. Hence we are attaching the Kubernetes pod log of the webjobs

INFO  [2021-04-27 14:23:06,076] org.mongodb.driver.cluster: Discovered replica set primary cdb-ms-prod-eastus1-fd11.documents.azure.com:10255
INFO  [2021-04-27 14:23:06,076] org.mongodb.driver.cluster: Discovered replica set primary cdb-ms-prod-eastus1-fd11.documents.azure.com:10255
INFO  [2021-04-27 14:23:06,078] org.mongodb.driver.cluster: Monitor thread successfully connected to server with description ServerDescription{address=cdb-ms-prod-eastus1-fd11.documents.azure.co
m:10255, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 2, 0]}, minWireVersion=0, maxWireVersion=2, maxDocumentSize=16777216, logicalSessionTimeoutMinutes
=null, roundTripTimeNanos=29987235, setName='globaldb', canonicalAddress=cdb-ms-prod-eastus1-fd11.documents.azure.com:10255, hosts=[cdb-ms-prod-eastus1-fd11.documents.azure.com:10255], passiv
es=[], arbiters=[], primary='cdb-ms-prod-eastus1-fd11.documents.azure.com:10255', tagSet=TagSet{[]}, electionId=null, setVersion=1, lastWriteDate=null, lastUpdateTimeNanos=7839726471962}       
INFO  [2021-04-27 14:23:06,079] org.mongodb.driver.cluster: Setting max set version to 1 from replica set primary cdb-ms-prod-eastus1-fd11.documents.azure.com:10255
INFO  [2021-04-27 14:23:06,079] org.mongodb.driver.cluster: Discovered replica set primary cdb-ms-prod-eastus1-fd11.documents.azure.com:10255
INFO  [2021-04-27 14:23:06,086] org.mongodb.driver.connection: Opened connection [connectionId{localValue:12, serverValue:-1026845694}] to cdb-ms-prod-eastus1-fd11.documents.azure.com:10255    
INFO  [2021-04-27 14:23:06,101] org.mongodb.driver.cluster: Monitor thread successfully connected to server with description ServerDescription{address=cdb-ms-prod-eastus1-fd11.documents.azure.co
m:10255, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 2, 0]}, minWireVersion=0, maxWireVersion=2, maxDocumentSize=16777216, logicalSessionTimeoutMinutes
=null, roundTripTimeNanos=14151911, setName='globaldb', canonicalAddress=cdb-ms-prod-eastus1-fd11.documents.azure.com:10255, hosts=[cdb-ms-prod-eastus1-fd11.documents.azure.com:10255], passiv
es=[], arbiters=[], primary='cdb-ms-prod-eastus1-fd11.documents.azure.com:10255', tagSet=TagSet{[]}, electionId=null, setVersion=1, lastWriteDate=null, lastUpdateTimeNanos=7839748883738}       
INFO  [2021-04-27 14:23:06,101] org.mongodb.driver.cluster: Setting max set version to 1 from replica set primary cdb-ms-prod-eastus1-fd11.documents.azure.com:10255
INFO  [2021-04-27 14:23:06,101] org.mongodb.driver.cluster: Discovered replica set primary cdb-ms-prod-eastus1-fd11.documents.azure.com:10255
INFO  [2021-04-27 14:23:06,133] org.mongodb.driver.cluster: Cluster created with settings {hosts=[nsnonprod.documents.azure.com:10255], mode=MULTIPLE, requiredClusterType=REPLICA_SET, serverSelecti
onTimeout='60000 ms', maxWaitQueueSize=3500, requiredReplicaSetName='globaldb'}
INFO  [2021-04-27 14:23:06,133] org.mongodb.driver.cluster: Adding discovered server nsnonprod.documents.azure.com:10255 to client view of cluster
INFO  [2021-04-27 14:23:06,161] org.mongodb.driver.connection: Opened connection [connectionId{localValue:13, serverValue:-937342664}] to nsnonprod.documents.azure.com:10255
INFO  [2021-04-27 14:23:06,163] org.mongodb.driver.cluster: Monitor thread successfully connected to server with description ServerDescription{address=nsnonprod.documents.azure.com:10255, type=REPL
ICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 2, 0]}, minWireVersion=0, maxWireVersion=2, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=null, roundTripTi
meNanos=1741414, setName='globaldb', canonicalAddress=cdb-ms-prod-eastus1-fd11.documents.azure.com:10255, hosts=[cdb-ms-prod-eastus1-fd11.documents.azure.com:10255], passives=[], arbiters=[],
 primary='cdb-ms-prod-eastus1-fd11.documents.azure.com:10255', tagSet=TagSet{[]}, electionId=null, setVersion=1, lastWriteDate=null, lastUpdateTimeNanos=7839811648130}
INFO  [2021-04-27 14:23:06,168] org.mongodb.driver.cluster: Adding discovered server cdb-ms-prod-eastus1-fd11.documents.azure.com:10255 to client view of cluster
INFO  [2021-04-27 14:23:06,190] org.mongodb.driver.cluster: Server nsnonprod.documents.azure.com:10255 is no longer a member of the replica set.  Removing from client view of cluster.
Could not get a resource from the pool
INFO  [2021-04-27 14:23:06,240] org.mongodb.driver.connection: Opened connection [connectionId{localValue:14, serverValue:-1291490047}] to nsnonprod.documents.azure.com:10255
INFO  [2021-04-27 14:23:06,249] org.mongodb.driver.cluster: Monitor thread successfully connected to server with description ServerDescription{address=nsnonprod.documents.azure.com:10255, type=REPL
ICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 2, 0]}, minWireVersion=0, maxWireVersion=2, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=null, roundTripTi
meNanos=8826069, setName='globaldb', canonicalAddress=cdb-ms-prod-eastus1-fd11.documents.azure.com:10255, hosts=[cdb-ms-prod-eastus1-fd11.documents.azure.com:10255], passives=[], arbiters=[],
 primary='cdb-ms-prod-eastus1-fd11.documents.azure.com:10255', tagSet=TagSet{[]}, electionId=null, setVersion=1, lastWriteDate=null, lastUpdateTimeNanos=7839897806105}
INFO  [2021-04-27 14:23:06,250] org.mongodb.driver.cluster: Adding discovered server cdb-ms-prod-eastus1-fd11.documents.azure.com:10255 to client view of cluster
INFO  [2021-04-27 14:23:06,252] org.mongodb.driver.cluster: Server nsnonprod.documents.azure.com:10255 is no longer a member of the replica set.  Removing from client view of cluster.
mkdir: cannot create directory ‘tmp’: File exists
14:23:06,928 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
14:23:06,928 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
14:23:06,928 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/usr/local/extraction/extraction.jar!/logback.xml]
14:23:06,955 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@233c0b17 - URL [jar:file:/usr/local/extraction/extraction.jar!/logback.xml] is not of type file
14:23:07,239 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
14:23:07,250 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
14:23:07,261 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:23:07,312 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:23:07,317 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [SIZE_AND_TIME_BASED_FILE]
14:23:07,360 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@787867107 - No compression will be used
14:23:07,362 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@787867107 - Will use the pattern logs/ocr.%d{yyyy-MM-dd-HH}.%i.log for the active file
14:23:07,365 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58651fd0 - The date pattern is 'yyyy-MM-dd-HH' from file name pattern 'logs/ocr.%d{yyyy-MM-dd-HH}.%i.log'.
14:23:07,365 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58651fd0 - Roll-over at the top of every hour.
14:23:07,373 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58651fd0 - Setting initial period to Tue Apr 27 12:14:27 GMT 2021
14:23:07,374 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58651fd0 - SizeAndTimeBasedFNATP is deprecated. Use SizeAndTimeBasedRollingPolicy instead
14:23:07,374 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@58651fd0 - For more information see http://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy
14:23:07,380 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
14:23:07,385 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[SIZE_AND_TIME_BASED_FILE] - Active log file name: logs/ocr.log
14:23:07,385 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[SIZE_AND_TIME_BASED_FILE] - File property is set to [logs/ocr.log]
14:23:07,406 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO
14:23:07,407 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
14:23:07,407 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
14:23:07,408 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@5c7fa833 - Registering current configuration as safe fallback point
INFO  [2021-04-27 14:23:09,047] org.eclipse.jetty.util.log: Logging initialized @2402ms to org.eclipse.jetty.util.log.Slf4jLog
INFO  [2021-04-27 14:23:09,186] io.dropwizard.server.DefaultServerFactory: Registering jersey handler with root path prefix: /
INFO  [2021-04-27 14:23:09,199] io.dropwizard.server.DefaultServerFactory: Registering admin handler with root path prefix: /admin
INFO  [2021-04-27 14:23:09,203] io.dropwizard.assets.AssetsBundle: Registering AssetBundle with name: swagger-assets for path /swagger-static/*
INFO  [2021-04-27 14:23:09,261] io.dropwizard.assets.AssetsBundle: Registering AssetBundle with name: swagger-oauth2-connect for path /o2c.html/*

To Reproduce Steps to reproduce the behavior:

Code Snippet

public class WebJobListener {
    private ServiceBusReceiverAsyncClient serviceBusReceiverAsyncClient;
    private Gson gson;
    private ILogger log;
    private static final Type requestModelType = new TypeToken<RequestModel>() {}.getType();

    @Inject
    public WebJobListener(ILogger log) {
        this.serviceBusReceiverAsyncClient = new ServiceBusClientBuilder()
                .connectionString(System.getenv("AZURE_SERVICEBUS_NAMESPACE_CONNECTION_STRING"))
                .retryOptions(new AmqpRetryOptions().setTryTimeout(Duration.ofSeconds(30)))
                .receiver()
                .receiveMode(ServiceBusReceiveMode.PEEK_LOCK)
                .topicName("MY_TOPIC")
                .subscriptionName("MY_SUBSCRIPTION")
                .prefetchCount(0) // Turn of prefetch messages
                .maxAutoLockRenewDuration(Duration.ofMinutes(10))
                .disableAutoComplete()
                .buildAsyncClient();
        this.jobManager = jobManager;
        this.captureJob = new CaptureJob();
        this.gson = new Gson();
        this.log = log;
    }

    public void run() {
        log.trace("Webjob worker starting to Listen", LogLevels.Verbose, null);
        serviceBusReceiverAsyncClient.receiveMessages().flatMap(message -> {
                    // Process message. If an exception is thrown from this consumer, the message is abandoned.
                    // Otherwise, it is completed.
                    if(message.getSubject().contentEquals("MY_SUBSCRIPTION")) {
                        RequestModel requestModel = gson.fromJson(message.getBody().toString(), requestModelType);

                        // My logic goes here
                        //my_test_function(requestModel);

                        // Complete the message after function completes
                        return serviceBusReceiverAsyncClient.complete(message);
                    }
                },
                error -> log.trace("Error occurred while receiving message from subscription: " + error , LogLevels.Error, null));
    }
}

Expected behavior Azure Service Bus client should pick up messages after n days of deployment from the subscription

Screenshots NA

Setup (please complete the following information):

Additional context Already raised a similar issue which got resolved by upgrading the azure-messaging-servicebus from 7.0.1 to 7.0.2 https://github.com/Azure/azure-sdk-for-java/issues/19254

Information Checklist Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

joshfree commented 3 years ago

@YijunXieMS could you please take a look?

YijunXieMS commented 3 years ago

Hi @sudharsan2020, do you see any exceptions (especially network error) in the logs of Apr 23rd?

sudharsan2020 commented 3 years ago

@YijunXieMS Thanks for reaching out. Please find my observations

Can you please help us to troubleshoot the issue since it's impacting our product release?

sudharsan2020 commented 3 years ago

@YijunXieMS Any updates?

YijunXieMS commented 3 years ago

Hi @sudharsan2020 I do find a bug with receiveMessages(), which doesn't reconnect after an network issue. I'm working on a fix. I'll update you once I fix it.

sudharsan2020 commented 3 years ago

@YijunXieMS Please provide an update once the fix is available. Thanks.

YijunXieMS commented 3 years ago

@sudharsan2020 I plan to release the bug fix early next week. I'll update you here once it's released.

YijunXieMS commented 3 years ago

@sudharsan2020 we released 7.2.2 today to fix connection retry problem. Could you upgrade and try?

sudharsan2020 commented 3 years ago

@YijunXieMS Thanks for the update. I will monitor the issue for two weeks and share an update.

sudharsan2020 commented 3 years ago

@YijunXieMS Getting the below error while upgrading the azure-messaging-servicebus library 7.1.0 to 7.2.2 NOTE: The issue occurs only in the 7.2.x version of azure-messaging-servicebus library Error message: Cannot inherit from final class

20:18:11,084 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[SIZE_AND_TIME_BASED_FILE] - Active log file name: logs/ocr.log
20:18:11,084 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[SIZE_AND_TIME_BASED_FILE] - File property is set to [logs/ocr.log]
20:18:11,085 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO
20:18:11,085 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
20:18:11,086 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
20:18:11,087 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@aecb35a - Registering current configuration as safe fallback point
INFO  [2021-05-28 14:48:12,038] org.eclipse.jetty.util.log: Logging initialized @1438ms to org.eclipse.jetty.util.log.Slf4jLog
INFO  [2021-05-28 14:48:12,103] io.dropwizard.server.DefaultServerFactory: Registering jersey handler with root path prefix: /
INFO  [2021-05-28 14:48:12,104] io.dropwizard.server.DefaultServerFactory: Registering admin handler with root path prefix: /admin
INFO  [2021-05-28 14:48:12,106] io.dropwizard.assets.AssetsBundle: Registering AssetBundle with name: swagger-assets for path /swagger-static/*
INFO  [2021-05-28 14:48:12,131] io.dropwizard.assets.AssetsBundle: Registering AssetBundle with name: swagger-oauth2-connect for path /o2c.html/*
INFO  [2021-05-28 14:48:12,216] org.reflections.Reflections: Reflections took 68 ms to scan 1 urls, producing 304 keys and 418 values 
INFO  [2021-05-28 14:48:12,918] com.azure.security.keyvault.secrets.SecretAsyncClient: Retrieving secret - Environment--DatabaseName
INFO  [2021-05-28 14:48:15,461] com.azure.identity.ClientSecretCredential: Azure Identity => getToken() result for scopes [https://vault.azure.net/.default]: SUCCESS
INFO  [2021-05-28 14:48:20,628] com.azure.security.keyvault.secrets.SecretAsyncClient: Retrieving secret - ServiceBusSettingsConnectionString
INFO  [2021-05-28 14:48:21,973] com.azure.security.keyvault.secrets.SecretAsyncClient: Retrieved secret - ServiceBusSettingsConnectionString
INFO  [2021-05-28 14:48:21,974] com.azure.security.keyvault.secrets.SecretAsyncClient: Retrieving secret - RedisCacheRedisHostName
INFO  [2021-05-28 14:48:23,328] com.azure.security.keyvault.secrets.SecretAsyncClient: Retrieved secret - RedisCacheRedisHostName
INFO  [2021-05-28 14:48:26,283] org.mongodb.driver.cluster: Cluster created with settings {hosts=[nsnonprod.documents.azure.com:10255], mode=MULTIPLE, requiredClusterType=REPLICA_SET, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500, requiredReplicaSetName='globaldb'}
INFO  [2021-05-28 14:48:26,283] org.mongodb.driver.cluster: Adding discovered server nsnonprod.documents.azure.com:10255 to client view of cluster
INFO  [2021-05-28 14:48:26,327] org.mongodb.driver.cluster: Cluster created with settings {hosts=[nsnonprod.documents.azure.com:10255], mode=MULTIPLE, requiredClusterType=REPLICA_SET, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500, requiredReplicaSetName='globaldb'}
WARN  [2021-05-28 14:48:26,455] com.azure.messaging.servicebus.implementation.ServiceBusConnectionProcessor: Processors can only be subscribed to once.
Cannot inherit from final class

Process finished with exit code 1

POM.xml: The POM file can be obtained from the below link. https://pastebin.com/MhdwuP52

Can you please do the needful?

YijunXieMS commented 3 years ago

Hi @sudharsan2020 A sanity check. I see 7.2.0 is used in the pom.xml. Could you use 7.2.2?

One more thing not directly related to this. The default number of retries is 3, which will exhaust in a few minutes. I suggest you config a larger number just in case you have longer network problem.

sudharsan2020 commented 3 years ago

@YijunXieMS The same issue persists with 7.2.2 version too. I was trying different 7.2.x version and all of them were throwing same error.

YijunXieMS commented 3 years ago

@sudharsan2020 I set up a test project with your pom.xml. It couldn't resolve dependency com.azure.shaded:keyvault:shaded..I removed it then moved forward and got an error about serialization. After I changed the fastxml.jackson dependency to use 2.12.2, the serialization error disappeared. I guess your problem is related to it. Could you try to update your jackson version if possible?

sudharsan2020 commented 3 years ago

@YijunXieMS Sorry gettting the same issue after upgrading the Jackson 2.12.2

        <dependency>
            <groupId>com.fasterxml.jackson.datatype</groupId>
            <artifactId>jackson-datatype-joda</artifactId>
            <version>2.12.2</version>
        </dependency>

I've attached the pom.xml used for generating the library com.azure.shaded I've used the shaded JAR mentioned in the below thread: https://github.com/Azure/azure-sdk-for-java/issues/14349#issuecomment-683934682

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <groupId>com.azure.shaded</groupId>
    <artifactId>keyvault-shaded</artifactId>
    <version>2.0-SNAPSHOT</version>

    <name>keyvaultshaded-app</name>
    <url>http://www.example.com</url>

    <properties>
        <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
        <maven.compiler.source>1.8</maven.compiler.source>
        <maven.compiler.target>1.8</maven.compiler.target>
    </properties>

    <dependencies>
            <dependency>
                <groupId>com.azure</groupId>
                <artifactId>azure-security-keyvault-secrets</artifactId>
                <version>4.2.3</version>
            </dependency>
            <dependency>
                <groupId>com.azure</groupId>
                <artifactId>azure-identity</artifactId>
                <version>1.2.0</version>
            </dependency>
        <dependency>
            <groupId>com.azure</groupId>
            <artifactId>azure-core</artifactId>
            <version>1.11.0</version>
        </dependency>
    </dependencies>

    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-shade-plugin</artifactId>
                <version>3.1.0</version>
                <executions>
                    <execution>
                        <phase>package</phase>
                        <goals>
                            <goal>shade</goal>
                        </goals>
                        <configuration>
                            <!--                            <finalName>azuresdkshaded-${project.version}-shaded</finalName>-->
                            <filters>
                                <filter>
                                    <artifact>*:*</artifact>
                                    <excludes>
                                        <exclude>META-INF/*.SF</exclude>
                                        <exclude>META-INF/*.DSA</exclude>
                                        <exclude>META-INF/*.RSA</exclude>
                                    </excludes>
                                </filter>
                            </filters>
                            <relocations>
                                <relocation>
                                    <pattern>com.fasterxml.jackson</pattern>
                                    <shadedPattern>com.microsoft.shaded.fasterxml.jackson</shadedPattern>
                                </relocation>
                            </relocations>
                        </configuration>
                    </execution>
                </executions>
            </plugin>
        </plugins>
        <pluginManagement><!-- lock down plugins versions to avoid using Maven defaults (may be moved to parent pom) -->
            <plugins>

                <plugin>
                    <groupId>org.apache.maven.plugins</groupId>
                    <artifactId>maven-compiler-plugin</artifactId>
                    <version>3.8.0</version>
                    <configuration>
                        <source>1.8</source>
                        <target>1.8</target>
                    </configuration>
                </plugin>

            </plugins>
        </pluginManagement>

    </build>

</project>
YijunXieMS commented 3 years ago

This is still dependency conflicts I guess. Those azure-* packages look pretty old. For instance latest azure-core is 1.16.0, azure-identity 1.3.0 and azure-security-keyvault-secrets 4.2.8. servicebus 7.2.2 uses azure-core 1.16.0.

sudharsan2020 commented 3 years ago

@YijunXieMS I've upgraded to the latest packages and still getting the same error. Also tried by removing the shaded package and directly using the libraries, but the issue still persists :(

Updated shaded pom.xml

             <dependency>
                <groupId>com.azure</groupId>
                <artifactId>azure-security-keyvault-secrets</artifactId>
                <version>4.2.8</version>
            </dependency>
            <dependency>
                <groupId>com.azure</groupId>
                <artifactId>azure-identity</artifactId>
                <version>1.3.0</version>
            </dependency>
        <dependency>
            <groupId>com.azure</groupId>
            <artifactId>azure-core</artifactId>
            <version>1.16.0</version>
        </dependency>
YijunXieMS commented 3 years ago

Could you run mvn dependency:tree -Dverbose?

sudharsan2020 commented 3 years ago

Please find the Maven dependency report.

pom.xml used: https://pastebin.com/2k5i1B95

Report: 

nextstep-core-java ---
[INFO] com.utils.capture:nextstep-core-java:jar:3.2.17
[INFO] +- org.projectlombok:lombok:jar:1.16.16:compile
[INFO] +- io.dropwizard:dropwizard-core:jar:1.1.0:compile
[INFO] |  +- io.dropwizard:dropwizard-util:jar:1.1.0:compile
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.8.0:compile - omitted for conflict with 2.12.2)
[INFO] |  |  +- (com.google.guava:guava:jar:21.0:compile - omitted for conflict with 20.0)
[INFO] |  |  +- com.google.code.findbugs:jsr305:jar:3.0.1:compile
[INFO] |  |  \- (joda-time:joda-time:jar:2.9.7:compile - omitted for conflict with 2.10.8)
[INFO] |  +- io.dropwizard:dropwizard-jackson:jar:1.1.0:compile
[INFO] |  |  +- (com.google.guava:guava:jar:21.0:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard:dropwizard-util:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for conflict with 2.12.2)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.8.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for conflict with 2.12.2)
[INFO] |  |  +- com.fasterxml.jackson.datatype:jackson-datatype-guava:jar:2.8.7:compile
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  |  \- (com.google.guava:guava:jar:16.0:compile - omitted for conflict with 21.0)
[INFO] |  |  +- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.8.7:compile
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.8.0:compile - omitted for duplicate)
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  |  \- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  +- com.fasterxml.jackson.datatype:jackson-datatype-jdk8:jar:2.8.7:compile
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  |  \- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  +- com.fasterxml.jackson.module:jackson-module-parameter-names:jar:2.8.7:compile
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  |  \- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  +- com.fasterxml.jackson.module:jackson-module-afterburner:jar:2.8.7:compile
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  |  \- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.datatype:jackson-datatype-joda:jar:2.8.7:compile - omitted for conflict with 2.12.2)
[INFO] |  |  +- (org.slf4j:slf4j-api:jar:1.7.24:compile - omitted for conflict with 1.7.13)
[INFO] |  |  \- ch.qos.logback:logback-classic:jar:1.2.1:compile
[INFO] |  |     \- (ch.qos.logback:logback-core:jar:1.2.1:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-validation:jar:1.1.0:compile
[INFO] |  |  +- (io.dropwizard:dropwizard-util:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- org.hibernate:hibernate-validator:jar:5.3.4.Final:compile
[INFO] |  |  |  +- (javax.validation:validation-api:jar:1.1.0.Final:compile - omitted for duplicate)
[INFO] |  |  |  +- org.jboss.logging:jboss-logging:jar:3.3.0.Final:compile
[INFO] |  |  |  \- com.fasterxml:classmate:jar:1.3.1:compile
[INFO] |  |  \- org.glassfish:javax.el:jar:3.0.0:compile
[INFO] |  +- io.dropwizard:dropwizard-configuration:jar:1.1.0:compile
[INFO] |  |  +- (io.dropwizard:dropwizard-jackson:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard:dropwizard-validation:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.8.7:compile - omitted for conflict with 2.7.7)
[INFO] |  |  \- (org.apache.commons:commons-lang3:jar:3.5:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-logging:jar:1.1.0:compile
[INFO] |  |  +- (io.dropwizard:dropwizard-jackson:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard:dropwizard-validation:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- io.dropwizard.metrics:metrics-logback:jar:3.2.2:compile
[INFO] |  |  |  \- (io.dropwizard.metrics:metrics-core:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  +- (org.slf4j:slf4j-api:jar:1.7.24:compile - omitted for duplicate)
[INFO] |  |  +- (org.slf4j:jul-to-slf4j:jar:1.7.24:compile - omitted for conflict with 1.7.13)
[INFO] |  |  +- ch.qos.logback:logback-core:jar:1.2.1:compile
[INFO] |  |  +- (ch.qos.logback:logback-classic:jar:1.2.1:compile - omitted for duplicate)
[INFO] |  |  +- org.slf4j:log4j-over-slf4j:jar:1.7.24:compile
[INFO] |  |  |  \- (org.slf4j:slf4j-api:jar:1.7.24:compile - omitted for duplicate)
[INFO] |  |  +- org.slf4j:jcl-over-slf4j:jar:1.7.24:compile
[INFO] |  |  |  \- (org.slf4j:slf4j-api:jar:1.7.24:compile - omitted for duplicate)
[INFO] |  |  \- org.eclipse.jetty:jetty-util:jar:9.4.2.v20170220:compile
[INFO] |  +- io.dropwizard:dropwizard-metrics:jar:1.1.0:compile
[INFO] |  |  +- (io.dropwizard:dropwizard-lifecycle:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard:dropwizard-jackson:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard:dropwizard-validation:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard.metrics:metrics-core:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  \- (org.slf4j:slf4j-api:jar:1.7.24:compile - omitted for duplicate)
[INFO] |  +- (io.dropwizard:dropwizard-jersey:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-servlets:jar:1.1.0:compile
[INFO] |  |  +- (org.slf4j:slf4j-api:jar:1.7.24:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard:dropwizard-util:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- io.dropwizard.metrics:metrics-annotation:jar:3.2.2:compile
[INFO] |  |  |  \- (org.slf4j:slf4j-api:jar:1.7.22:compile - omitted for conflict with 1.7.24)
[INFO] |  |  +- (io.dropwizard.metrics:metrics-core:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  \- (ch.qos.logback:logback-classic:jar:1.2.1:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-jetty:jar:1.1.0:compile
[INFO] |  |  +- (io.dropwizard:dropwizard-logging:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- io.dropwizard.metrics:metrics-jetty9:jar:3.2.2:compile
[INFO] |  |  |  \- (io.dropwizard.metrics:metrics-core:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  +- (org.eclipse.jetty:jetty-server:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  +- org.eclipse.jetty:jetty-servlet:jar:9.4.2.v20170220:compile
[INFO] |  |  |  \- org.eclipse.jetty:jetty-security:jar:9.4.2.v20170220:compile
[INFO] |  |  |     \- (org.eclipse.jetty:jetty-server:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  +- org.eclipse.jetty:jetty-servlets:jar:9.4.2.v20170220:compile
[INFO] |  |  |  +- (org.eclipse.jetty:jetty-continuation:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.eclipse.jetty:jetty-http:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.eclipse.jetty:jetty-util:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  |  \- (org.eclipse.jetty:jetty-io:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  \- org.eclipse.jetty:jetty-http:jar:9.4.2.v20170220:compile
[INFO] |  |     +- (org.eclipse.jetty:jetty-util:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |     \- (org.eclipse.jetty:jetty-io:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-lifecycle:jar:1.1.0:compile
[INFO] |  |  +- (org.slf4j:slf4j-api:jar:1.7.24:compile - omitted for duplicate)
[INFO] |  |  +- (com.google.guava:guava:jar:21.0:compile - omitted for duplicate)
[INFO] |  |  +- (org.eclipse.jetty:jetty-server:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  \- (io.dropwizard:dropwizard-util:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard.metrics:metrics-core:jar:3.2.2:compile
[INFO] |  +- io.dropwizard.metrics:metrics-jvm:jar:3.2.2:compile
[INFO] |  |  \- (io.dropwizard.metrics:metrics-core:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard.metrics:metrics-servlets:jar:3.2.2:compile
[INFO] |  |  +- (io.dropwizard.metrics:metrics-core:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard.metrics:metrics-healthchecks:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  +- io.dropwizard.metrics:metrics-json:jar:3.2.2:compile
[INFO] |  |  |  \- (io.dropwizard.metrics:metrics-core:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard.metrics:metrics-jvm:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  \- com.papertrail:profiler:jar:1.0.2:compile
[INFO] |  |     \- (joda-time:joda-time:jar:2.9.1:compile - omitted for conflict with 2.9.7)
[INFO] |  +- io.dropwizard.metrics:metrics-healthchecks:jar:3.2.2:compile
[INFO] |  +- io.dropwizard:dropwizard-request-logging:jar:1.1.0:compile
[INFO] |  |  +- (io.dropwizard:dropwizard-jetty:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (io.dropwizard:dropwizard-logging:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  \- ch.qos.logback:logback-access:jar:1.2.1:compile
[INFO] |  |     \- (ch.qos.logback:logback-core:jar:1.2.1:compile - omitted for duplicate)
[INFO] |  +- net.sourceforge.argparse4j:argparse4j:jar:0.7.0:compile
[INFO] |  \- org.eclipse.jetty.toolchain.setuid:jetty-setuid-java:jar:1.0.3:compile
[INFO] +- io.dropwizard:dropwizard-jersey:jar:1.1.0:compile
[INFO] |  +- (io.dropwizard:dropwizard-jackson:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- (io.dropwizard:dropwizard-validation:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- (io.dropwizard:dropwizard-logging:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- org.glassfish.jersey.core:jersey-server:jar:2.25.1:compile
[INFO] |  |  +- org.glassfish.jersey.core:jersey-common:jar:2.25.1:compile
[INFO] |  |  |  +- (javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile - omitted for duplicate)
[INFO] |  |  |  +- (javax.annotation:javax.annotation-api:jar:1.2:compile - omitted for duplicate)
[INFO] |  |  |  +- org.glassfish.jersey.bundles.repackaged:jersey-guava:jar:2.25.1:compile
[INFO] |  |  |  +- (org.glassfish.hk2:hk2-api:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2.external:javax.inject:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2:hk2-locator:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  \- org.glassfish.hk2:osgi-resource-locator:jar:1.0.1:compile
[INFO] |  |  +- org.glassfish.jersey.core:jersey-client:jar:2.25.1:compile
[INFO] |  |  |  +- (javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.jersey.core:jersey-common:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2:hk2-api:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2.external:javax.inject:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  \- (org.glassfish.hk2:hk2-locator:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  +- javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile
[INFO] |  |  +- org.glassfish.jersey.media:jersey-media-jaxb:jar:2.25.1:compile
[INFO] |  |  |  +- (org.glassfish.jersey.core:jersey-common:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2:hk2-api:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2.external:javax.inject:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2:hk2-locator:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  \- (org.glassfish.hk2:osgi-resource-locator:jar:1.0.1:compile - omitted for duplicate)
[INFO] |  |  +- javax.annotation:javax.annotation-api:jar:1.2:compile
[INFO] |  |  +- (org.glassfish.hk2:hk2-api:jar:2.5.0-b32:compile - omitted for conflict with 2.5.0-b36)
[INFO] |  |  +- org.glassfish.hk2.external:javax.inject:jar:2.5.0-b32:compile
[INFO] |  |  +- org.glassfish.hk2:hk2-locator:jar:2.5.0-b32:compile
[INFO] |  |  |  +- (org.glassfish.hk2.external:javax.inject:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2.external:aopalliance-repackaged:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2:hk2-api:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.hk2:hk2-utils:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  \- org.javassist:javassist:jar:3.20.0-GA:compile
[INFO] |  |  \- javax.validation:validation-api:jar:1.1.0.Final:compile
[INFO] |  +- org.glassfish.jersey.ext:jersey-metainf-services:jar:2.25.1:compile
[INFO] |  |  +- (org.glassfish.jersey.core:jersey-common:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  \- (javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile - omitted for duplicate)
[INFO] |  +- org.glassfish.jersey.ext:jersey-bean-validation:jar:2.25.1:compile
[INFO] |  |  +- (org.glassfish.hk2.external:javax.inject:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  +- (org.glassfish.jersey.core:jersey-common:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  +- (org.glassfish.jersey.core:jersey-server:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  +- (javax.validation:validation-api:jar:1.1.0.Final:compile - omitted for duplicate)
[INFO] |  |  +- (org.hibernate:hibernate-validator:jar:5.1.3.Final:compile - omitted for conflict with 5.3.4.Final)
[INFO] |  |  +- javax.el:javax.el-api:jar:2.2.4:compile
[INFO] |  |  +- org.glassfish.web:javax.el:jar:2.2.4:compile
[INFO] |  |  |  \- (javax.el:javax.el-api:jar:2.2.4:compile - omitted for duplicate)
[INFO] |  |  \- (javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard.metrics:metrics-jersey2:jar:3.2.2:compile
[INFO] |  |  +- (io.dropwizard.metrics:metrics-core:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  |  \- (io.dropwizard.metrics:metrics-annotation:jar:3.2.2:compile - omitted for duplicate)
[INFO] |  +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:jar:2.8.7:compile
[INFO] |  |  +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.8.7:compile
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  |  \- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |  \- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.8.7:compile
[INFO] |  |     +- (com.fasterxml.jackson.core:jackson-core:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  |     +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.8.0:compile - omitted for duplicate)
[INFO] |  |     \- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.7:compile - omitted for duplicate)
[INFO] |  +- org.glassfish.jersey.containers:jersey-container-servlet:jar:2.25.1:compile
[INFO] |  |  +- org.glassfish.jersey.containers:jersey-container-servlet-core:jar:2.25.1:compile
[INFO] |  |  |  +- (org.glassfish.hk2.external:javax.inject:jar:2.5.0-b32:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.jersey.core:jersey-common:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  |  +- (org.glassfish.jersey.core:jersey-server:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  |  \- (javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile - omitted for duplicate)
[INFO] |  |  +- (org.glassfish.jersey.core:jersey-common:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  +- (org.glassfish.jersey.core:jersey-server:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  \- (javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile - omitted for duplicate)
[INFO] |  +- org.eclipse.jetty:jetty-server:jar:9.4.2.v20170220:compile
[INFO] |  |  +- javax.servlet:javax.servlet-api:jar:3.1.0:compile
[INFO] |  |  +- (org.eclipse.jetty:jetty-http:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  \- org.eclipse.jetty:jetty-io:jar:9.4.2.v20170220:compile
[INFO] |  |     \- (org.eclipse.jetty:jetty-util:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  +- org.eclipse.jetty:jetty-webapp:jar:9.4.2.v20170220:compile
[INFO] |  |  +- org.eclipse.jetty:jetty-xml:jar:9.4.2.v20170220:compile
[INFO] |  |  |  \- (org.eclipse.jetty:jetty-util:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  |  \- (org.eclipse.jetty:jetty-servlet:jar:9.4.2.v20170220:compile - omitted for duplicate)
[INFO] |  +- org.eclipse.jetty:jetty-continuation:jar:9.4.2.v20170220:compile
[INFO] |  \- org.apache.commons:commons-lang3:jar:3.5:compile
[INFO] +- org.glassfish.hk2:hk2-api:jar:2.5.0-b36:compile
[INFO] |  +- javax.inject:javax.inject:jar:1:compile
[INFO] |  +- org.glassfish.hk2:hk2-utils:jar:2.5.0-b36:compile
[INFO] |  |  \- (javax.inject:javax.inject:jar:1:compile - omitted for duplicate)
[INFO] |  \- org.glassfish.hk2.external:aopalliance-repackaged:jar:2.5.0-b36:compile
[INFO] +- com.google.guava:guava:jar:20.0:compile
[INFO] +- com.smoketurner:dropwizard-swagger:jar:1.1.0-1:compile
[INFO] |  +- (io.dropwizard:dropwizard-core:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-auth:jar:1.1.0:compile
[INFO] |  |  \- (io.dropwizard:dropwizard-core:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-assets:jar:1.1.0:compile
[INFO] |  |  +- (io.dropwizard:dropwizard-core:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  \- (io.dropwizard:dropwizard-servlets:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-views:jar:1.1.0:compile
[INFO] |  |  \- (io.dropwizard:dropwizard-core:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  +- io.dropwizard:dropwizard-views-freemarker:jar:1.1.0:compile
[INFO] |  |  +- (io.dropwizard:dropwizard-views:jar:1.1.0:compile - omitted for duplicate)
[INFO] |  |  \- org.freemarker:freemarker:jar:2.3.23:compile
[INFO] |  +- org.glassfish.jersey.media:jersey-media-multipart:jar:2.25.1:compile
[INFO] |  |  +- (org.glassfish.jersey.core:jersey-common:jar:2.25.1:compile - omitted for duplicate)
[INFO] |  |  \- org.jvnet.mimepull:mimepull:jar:1.9.6:compile
[INFO] |  \- io.swagger:swagger-jersey2-jaxrs:jar:1.5.13:compile
[INFO] |     +- io.swagger:swagger-jaxrs:jar:1.5.13:compile
[INFO] |     |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.5:compile - omitted for conflict with 2.8.7)
[INFO] |     |  +- io.swagger:swagger-core:jar:1.5.13:compile
[INFO] |     |  |  +- (org.apache.commons:commons-lang3:jar:3.2.1:compile - omitted for conflict with 3.5)
[INFO] |     |  |  +- (org.slf4j:slf4j-api:jar:1.7.22:compile - omitted for conflict with 1.7.24)
[INFO] |     |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.8.5:compile - omitted for conflict with 2.8.0)
[INFO] |     |  |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.8.5:compile - omitted for conflict with 2.8.7)
[INFO] |     |  |  +- (com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.8.5:compile - omitted for conflict with 2.8.7)
[INFO] |     |  |  +- io.swagger:swagger-models:jar:1.5.13:compile
[INFO] |     |  |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.8.5:compile - omitted for conflict with 2.8.0)
[INFO] |     |  |  |  +- (org.slf4j:slf4j-api:jar:1.7.22:compile - omitted for conflict with 1.7.24)
[INFO] |     |  |  |  \- io.swagger:swagger-annotations:jar:1.5.13:compile
[INFO] |     |  |  +- (com.google.guava:guava:jar:20.0:compile - omitted for duplicate)
[INFO] |     |  |  \- (javax.validation:validation-api:jar:1.1.0.Final:compile - omitted for duplicate)
[INFO] |     |  +- org.reflections:reflections:jar:0.9.10:compile
[INFO] |     |  |  +- (com.google.guava:guava:jar:15.0:compile - omitted for conflict with 20.0)
[INFO] |     |  |  +- (org.javassist:javassist:jar:3.19.0-GA:compile - omitted for conflict with 3.20.0-GA)
[INFO] |     |  |  \- com.google.code.findbugs:annotations:jar:2.0.1:compile
[INFO] |     |  \- (com.google.guava:guava:jar:20.0:compile - omitted for duplicate)
[INFO] |     +- (org.glassfish.jersey.containers:jersey-container-servlet-core:jar:2.1:compile - omitted for conflict with 2.25.1)
[INFO] |     \- (org.glassfish.jersey.media:jersey-media-multipart:jar:2.1:compile - omitted for conflict with 2.25.1)
[INFO] +- com.fasterxml.jackson.datatype:jackson-datatype-joda:jar:2.12.2:compile
[INFO] |  +- com.fasterxml.jackson.core:jackson-annotations:jar:2.12.2:compile
[INFO] |  +- com.fasterxml.jackson.core:jackson-core:jar:2.12.2:compile
[INFO] |  +- com.fasterxml.jackson.core:jackson-databind:jar:2.12.2:compile
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.12.2:compile - omitted for duplicate)
[INFO] |  |  \- (com.fasterxml.jackson.core:jackson-core:jar:2.12.2:compile - omitted for duplicate)
[INFO] |  \- joda-time:joda-time:jar:2.10.8:compile
[INFO] +- org.mongojack:mongojack:jar:2.9.4:compile
[INFO] |  +- org.mongodb:mongodb-driver:jar:3.8.0:compile
[INFO] |  |  +- org.mongodb:bson:jar:3.8.0:compile
[INFO] |  |  \- org.mongodb:mongodb-driver-core:jar:3.8.0:compile
[INFO] |  |     \- (org.mongodb:bson:jar:3.8.0:compile - omitted for duplicate)
[INFO] |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.9.6:compile - omitted for conflict with 2.12.2)
[INFO] |  +- de.undercouch:bson4jackson:jar:2.9.2:compile
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.9.3:compile - omitted for conflict with 2.12.2)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.9.3:compile - omitted for conflict with 2.12.2)
[INFO] |  |  \- (com.fasterxml.jackson.core:jackson-databind:jar:2.9.3:compile - omitted for conflict with 2.12.2)
[INFO] |  +- javax.persistence:persistence-api:jar:1.0.2:compile
[INFO] |  \- commons-io:commons-io:jar:2.6:compile
[INFO] +- io.fabric8:kubernetes-client:jar:4.0.4:compile
[INFO] |  +- io.fabric8:kubernetes-model:jar:3.0.2:compile
[INFO] |  |  +- (com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.7.5:compile - omitted for conflict with 2.8.7)
[INFO] |  |  \- (javax.validation:validation-api:jar:1.1.0.Final:compile - omitted for duplicate)
[INFO] |  +- com.squareup.okhttp3:okhttp:jar:3.9.1:compile
[INFO] |  |  \- com.squareup.okio:okio:jar:1.13.0:compile
[INFO] |  +- com.squareup.okhttp3:logging-interceptor:jar:3.9.1:compile
[INFO] |  |  \- (com.squareup.okhttp3:okhttp:jar:3.9.1:compile - omitted for duplicate)
[INFO] |  +- org.slf4j:slf4j-api:jar:1.7.13:compile
[INFO] |  +- org.slf4j:jul-to-slf4j:jar:1.7.13:compile
[INFO] |  |  \- (org.slf4j:slf4j-api:jar:1.7.13:compile - omitted for duplicate)
[INFO] |  +- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.7.7:compile
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.7.7:compile - omitted for conflict with 2.12.2)
[INFO] |  |  \- org.yaml:snakeyaml:jar:1.15:compile
[INFO] |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.7.7:compile - omitted for conflict with 2.12.2)
[INFO] |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.7.7:compile - omitted for conflict with 2.12.2)
[INFO] |  +- io.fabric8:zjsonpatch:jar:0.3.0:compile
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.3.2:compile - omitted for conflict with 2.12.2)
[INFO] |  |  \- (com.fasterxml.jackson.core:jackson-core:jar:2.3.2:compile - omitted for conflict with 2.12.2)
[INFO] |  \- com.github.mifmif:generex:jar:1.0.1:compile
[INFO] |     \- dk.brics.automaton:automaton:jar:1.11-8:compile
[INFO] +- com.microsoft.azure:applicationinsights-core:jar:2.6.0:compile
[INFO] +- com.microsoft.azure:azure:jar:1.38.0:compile
[INFO] |  +- com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile
[INFO] |  |  \- com.microsoft.rest:client-runtime:jar:1.7.10:compile
[INFO] |  |     +- (com.google.guava:guava:jar:20.0:compile - omitted for duplicate)
[INFO] |  |     +- com.squareup.retrofit2:retrofit:jar:2.6.4:compile
[INFO] |  |     |  \- (com.squareup.okhttp3:okhttp:jar:3.12.0:compile - omitted for conflict with 3.9.1)
[INFO] |  |     +- (com.squareup.okhttp3:okhttp:jar:3.12.12:compile - omitted for conflict with 3.9.1)
[INFO] |  |     +- (com.squareup.okhttp3:logging-interceptor:jar:3.12.12:compile - omitted for conflict with 3.9.1)
[INFO] |  |     +- com.squareup.okhttp3:okhttp-urlconnection:jar:3.12.12:compile
[INFO] |  |     |  \- (com.squareup.okhttp3:okhttp:jar:3.12.12:compile - omitted for conflict with 3.9.1)
[INFO] |  |     +- com.squareup.retrofit2:converter-jackson:jar:2.6.4:compile
[INFO] |  |     |  +- (com.squareup.retrofit2:retrofit:jar:2.6.4:compile - omitted for duplicate)
[INFO] |  |     |  \- (com.fasterxml.jackson.core:jackson-databind:jar:2.9.8:compile - omitted for conflict with 2.12.2)
[INFO] |  |     +- (com.fasterxml.jackson.datatype:jackson-datatype-joda:jar:2.10.1:compile - omitted for conflict with 2.12.2)
[INFO] |  |     +- (org.apache.commons:commons-lang3:jar:3.4:compile - omitted for conflict with 3.5)
[INFO] |  |     +- (io.reactivex:rxjava:jar:1.3.8:compile - omitted for duplicate)
[INFO] |  |     +- com.squareup.retrofit2:adapter-rxjava:jar:2.6.4:compile
[INFO] |  |     |  +- (com.squareup.retrofit2:retrofit:jar:2.6.4:compile - omitted for duplicate)
[INFO] |  |     |  \- (io.reactivex:rxjava:jar:1.3.0:compile - omitted for conflict with 1.3.8)
[INFO] |  |     +- (org.slf4j:slf4j-api:jar:1.7.22:compile - omitted for conflict with 1.7.13)
[INFO] |  |     \- (com.microsoft.azure:azure-annotations:jar:1.10.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-client-authentication:jar:1.7.10:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (commons-codec:commons-codec:jar:1.11:compile - omitted for conflict with 1.9)
[INFO] |  |  +- com.microsoft.azure:adal4j:jar:1.6.4:compile
[INFO] |  |  |  +- (com.nimbusds:oauth2-oidc-sdk:jar:6.5:compile - omitted for conflict with 9.4)
[INFO] |  |  |  +- (com.google.code.gson:gson:jar:2.8.0:compile - omitted for conflict with 2.2.4)
[INFO] |  |  |  +- (org.slf4j:slf4j-api:jar:1.7.21:compile - omitted for conflict with 1.7.13)
[INFO] |  |  |  +- (commons-codec:commons-codec:jar:1.11:compile - omitted for duplicate)
[INFO] |  |  |  \- (org.apache.commons:commons-lang3:jar:3.5:compile - omitted for duplicate)
[INFO] |  |  \- com.microsoft.azure:azure-annotations:jar:1.10.0:compile
[INFO] |  +- com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- io.reactivex:rxjava:jar:1.3.8:compile
[INFO] |  |  +- (com.microsoft.azure:azure-annotations:jar:1.10.0:compile - omitted for duplicate)
[INFO] |  |  \- (org.apache.httpcomponents:httpcore:jar:4.4.5:compile - omitted for conflict with 4.4.4)
[INFO] |  +- com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-network:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-compute:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-network:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-msi:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-graph-rbac:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.google.code.gson:gson:jar:2.2.4:compile - omitted for conflict with 2.7)
[INFO] |  +- com.microsoft.azure:azure-mgmt-graph-rbac:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-keyvault:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-graph-rbac:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- com.microsoft.azure:azure-keyvault:jar:1.0.0:compile
[INFO] |  |     +- (com.microsoft.azure:azure-client-runtime:jar:1.0.0:compile - omitted for conflict with 1.7.10)
[INFO] |  |     \- com.microsoft.azure:azure-keyvault-webkey:jar:1.0.0:compile
[INFO] |  |        +- (com.fasterxml.jackson.core:jackson-databind:jar:2.7.2:compile - omitted for conflict with 2.12.2)
[INFO] |  |        +- (commons-codec:commons-codec:jar:1.10:compile - omitted for conflict with 1.11)
[INFO] |  |        \- (com.google.guava:guava:jar:20.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-batch:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-trafficmanager:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-dns:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-redis:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-appservice:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-msi:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-keyvault:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-dns:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- com.microsoft.azure:azure-storage:jar:6.1.0:compile
[INFO] |  |     +- (com.fasterxml.jackson.core:jackson-core:jar:2.6.0:compile - omitted for conflict with 2.12.2)
[INFO] |  |     +- (org.slf4j:slf4j-api:jar:1.7.12:compile - omitted for conflict with 1.7.13)
[INFO] |  |     +- (org.apache.commons:commons-lang3:jar:3.4:compile - omitted for conflict with 3.5)
[INFO] |  |     \- com.microsoft.azure:azure-keyvault-core:jar:0.8.0:compile
[INFO] |  |        \- (org.apache.commons:commons-lang3:jar:3.4:compile - omitted for conflict with 3.5)
[INFO] |  +- com.microsoft.azure:azure-mgmt-locks:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- javax.xml.bind:jaxb-api:jar:2.3.0:compile
[INFO] |  +- com.microsoft.azure:azure-mgmt-eventhub:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-storage:jar:6.1.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.fasterxml.jackson.core:jackson-core:jar:2.10.0.pr1:compile - omitted for conflict with 2.12.2)
[INFO] |  +- com.microsoft.azure:azure-mgmt-cdn:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-sql:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-storage:jar:6.1.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.fasterxml.jackson.core:jackson-core:jar:2.10.0.pr1:compile - omitted for conflict with 2.12.2)
[INFO] |  +- com.microsoft.azure:azure-mgmt-containerinstance:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-storage:jar:6.1.0:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.10.0.pr1:compile - omitted for conflict with 2.12.2)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-graph-rbac:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-msi:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-containerregistry:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-containerservice:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-storage:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-cosmosdb:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-search:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-msi:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-graph-rbac:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-monitor:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  +- com.microsoft.azure:azure-mgmt-servicebus:jar:1.38.0:compile
[INFO] |  |  +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |  |  +- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] |  |  \- (joda-time:joda-time:jar:2.1:compile - omitted for conflict with 2.10.8)
[INFO] |  \- com.microsoft.azure:azure-mgmt-batchai:jar:1.38.0:compile
[INFO] |     +- (com.microsoft.azure:azure-client-runtime:jar:1.7.10:compile - omitted for duplicate)
[INFO] |     \- (com.microsoft.azure:azure-mgmt-resources:jar:1.38.0:compile - omitted for duplicate)
[INFO] +- com.google.code.gson:gson:jar:2.7:compile
[INFO] +- org.apache.httpcomponents:httpmime:jar:4.5.3:compile
[INFO] |  \- (org.apache.httpcomponents:httpclient:jar:4.5.3:compile - omitted for conflict with 4.5.2)
[INFO] +- org.apache.httpcomponents:httpclient:jar:4.5.2:compile
[INFO] |  +- org.apache.httpcomponents:httpcore:jar:4.4.4:compile
[INFO] |  +- commons-logging:commons-logging:jar:1.2:compile
[INFO] |  \- commons-codec:commons-codec:jar:1.9:compile
[INFO] +- junit:junit:jar:4.12:test (scope not updated to compile)
[INFO] |  \- org.hamcrest:hamcrest-core:jar:1.3:test
[INFO] +- com.googlecode.json-simple:json-simple:jar:1.1.1:compile
[INFO] |  \- (junit:junit:jar:4.10:compile - omitted for conflict with 4.12)
[INFO] +- redis.clients:jedis:jar:3.5.1:compile
[INFO] |  +- (org.slf4j:slf4j-api:jar:1.7.30:compile - omitted for conflict with 1.7.13)
[INFO] |  \- org.apache.commons:commons-pool2:jar:2.6.2:compile
[INFO] +- com.azure:azure-messaging-servicebus:jar:7.2.0:compile
[INFO] |  +- com.azure:azure-core:jar:1.15.0:compile
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.12.2:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.12.2:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.12.2:compile - omitted for duplicate)
[INFO] |  |  +- (com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.12.2:compile - omitted for conflict with 2.8.7)
[INFO] |  |  +- com.fasterxml.jackson.dataformat:jackson-dataformat-xml:jar:2.12.2:compile
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-core:jar:2.12.2:compile - omitted for duplicate)
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-annotations:jar:2.12.2:compile - omitted for duplicate)
[INFO] |  |  |  +- (com.fasterxml.jackson.core:jackson-databind:jar:2.12.2:compile - omitted for duplicate)
[INFO] |  |  |  +- (com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.12.2:compile - omitted for conflict with 2.8.7)
[INFO] |  |  |  +- org.codehaus.woodstox:stax2-api:jar:4.2.1:compile
[INFO] |  |  |  \- com.fasterxml.woodstox:woodstox-core:jar:6.2.4:compile
[INFO] |  |  |     \- (org.codehaus.woodstox:stax2-api:jar:4.2.1:compile - omitted for duplicate)
[INFO] |  |  +- (org.slf4j:slf4j-api:jar:1.7.30:compile - omitted for conflict with 1.7.13)
[INFO] |  |  +- io.projectreactor:reactor-core:jar:3.4.3:compile
[INFO] |  |  |  \- org.reactivestreams:reactive-streams:jar:1.0.3:compile
[INFO] |  |  \- io.netty:netty-tcnative-boringssl-static:jar:2.0.36.Final:compile
[INFO] |  +- com.azure:azure-core-amqp:jar:2.0.4:compile
[INFO] |  |  +- (com.azure:azure-core:jar:1.15.0:compile - omitted for duplicate)
[INFO] |  |  +- com.microsoft.azure:qpid-proton-j-extensions:jar:1.2.3:compile
[INFO] |  |  |  +- (org.apache.qpid:proton-j:jar:0.33.4:compile - omitted for duplicate)
[INFO] |  |  |  \- (org.slf4j:slf4j-api:jar:1.7.28:compile - omitted for conflict with 1.7.13)
[INFO] |  |  \- org.apache.qpid:proton-j:jar:0.33.4:compile
[INFO] |  \- com.azure:azure-core-http-netty:jar:1.9.1:compile
[INFO] |     +- (com.azure:azure-core:jar:1.15.0:compile - omitted for duplicate)
[INFO] |     +- io.netty:netty-handler:jar:4.1.60.Final:compile
[INFO] |     |  +- io.netty:netty-common:jar:4.1.60.Final:compile
[INFO] |     |  +- io.netty:netty-resolver:jar:4.1.60.Final:compile
[INFO] |     |  |  \- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- io.netty:netty-transport:jar:4.1.60.Final:compile
[INFO] |     |  |  +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  |  \- (io.netty:netty-resolver:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  \- io.netty:netty-codec:jar:4.1.60.Final:compile
[INFO] |     |     +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |     +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |     \- (io.netty:netty-transport:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     +- io.netty:netty-handler-proxy:jar:4.1.60.Final:compile
[INFO] |     |  +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-transport:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-codec:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- io.netty:netty-codec-socks:jar:4.1.60.Final:compile
[INFO] |     |  |  +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  |  +- (io.netty:netty-transport:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  |  \- (io.netty:netty-codec:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  \- (io.netty:netty-codec-http:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     +- io.netty:netty-buffer:jar:4.1.60.Final:compile
[INFO] |     |  \- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     +- io.netty:netty-codec-http:jar:4.1.60.Final:compile
[INFO] |     |  +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-transport:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-codec:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  \- (io.netty:netty-handler:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     +- io.netty:netty-codec-http2:jar:4.1.60.Final:compile
[INFO] |     |  +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-transport:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-codec:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-handler:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  \- (io.netty:netty-codec-http:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     +- io.netty:netty-transport-native-unix-common:jar:4.1.60.Final:compile
[INFO] |     |  +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  \- (io.netty:netty-transport:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     +- io.netty:netty-transport-native-epoll:jar:linux-x86_64:4.1.60.Final:compile
[INFO] |     |  +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-transport:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  \- (io.netty:netty-transport-native-unix-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     +- io.netty:netty-transport-native-kqueue:jar:osx-x86_64:4.1.60.Final:compile
[INFO] |     |  +- (io.netty:netty-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-buffer:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  +- (io.netty:netty-transport:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     |  \- (io.netty:netty-transport-native-unix-common:jar:4.1.60.Final:compile - omitted for duplicate)
[INFO] |     \- io.projectreactor.netty:reactor-netty:jar:1.0.4:compile
[INFO] |        +- io.projectreactor.netty:reactor-netty-core:jar:1.0.4:compile
[INFO] |        |  +- (io.netty:netty-handler:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  +- (io.netty:netty-handler-proxy:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  +- io.netty:netty-resolver-dns:jar:4.1.59.Final:compile
[INFO] |        |  |  +- (io.netty:netty-common:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  +- (io.netty:netty-buffer:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  +- (io.netty:netty-resolver:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  +- (io.netty:netty-transport:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  +- (io.netty:netty-codec:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  +- io.netty:netty-codec-dns:jar:4.1.59.Final:compile
[INFO] |        |  |  |  +- (io.netty:netty-common:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  |  +- (io.netty:netty-buffer:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  |  +- (io.netty:netty-transport:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  |  \- (io.netty:netty-codec:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  \- (io.netty:netty-handler:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  +- io.netty:netty-resolver-dns-native-macos:jar:osx-x86_64:4.1.59.Final:compile
[INFO] |        |  |  +- (io.netty:netty-common:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  |  +- (io.netty:netty-resolver-dns:jar:4.1.59.Final:compile - omitted for duplicate)
[INFO] |        |  |  \- (io.netty:netty-transport-native-unix-common:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  +- (io.netty:netty-transport-native-epoll:jar:linux-x86_64:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  \- (io.projectreactor:reactor-core:jar:3.4.3:compile - omitted for duplicate)
[INFO] |        +- io.projectreactor.netty:reactor-netty-http:jar:1.0.4:compile
[INFO] |        |  +- (io.netty:netty-codec-http:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  +- (io.netty:netty-codec-http2:jar:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  +- (io.netty:netty-resolver-dns:jar:4.1.59.Final:compile - omitted for duplicate)
[INFO] |        |  +- (io.netty:netty-resolver-dns-native-macos:jar:osx-x86_64:4.1.59.Final:compile - omitted for duplicate)
[INFO] |        |  +- (io.netty:netty-transport-native-epoll:jar:linux-x86_64:4.1.59.Final:compile - omitted for conflict with 4.1.60.Final)
[INFO] |        |  +- (io.projectreactor.netty:reactor-netty-core:jar:1.0.4:compile - omitted for duplicate)
[INFO] |        |  \- (io.projectreactor:reactor-core:jar:3.4.3:compile - omitted for duplicate)
[INFO] |        \- io.projectreactor.netty:reactor-netty-http-brave:jar:1.0.4:runtime
[INFO] |           +- (io.projectreactor.netty:reactor-netty-http:jar:1.0.4:runtime - omitted for duplicate)
[INFO] |           \- io.zipkin.brave:brave-instrumentation-http:jar:5.13.3:runtime
[INFO] |              \- io.zipkin.brave:brave:jar:5.13.3:runtime
[INFO] |                 \- io.zipkin.reporter2:zipkin-reporter-brave:jar:2.16.3:runtime
[INFO] |                    \- io.zipkin.reporter2:zipkin-reporter:jar:2.16.3:runtime
[INFO] |                       \- io.zipkin.zipkin2:zipkin:jar:2.23.2:runtime
[INFO] +- com.azure:azure-security-keyvault-secrets:jar:4.2.8:compile
[INFO] |  +- (com.azure:azure-core:jar:1.16.0:compile - omitted for conflict with 1.15.0)
[INFO] |  \- (com.azure:azure-core-http-netty:jar:1.9.2:compile - omitted for conflict with 1.9.1)
[INFO] \- com.azure:azure-identity:jar:1.3.0:compile
[INFO]    +- (com.azure:azure-core:jar:1.16.0:compile - omitted for conflict with 1.15.0)
[INFO]    +- (com.azure:azure-core-http-netty:jar:1.9.2:compile - omitted for conflict with 1.9.1)
[INFO]    +- com.microsoft.azure:msal4j:jar:1.10.0:compile
[INFO]    |  +- com.nimbusds:oauth2-oidc-sdk:jar:9.4:compile
[INFO]    |  |  +- com.github.stephenc.jcip:jcip-annotations:jar:1.0-1:compile
[INFO]    |  |  +- com.nimbusds:content-type:jar:2.1:compile
[INFO]    |  |  +- net.minidev:json-smart:jar:2.4.2:compile
[INFO]    |  |  |  \- net.minidev:accessors-smart:jar:2.4.2:compile
[INFO]    |  |  |     \- org.ow2.asm:asm:jar:8.0.1:compile
[INFO]    |  |  +- com.nimbusds:lang-tag:jar:1.5:compile
[INFO]    |  |  \- com.nimbusds:nimbus-jose-jwt:jar:9.8.1:compile
[INFO]    |  |     \- (com.github.stephenc.jcip:jcip-annotations:jar:1.0-1:compile - omitted for duplicate)
[INFO]    |  +- (org.slf4j:slf4j-api:jar:1.7.28:compile - omitted for conflict with 1.7.13)
[INFO]    |  \- (com.fasterxml.jackson.core:jackson-databind:jar:2.12.1:compile - omitted for conflict with 2.12.2)
[INFO]    +- com.microsoft.azure:msal4j-persistence-extension:jar:1.1.0:compile
[INFO]    |  +- (com.microsoft.azure:msal4j:jar:1.4.0:compile - omitted for conflict with 1.10.0)
[INFO]    |  +- net.java.dev.jna:jna:jar:5.5.0:compile
[INFO]    |  +- (net.java.dev.jna:jna-platform:jar:5.5.0:compile - omitted for conflict with 5.6.0)
[INFO]    |  \- (org.slf4j:slf4j-api:jar:1.7.7:compile - omitted for conflict with 1.7.13)
[INFO]    +- net.java.dev.jna:jna-platform:jar:5.6.0:compile
[INFO]    |  \- (net.java.dev.jna:jna:jar:5.6.0:compile - omitted for conflict with 5.5.0)
[INFO]    \- org.linguafranca.pwdb:KeePassJava2:jar:2.1.4:compile
[INFO]       +- org.linguafranca.pwdb:KeePassJava2-kdb:jar:2.1.4:compile
[INFO]       |  +- org.linguafranca.pwdb:database:jar:2.1.4:compile
[INFO]       |  |  +- (org.jetbrains:annotations:jar:15.0:compile - omitted for duplicate)
[INFO]       |  |  +- (com.google.guava:guava:jar:19.0:compile - omitted for conflict with 20.0)
[INFO]       |  |  \- com.madgag.spongycastle:core:jar:1.54.0.0:compile
[INFO]       |  \- org.jetbrains:annotations:jar:15.0:compile
[INFO]       +- org.linguafranca.pwdb:KeePassJava2-dom:jar:2.1.4:compile
[INFO]       |  \- org.linguafranca.pwdb:KeePassJava2-kdbx:jar:2.1.4:compile
[INFO]       |     +- (org.linguafranca.pwdb:database:jar:2.1.4:compile - omitted for duplicate)
[INFO]       |     +- (commons-codec:commons-codec:jar:1.10:compile - omitted for conflict with 1.9)
[INFO]       |     \- (org.jetbrains:annotations:jar:15.0:compile - omitted for duplicate)
[INFO]       +- org.linguafranca.pwdb:KeePassJava2-jaxb:jar:2.1.4:compile
[INFO]       |  \- (org.linguafranca.pwdb:KeePassJava2-kdbx:jar:2.1.4:compile - omitted for duplicate)
[INFO]       \- org.linguafranca.pwdb:KeePassJava2-simple:jar:2.1.4:compile
[INFO]          +- (org.linguafranca.pwdb:KeePassJava2-kdbx:jar:2.1.4:compile - omitted for duplicate)
[INFO]          +- org.simpleframework:simple-xml:jar:2.7.1:compile
[INFO]          |  +- stax:stax-api:jar:1.0.1:compile
[INFO]          |  +- stax:stax:jar:1.2.0:compile
[INFO]          |  |  \- (stax:stax-api:jar:1.0.1:compile - omitted for duplicate)
[INFO]          |  \- xpp3:xpp3:jar:1.1.3.3:compile
[INFO]          +- (org.apache.httpcomponents:httpcore:jar:4.4.5:compile - omitted for conflict with 4.4.4)
[INFO]          \- com.fasterxml:aalto-xml:jar:1.0.0:compile
[INFO]             \- (org.codehaus.woodstox:stax2-api:jar:4.0.0:compile - omitted for conflict with 4.2.1)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  2.488 s
[INFO] Finished at: 2021-06-03T11:40:40+05:30
[INFO] ------------------------------------------------------------------------
YijunXieMS commented 3 years ago

I see a lot of conflicts. That's the reason for this error I think. But I don't know which conflict causes the error. Let's try:

  1. Use azure-messaging-servicebus 7.2.2 instead of 7.2.0. This can reduce some conflicts.
  2. Not sure if this conflict is a problem for azure-messaging-service dependency com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.12.2:compile - omitted for conflict with 2.8.7 because other fasterxml jars use 2.12.2. If step 1 doesn't solve the problem, could you use 2.12.2 explicitly in your pom? (But I don't know if this will cause other libraries to fail).
sudharsan2020 commented 3 years ago

I agree that there are conflicts, however the issue doesn't occur when I use azure-messaging-servicebus 7.1.0 and occurs only with 7.2.x versions.

sudharsan2020 commented 3 years ago

@YijunXieMS Fixed the maven conflict issue by upgrading the library to azure-messaging-servicebus 7.3.0-beta.2. Please find the updated pom.xml file used.https://pastebin.com/WGJxmxh3

Will continue to monitor the webjob over the next 2 weeks and confirm if the network issue persists. Kindly provide release notes for each version so that we know what has changed and if the library upgrade is needed. Thanks.

sudharsan2020 commented 3 years ago

@YijunXieMS The fix doesn't seem to work and we face the same network connectivity from the Azure Subscription client.The deployment was done on June 7th and the issue occured today(June 15th) within 8 days.

Because of this issue we couldn't ship a service and its impacting the business badly. Kindly do the needful.

Azure service bus client: azure-messaging-servicebus 7.3.0-beta.2 POM file used: https://pastebin.com/x4nUe3n5

YijunXieMS commented 3 years ago

Hi @sudharsan2020 I don't recommend a beta version for production use. It's usually to preview new features. Could you reach us via the support system and let's have a meeting to see what we can do to fix the pom.xml file for SB 7.2.2 or 7.2.3.

sudharsan2020 commented 3 years ago

@YijunXieMS Updated to SB 7.2.2 and will continue to monitor for a week and share the update.

YijunXieMS commented 3 years ago

@sudharsan2020 Awesome that you can upgrade to 7.2.2 (it's even better if you can use the latest version 7.2.3 since we just released). Could you give me the new POM file again? After the version upgrade, I've some questions / suggestions for your code:

  1. We have ServiceBusProcessorClient which is a higher level API than the receiver client (ServiceBusReceiverAsyncClient and ServiceBusReceiverClient). It indefinitely retry to connect in case of errors. I'm not sure if it works for your case but for your consideration.
  2. You can go ahead using your existing code but better make the following two changes. a. .Use 5s or 10s for the tryTimeout - this line retryOptions(new AmqpRetryOptions().setTryTimeout(Duration.ofSeconds(30))). Today I found a bug that may cause the complete message to be stuck if tryTimeOut is long and there is a network error. It will be fixed soon. But for now please use a shorter time. b. Also for the retryOptions. You better set a larger maxRetries just in case the network is down. By default it's 3 times. So if the network to the SB service is down for a few minutes, the client will stop retry and receiving will stop. c. return serviceBusReceiverAsyncClient.complete(message) may throw exception when the network is down, or the lock on the message expires. You may use .onErrorResume and return a Mono.emtpy() so the stream doesn't error out. The message will be returned to the queue again and be received again.

One more thing is, could you configure your logging policy to set debug level for com.azure.messaging and com.azure.core.amqp. If the problem happens again, I'll have logs to look into.

I have tests running for 7.2.3. Haven't seen receiving stop so far. Will wait for another few days. I'll also look into the code to see if there is any potential problems.

sudharsan2020 commented 3 years ago

@YijunXieMS Thanks for your suggestions. I've implemented the above recommendations and will continue to monitor.

sudharsan2020 commented 3 years ago

Please confirm if the issue has been resolved. Our production release is on hold for the last 2 months due to the AMPQ connection issue with the Azure Service Bus JDK. No response from the Microsoft team even after creating a dedicated ticket. TrackingID#2106170060003926 Really disappointed with your pathetic customer support :angry: :angry: :angry:

anuchandy commented 3 years ago

Hi Sudharsan, we're sorry for the trouble you're facing.

I'm following up with support to get the debug logs that you had shared with Yijun. We have had a reliability bug fix on the 7.3.0. I believe 7.2.3 is the last version you tried. We also found and fixed few reliability issues in the last and this week, which we're currently validating through our long-running tests (LRT). If the LRT outcome is good, we plan to release it this week or early next week.

anuchandy commented 3 years ago

Confirming that we've received logs from support.

anuchandy commented 3 years ago

Hi @sudharsan2020 - I spent some time scanning the INFO level log file. We were hoping to get a hold on DEBUG level log.

With the "limited" INFO level logs - the understanding is that not producing a "new" connection results in receiver stoppage. A potential fix for this got merged; the fix adds a timeout for child channel closure to ensure the closing of the "old" and emission of new connection. Currently, tests are executed on that fix and a few other reliability fixes.

It will help if we can get the DEBUG level info, as Yujin mentioned above - the log with DEBUG level enabled for "com.azure"

Once the bits are out, I'll update this thread; we can jump on a call if any assistance is needed with new bits; Let's have DEBUG enabled next time (if not already) to help with any future troubleshooting, consider adding a filter like this: that only logs things from "com.azure" but filtering out some of the noisy logs like from JacksonAdapter / onDelivery from ReceiveLinkHandler.

anuchandy commented 3 years ago

The new bits are released: https://search.maven.org/artifact/com.azure/azure-messaging-servicebus/7.4.0/jar .

sudharsan2020 commented 3 years ago

@anuchandy We haven't faced any connectivity exception with the Service Bus Client over the past 4 weeks and the connection looks stable. Thanks for your patience and support in resolving the issue

anuchandy commented 3 years ago

@sudharsan2020 Thanks for the update. We're targetting another release update next week, which includes a couple of reliability fixes. I just want to let you know so that you can plan to pick it for future deployments.