When executing the code from branch 3.0 in Databricks runtime 8.0 (libraries included here) getting the following error:
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 11.0 failed 4 times, most recent failure: Lost task 0.3 in stage 11.0 (TID 43) (10.139.64.4 executor 0): java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at com.microsoft.azure.cosmosdb.internal.directconnectivity.RntbdTransportClient$Options$Builder.requestTimeout(RntbdTransportClient.java:583) at com.microsoft.azure.cosmosdb.internal.directconnectivity.RntbdTransportClient$Options$Builder.<init>(RntbdTransportClient.java:483) at com.microsoft.azure.cosmosdb.internal.directconnectivity.RntbdTransportClient$Options$Builder.<init>(RntbdTransportClient.java:501) at com.microsoft.azure.cosmosdb.internal.directconnectivity.RntbdTransportClient.<init>(RntbdTransportClient.java:96) at com.microsoft.azure.cosmosdb.internal.directconnectivity.StoreClientFactory.<init>(StoreClientFactory.java:57) at com.microsoft.azure.cosmosdb.rx.internal.RxDocumentClientImpl.initializeDirectConnectivity(RxDocumentClientImpl.java:335) at com.microsoft.azure.cosmosdb.rx.internal.RxDocumentClientImpl.init(RxDocumentClientImpl.java:327) at com.microsoft.azure.cosmosdb.rx.AsyncDocumentClient$Builder.build(AsyncDocumentClient.java:231) at com.microsoft.azure.cosmosdb.spark.AsyncCosmosDBConnection$.createClient(AsyncCosmosDBConnection.scala:126) at com.microsoft.azure.cosmosdb.spark.AsyncCosmosDBConnection$$anon$1.apply(AsyncCosmosDBConnection.scala:52) at com.microsoft.azure.cosmosdb.spark.AsyncCosmosDBConnection$$anon$1.apply(AsyncCosmosDBConnection.scala:51) at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) at com.microsoft.azure.cosmosdb.spark.AsyncCosmosDBConnection$.getClient(AsyncCosmosDBConnection.scala:115)
snippet for reference:
cosmos_data.writeStream.outputMode("Update").format("com.microsoft.azure.cosmosdb.spark.streaming.CosmosDBSinkProvider").option("checkpointLocation", "/delta/events/_checkpoints/process-automatic-feeders-test").options(**writeConfig).start()
When executing the code from branch 3.0 in Databricks runtime 8.0 (libraries included here) getting the following error:
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 11.0 failed 4 times, most recent failure: Lost task 0.3 in stage 11.0 (TID 43) (10.139.64.4 executor 0): java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at com.microsoft.azure.cosmosdb.internal.directconnectivity.RntbdTransportClient$Options$Builder.requestTimeout(RntbdTransportClient.java:583) at com.microsoft.azure.cosmosdb.internal.directconnectivity.RntbdTransportClient$Options$Builder.<init>(RntbdTransportClient.java:483) at com.microsoft.azure.cosmosdb.internal.directconnectivity.RntbdTransportClient$Options$Builder.<init>(RntbdTransportClient.java:501) at com.microsoft.azure.cosmosdb.internal.directconnectivity.RntbdTransportClient.<init>(RntbdTransportClient.java:96) at com.microsoft.azure.cosmosdb.internal.directconnectivity.StoreClientFactory.<init>(StoreClientFactory.java:57) at com.microsoft.azure.cosmosdb.rx.internal.RxDocumentClientImpl.initializeDirectConnectivity(RxDocumentClientImpl.java:335) at com.microsoft.azure.cosmosdb.rx.internal.RxDocumentClientImpl.init(RxDocumentClientImpl.java:327) at com.microsoft.azure.cosmosdb.rx.AsyncDocumentClient$Builder.build(AsyncDocumentClient.java:231) at com.microsoft.azure.cosmosdb.spark.AsyncCosmosDBConnection$.createClient(AsyncCosmosDBConnection.scala:126) at com.microsoft.azure.cosmosdb.spark.AsyncCosmosDBConnection$$anon$1.apply(AsyncCosmosDBConnection.scala:52) at com.microsoft.azure.cosmosdb.spark.AsyncCosmosDBConnection$$anon$1.apply(AsyncCosmosDBConnection.scala:51) at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) at com.microsoft.azure.cosmosdb.spark.AsyncCosmosDBConnection$.getClient(AsyncCosmosDBConnection.scala:115)snippet for reference:
cosmos_data.writeStream.outputMode("Update").format("com.microsoft.azure.cosmosdb.spark.streaming.CosmosDBSinkProvider").option("checkpointLocation", "/delta/events/_checkpoints/process-automatic-feeders-test").options(**writeConfig).start()