search

springml / spark-salesforce

Spark data source for Salesforce
Apache License 2.0
79 stars 67 forks source link

QueryAll option is not working #48

Open sindhujadhamodaran opened 4 years ago

sindhujadhamodaran commented 4 years ago

Hi,

I am unable to get all the records(including the deleted records) using the QueryAll option. Below is my code snippet used in databricks. This fetches only the records which are not deleted or archived. I am using com.springml:spark-salesforce_2.11:1.1.3 from Maven.

val Case_soql_df = spark. read. format("com.springml.spark.salesforce"). option("login","https://login.salesforce.com/services/Soap/u/37.0/"). option("username","" ). option("password","" ). option("soql", Case_soql). option("version","37"). option("queryAll", "true"). load()

aspektr commented 3 years ago

You have to build your own jar, because 'queryAll' param to control retrieving deleted and archived records for SOQL queries was added 28/03/2019 and maven jar from 25/07/2018

VishalPra commented 1 year ago

Hello All / @aspektr / @sindhujadhamodaran ,

Need URGENT help on this.

Please help if someone able to resolve this fetching of soft deletes records.

We have replaced dependencies from salesforce-wave-api-1.0.9.jar to salesforce-wave-api-1.0.10.jar (https://mvnrepository.com/artifact/com.springml/salesforce-wave-api/1.0.10).

and added below to pom.xml:

com.springml salesforce-wave-api 1.0.10

and updated the code to below: sfDF = sparkSession. read(). format("com.springml.spark.salesforce"). option("header", "true"). option("username", inputParameters.get("salesforce_username")). option("password", inputParameters.get("salesforce_password")). option("soql", query). option("queryAll", true). options(options). load();