Retrieving Large data-volumes (1M+)

hiratake55 / RForcecom

RForcecom provides the connection to Force.com and Salesforce.com from R

http://cran.r-project.org/web/packages/RForcecom/index.html

Other

49 stars 25 forks source link

Retrieving Large data-volumes (1M+) #13

Open StanislavBG opened 9 years ago

StanislavBG commented 9 years ago

Hello,

I've been using the "query()", function so far to retrieve anywhere up to 50k records. I have a Salesforce Org with much more data, several millions and wonder how can I leverage "queryMore" correctly.

I receive the following error when trying to use it. Thanks for the help

Error in rforcecom.queryMore(session, nextRecordsUrl) : INVALID_QUERY_LOCATOR: invalid query locator

StevenMMortimer commented 9 years ago

@StanislavBG I would recommend using the Bulk API for larger tasks. I have forked the current package and added Bulk API functionality if you'd like install and try out. Although some query operations aren't supported by the Bulk API as noted in its documentation: (https://resources.docs.salesforce.com/sfdc/pdf/api_asynch.pdf)

# install commands
library(devtools)
install_github('ReportMort/RForcecom/RForcecom', ref='feature/bulk-api')
library(RForcecom)