Bulk upsert jobs to Salesforce failing with exit code 5

[daissatou2]

Describe the bug

Hildah reported that the bulk upsert jobs that were developed last week are failing with an exit code 5. Find the failed runs below.

To Reproduce

1. Here is a link to a failed run on OpenFn.org which is indicative of the bug:

• WF1-2. Bulk upsert HHs and HH Visits
• WF2-2. Bulk get Person casesBulk upsert Persons
• WF4-2. Bulk upsert Services

expression.js

Link to the job itself in Github:

• https://github.com/OpenFn/lwala/blob/bulk-testing/commcare-salesforce-jobs/upsert_household_and_household_visit.js
• https://github.com/OpenFn/lwala/blob/bulk-testing/commcare-salesforce-jobs/Upsert-Person-Case-Update.js
• https://github.com/OpenFn/lwala/blob/bulk-testing/commcare-salesforce-jobs/Referrals-Upsert-Service_V2.js

state.json

Parent job

{
 "configuration": { "SEE LP OpenFn CommCareHQ (Lwala) - PROD"}, 
"data": {"NA"}
"cursor": {"dynamic OR manual cursor 2023-01-01T00:00:00"}
}

Flow job

{
 "configuration": {"SEE LP Lwala Salesforce Sandbox (Bulk 2023)"}, 
"data": {"data generated by parent jobs"}
}

Expected behavior

These jobs should upsert the CommCare case data to Salesforce.

To test/resolve

1. After the desired output is working locally (from the CLI), please [push commits to master || open a pull request].
2. [Please test the change on OpenFn.org by re-running the parent runs of the run links above and confirming success.]

Toggl

Lwala Bulk Workflows [2023]

[daissatou2]

@aleksa-krolls please confirm the Lwala CommCare cred name before assigning to Mtuchi and Taylor.

[aleksa-krolls]

Issue caused by flow Job 2 exceed job state limit of 10MB because too much data was extracted in Job 1. Marking as closed for now.