The autofetch feature on the salesforce query sort of works but also not really.
This PR #478 introduced a few regressions:
Referneces is nested, so you have to do [0][0]
The adaptor pushes responses into references, not recerds, So the data isn't really even accurate
Basically autofetch needs to push the RECORDS into a single flat results array
Not to mention that the code is a bit quirky, to say the least.
I'd also ask whether callback should be triggered per batch, or at the end result. I think that when you're talking about a batch processing API it make sense to chunkup the callback or else you're likely to hit a problem downstream. Maybe this is an option. This is something that comes up on many APIs so I'd want to think carefully about what we do here.
The autofetch feature on the salesforce query sort of works but also not really.
This PR #478 introduced a few regressions:
[0][0]
Basically autofetch needs to push the RECORDS into a single flat results array
Not to mention that the code is a bit quirky, to say the least.
I'd also ask whether callback should be triggered per batch, or at the end result. I think that when you're talking about a batch processing API it make sense to chunkup the callback or else you're likely to hit a problem downstream. Maybe this is an option. This is something that comes up on many APIs so I'd want to think carefully about what we do here.