SAP / node-rfc

Asynchronous, non-blocking SAP NW RFC SDK bindings for Node.js
Apache License 2.0
252 stars 74 forks source link

Chunking in noderfc #142

Open smfaizalkhan opened 4 years ago

smfaizalkhan commented 4 years ago

@bsrdjan Thanks for the library,As part of our project we were initally using SAPJCO3 jar to fetch data from ABAP,but as the data size is high,JVM gives OutOfMemoryException and we noticed that there was not Chunking options in JCO ,we tried for an alternative .We found this librar,would like to know the chunking available in noderfc?

Saw the below issues [https://stackoverflow.com/questions/49691298/chunking-big-datasets-in-pyrfc-possible/51862805#51862805](chunking in PyRcc) Memory Consumption reduced to Half

If chunking isnot possible and need to do mutiple calls ,to same function,is there an internal counter that next request should fetch the next subset (say next 1000 rows) and not the already read rows in ABAP ?

Regards, Faizal

bsrdjan commented 4 years ago

Could you please share an example how the application loop would look like, if the feature would be provided?

Even better, how it looks now and how it would be simplified with this feature provided?

bsrdjan commented 4 years ago

Similar scenario discussed in node-rfc/#172.

Does any of solutions described there looks good for your application?