search

shelfio / dynamodb-parallel-scan

Scan large DynamoDB tables faster with parallelism
MIT License
71 stars 10 forks source link

Instantiate dynamo clients once per call #245

Closed jakedaleweb closed 10 months ago

jakedaleweb commented 11 months ago

By instantiating the each time scan is called unnecessary overheads are used in terms of memory and open files.

In my case this was causing too many files open in AWS lambda.

By ensuring the client is only instantiated once each time I call this library the issue with too many files open was resolved.

jakedaleweb commented 10 months ago

@mpushkin 🙏

vladholubiev commented 10 months ago

published in 3.6.0! thanks!

jakedaleweb commented 10 months ago

Thank you!