customink / activerecord-aurora-serverless-adapter

ActiveRecord Adapter for Amazon Aurora Serverless
https://technology.customink.com/blog/2020/01/03/migrate-your-rails-app-from-heroku-to-aws-lambda/
MIT License
66 stars 7 forks source link

Auto pageinate requests #36

Open davidplappert opened 2 years ago

davidplappert commented 2 years ago

As our dataset grows, we continue to get this error: ActiveRecord::StatementInvalid (Database returned more than the allowed response size limit)

As I understand, AWS has a limit of 1MB per return.

Using order & limit, it would be nice to turn on a config flag to auto grab all the records, and not have to manually write the method each time to loop.