LibreCat / Catmandu-DBI

A Catmandu::Store plugin for DBI based interfaces
Other
0 stars 1 forks source link

huge memory usage for method each when using DBD::Pg #21

Closed nicolasfranck closed 6 years ago

nicolasfranck commented 6 years ago

cf. http://search.cpan.org/~turnstep/DBD-Pg-3.7.0/Pg.pm#Cursors

Apparently DBD::Pg does not use postgres cursors, but simply copies ALL records into the user memory space, leading to a huge memory usage.

nicolasfranck commented 6 years ago

And DBD::mysql has the same problem..

Better to revert commit: https://github.com/LibreCat/Catmandu-DBI/commit/619bec3131738e8fc242d8ce67e20dfa9b8b4046

See pull request: https://github.com/LibreCat/Catmandu-DBI/pull/22