Export large data from tl_cookie_log

oveleon / contao-cookiebar

Cookie bar for the Contao Open Source CMS

GNU Affero General Public License v3.0

58 stars 24 forks source link

Export large data from tl_cookie_log #194

Closed akroii closed 5 months ago

akroii commented 6 months ago

Hi, currently we have >90MB of data inside tl_cookie_log. Memory_limit is set to 2048MB

It is not possible to export all data without getting the csv file with this message inside:

oveleon/contao-cookiebar Version 1.14.1 contao/manager-bundle Version 4.9.33 (i know, currently its not possible to upgrade :/ )

zoglo commented 6 months ago

@akroii The consent-log was deactivated in a previous version. If you have like > 90 MB of data, this seems to be like ~300.000 rows.

The whole export needs to be rewritten to be more performant. You could gladly finance this if you want this in the 1.x Version

zoglo commented 5 months ago

@akroii feel free to reopen this if it's important to you- the log has been disabled a while ago and rewriting this would take at least 3-4+ hrs of work.