search

veda-consulting-company / uk.co.vedaconsulting.mailchimp

Other
22 stars 43 forks source link

Performance Slow With Large Lists #304

Closed tylershuster closed 3 years ago

tylershuster commented 6 years ago

I have some very large lists that cause this extension to reach the PHP and MySQL timeouts when the script runs. I cannot increase these limits. Do you have any suggestions for making this more efficient, possibly by breaking the sync up into subtasks by offset?

ericfg commented 6 years ago

I'm looking into using this extension on a couple relatively large but not huge sites. Can you give me any details on what size your lists are and what the setting/limits are you are running up against? I'd appreciate it. Sorry I don't have any answer for you about how to batch process the sync process.

tylershuster commented 5 years ago

We have about 120,000 emails. The limit is just a server timeout limit. The code has some bottlenecks. In some places it processes batches of these 120,000, but in a few critical places it deigns to load all addresses in memory and this consistently fails.

tylershuster commented 3 years ago

Closing due to inactivity. This client needs to migrate CMSs anyway.