praekeltfoundation / casepro

Case management dashboard for RapidPro
BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

Sync identities one page at a time #186

Closed rudigiesler closed 7 years ago

rudigiesler commented 7 years ago

Currently, we're pulling all the identities that need to be synced into memory, and then we are processing them.

This causes issues with memory usage, which can cause the sync task to be killed halfway through.

This PR aims to resolve this by only processing one page of results at a time.