powersync-ja / powersync-service

Other
123 stars 9 forks source link

Reduce memory usage of slot health check #94

Closed rkistner closed 1 month ago

rkistner commented 1 month ago

Fixes #86.

We use pg_logical_slot_peek_binary_changes to peak up to 1000 changes to check slot health on startup.

If the peaked changes are large, this can add significant processing and memory overhead, potentially leading to out-of-memory errors such as #86.

This changes to streaming results, as well as removing the large binary data from the results, to avoid that issue.

changeset-bot[bot] commented 1 month ago

🦋 Changeset detected

Latest commit: 6364c028b0a5dd4011214b366bbe72f2bf181184

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 3 packages | Name | Type | | ------------------------ | ----- | | @powersync/service-core | Patch | | @powersync/service-image | Patch | | test-client | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR