search

typesense / firestore-typesense-search

Firebase Extension to automatically push Firestore documents to Typesense for full-text search with typo tolerance, faceting, and more
https://extensions.dev/extensions/typesense/firestore-typesense-search
Apache License 2.0
152 stars 27 forks source link

Backfill is crashing #82

Open rohan-mehta opened 3 weeks ago

rohan-mehta commented 3 weeks ago

Description

I have a large-ish firebase collection (hundreds of thousands of docs) that I'm trying to sync to typesense. When I start the backfill, I see:

Memory limit of 2048 MiB exceeded with 2054 MiB used. Consider increasing the memory limit, see https://cloud.google.com/functions/docs/configuring/memory

How do I fix this?

Metadata

Typesense Version: 26

OS: typesense cloud

rohan-mehta commented 3 weeks ago

Based on some closed issues — seems like the extension tries to load the entire collection into memory instead of paginating?