long2ice / meilisync

Realtime sync data from MySQL/PostgreSQL/MongoDB to Meilisearch
https://github.com/long2ice/meilisync
Apache License 2.0
250 stars 37 forks source link

Switch to add_documents_in_batches #1

Closed sanders41 closed 1 year ago

sanders41 commented 1 year ago

meilisearch_python_async has an add_documents_in_batches method that takes advantage of Python's asyncio.gather functionality and should improve performance with adding batches. This PR switches from add_documents to add_documents_in_batches to take advantage of that.

long2ice commented 1 year ago

Thanks!