search

willhlaw / node-firestore-backup-restore

Google Firebase Firestore backup and restore tool
91 stars 24 forks source link

Slow? #33

Open compojoom opened 6 years ago

compojoom commented 6 years ago

I'm just wondering if I'm doing something wrong. I'm trying to backup a database with around 100k items. The backup is already taking 60mins and we are not even half way through?

I see that https://github.com/steadyequipment/node-firestore-backup has an -L option to enable several requests to be made in parallel, but we don't seem to have this in this package?

-L, --requestCountLimit - The maximum number of requests to be made in parallel.

willhlaw commented 6 years ago

@compojoom, this library does not yet have the parallel option. This project was forked from steadyequipment before they added the feature. Feature parity has since diverted enough to where it is tough to keep in sync.

If you are interested, you can follow a similar pattern to saving to disk as this PR (which is still in review): https://github.com/willhlaw/node-firestore-backup-restore/pull/20.

Have others had luck with backing up ~100k items?

priyankinfinnov commented 6 years ago

+1