search

stripe-archive / mosql

MongoDB → PostgreSQL streaming replication
MIT License
1.63k stars 225 forks source link

Feature/fix cursor timeout #106

Open taxilian opened 8 years ago

taxilian commented 8 years ago

This is a weird one; we have a collection with 51 million records that we need to mirror to postgres and we kept hitting the CURSOR_NOT_FOUND exception. As recommended on https://github.com/mongodb/mongo-ruby-driver/wiki/FAQ#i-keep-getting-cursor_not_found-exceptions-whats-happening I tried adding the :timeout => false parameter, which did not change anything. However, once I additionally removed the "with_retries" around it everything works. I don't know why that would break it, I'm not much of a ruby guy, but it doesn't seem to be doing anything near as important as getting all entries in a large collection, so unless you have a suggestion for another way to fix this I suggest this fix.

CLAassistant commented 4 years ago

CLA assistant check
All committers have signed the CLA.