Rjm/robustify port jobs a little

socrata / datasync

Desktop / Console application for updating Socrata datasets automatically.

http://socrata.github.io/datasync/

MIT License

79 stars 33 forks source link

Rjm/robustify port jobs a little #166

Closed rjmac closed 7 years ago

chrismetcalf commented 7 years ago

@rjmac How robustly have we robustified? In other words, can I trust port on my 3M+ row ODN datasets now?

rjmac commented 7 years ago

@chrismetcalf If it encounters an error on either the extract or upsert portions, it retries a few times. As long as your network connection is only intermittently bad and/or you don't get unlucky with a core server restart... maybe? Try it and see.