frictionlessdata / goodtables.io

Data validation as a service. Project retired, got to the current one at frictionsless/repository
https://goodtables.io
GNU Affero General Public License v3.0
69 stars 16 forks source link

Make the system self-recoverable after connection errors #319

Closed roll closed 6 years ago

roll commented 6 years ago

We solve here various issues:

All these steps applied should guarantee eventual integrity for the system.

roll commented 6 years ago

@amercader Please review

roll commented 6 years ago

@amercader Thanks!

I agree - it should not be a problem while we have only 1 or 2 simple requests there (and anyway inside the already errored session).

roll commented 6 years ago

Probably having regular clean-up jobs could be a better solution. But current should work for now.