simonw / airtable-export

Export Airtable data to YAML, JSON or SQLite files on disk
https://datasette.io/tools/airtable-export
Apache License 2.0
112 stars 15 forks source link

feat: override read timeout via --http-read-timeout #14

Closed eliblock closed 3 years ago

eliblock commented 3 years ago

Occasionally airtable-export fails due to a timeout on read out with an error like:

Error: The read operation timed out

This occurs intermittently, particularly when interacting with a large number of records in quick succession during an export.

Allow configuration of python-httpx's read timeout as needed. In recent testing where I previously had the above error, setting a 60s timeout (default is 5s) appears to eliminate airtable-export failures.