Closed smnorris closed 2 weeks ago
For downloads, consider using https://github.com/openaddresses/batch-machine (and modifying source config to support this). This presumably would ensure support for most download file/protocol types and typical source data organization quirks.
Worth noting that batch-machine detects changes to a dataset - https://github.com/openaddresses/batch-machine/blob/master/openaddr/cache.py#L83
For downloads, consider using https://github.com/openaddresses/batch-machine (and modifying source config to support this). This presumably would ensure support for most download file/protocol types and typical source data organization quirks.
Worth noting that batch-machine detects changes to a dataset - https://github.com/openaddresses/batch-machine/blob/master/openaddr/cache.py#L83