open-contracting / kingfisher-collect

Downloads OCDS data and stores it on disk
https://kingfisher-collect.readthedocs.io
BSD 3-Clause "New" or "Revised" License
13 stars 12 forks source link

Use git commit sha as version sent to Scrapyd #802

Open jpmckinney opened 3 years ago

jpmckinney commented 3 years ago

See https://github.com/scrapy/scrapyd-client#versioning

This means (if we have a use case) that we can send to Kingfisher Process the code version, to know which version of a spider was run (for troubleshooting) (was #411). If this isn't accessible as the SCRAPY_EGG_VERSION environment variable, then we might be able to determine the latest egg.

yolile commented 2 years ago

Blocked until https://github.com/scrapy/scrapyd/issues/212 is resolved