search

simonw / ca-fires-history

Tracking fire data from www.fire.ca.gov
201 stars 48 forks source link

Exclude AllYearIncidents.UpdatedDate #3

Closed blitmap closed 1 year ago

blitmap commented 1 year ago

Hello,

Regularly the only change in the .json is the AllYearIncidents.UpdatedDate. When I forked this project for another purpose, I was seeing thousands of commits for a similar "rundate" member on the JSON I was watching for changes. Looks like you can have jq remove/exclude that member: | jq 'del(.AllYearIncidents.UpdatedDate)' ... in scrape.yml

I thought I'd pass it along if that's useful to you :-)

Cheers ~

simonw commented 1 year ago

Obsolete now, thanks to https://github.com/simonw/ca-fires-history/issues/5