search

sfcpc / housing-dashboard

4 stars 0 forks source link

Fix freshness #72

Closed thelee closed 4 years ago

thelee commented 4 years ago

Not ideal for mohcd, but may have to suffice.

thelee commented 4 years ago

context: mohcd uses a lot of spculative-in-the-future dates, even for date fields taht don't really seem like they are suppossed to be for in-the-future dates, so our data freshness is tweaked just so that for mohcd we use the schema-less last_updated value instead (which is going to overstate the freshness for our initial set of tables, until mohcd data is uploaded and pulled again).

thelee commented 4 years ago

lgtm, but I"m curious about the future dates you were seeing. Were they being shown for all the dates? (because some of those dates are just supposed to be pulled from PTS?)

i was getting some future dates out of "date_issuance_of_notice_to_proceed"