Open pm5 opened 4 years ago
@pm5 looks like some of our dcard snapshots disappeared....
From the record of Article table, the last successful update is at Feb 28 13:51 TW time (unix time 1582869089
)
sql command : SELECT * from Article WHERE next_snapshot_at != 0 AND snapshot_count != 1 ORDER BY last_snapshot_at DESC LIMIT 1
I think we have to do a full review to see what happened and how many snapshots are lost.....
Note: we have backup up to 2/17. Working on data recovery 2/17-2/28
Found an error in cronjob logs:
Looks like a problem getting the lastest floor of Dcard comments. This happens during the creation of spiders so an uncaught exception here will abort updates for all sites.