Open 0xkash opened 1 year ago
Two options for this:
Maybe just adding a scraped_date_start
and scraped_date_completed
column to see when the scraper has run.
A new table tasks
where the PK is the task uuid
. This can also store more then just the dates but also failure response and success response
When a scraper is set in the task queue I want to track the progress and see when its run. Now only the
status
in theScraper
object is available, however this does not give enough information about when its run or even if the ran task had any troubles.