We can probably just use new progressClass... then serialize it, just like how we did in FINISH message. Most of the progress data should be available, not null, since each round the scraper is updating them. So should be safe to access them.
But indeed, if the exception occurs before getting into scrape review task, they might become null.
We can probably just use
new progressClass...then serialize it, just like how we did in FINISH message. Most of the progress data should be available, not null, since each round the scraper is updating them. So should be safe to access them.But indeed, if the exception occurs before getting into scrape review task, they might become null.