bbepis / Hayden

Ultra-low resource 4chan/altchan thread and board archiver
MIT License
62 stars 7 forks source link

Minimum post age for scraper #15

Open b3lrog opened 6 months ago

b3lrog commented 6 months ago

A feature I'd like is a configurable minimum age threshold that posts have to surpass before being archived. Setting this to something like 6 hours would essentially remove the need to manually moderate an archive since it gives jannies enough time to delete illegal content before it's archived.

bbepis commented 6 months ago

So there's going to be two parts to this:

First part should be really easy, second part would be pretty hard. It's possible to just make the first part but it's possible for posts to slip through the gaps. Depends on how much you care

b3lrog commented 6 months ago

Yeah, I realised this when I took a look at implementing it myself. Having it only apply to threads would be easy to implement and wouldn't miss any posts but has the obvious downside of still archiving replies immediately.