search

mikwielgus / forum-dl

Scrape posts, threads from forums, news aggregators, mail archives, export to JSONL, mailbox, WARC
MIT License
68 stars 2 forks source link

Errors in identifying extractor #13

Open oderyn opened 1 year ago

oderyn commented 1 year ago

I've run into a couple of cases where forum-dl can't identify the type of forum. What if we could specify an extractor as an option when running forum-dl?

mikwielgus commented 1 year ago

If Forum-dl can't identify the type of forum, then it's unlikely to be able to extract it anyway. But it makes sense to give the user this option notwithstanding.