mikwielgus / forum-dl

Scrape posts, threads from forums, news aggregators, mail archives, export to JSONL, mailbox, WARC
MIT License
68 stars 2 forks source link

TypeError: memoryview: a bytes-like object is required, not NoneType #9

Open peterjschroeder opened 1 year ago

peterjschroeder commented 1 year ago

Newer versions bomb out with this error on:

forum-dl -f mbox -o "The Piazza - Classic D&D.mbox" "https://www.thepiazza.org.uk/bb/viewforum.php?f=59"

Seems to be triggered by file links that 404.

I would try a wayback link of the file, than if that fails just drop a warning, insert the dead link, and continue.

mikwielgus commented 1 year ago

Just wanted to note that it will take some time before I fix this bug, as I'm currently strongly focused on another project.