Exclude individual post pages ("&d=XXXX...") - Githubissues

ArchiveTeam / imdb-grab

Archiving IMDb.

The Unlicense

4 stars 1 forks source link

Exclude individual post pages ("&d=XXXX...") #3

Closed xv-vx closed 7 years ago

xv-vx commented 7 years ago

Are post permalinks (I guess they're not so permanent now) really needed, i.e. isn't that content already in the threads? May save scraping time to just get the threads. WARNING: This is the first Lua code I've ever written and it's untested

Arkiver2 commented 7 years ago

Fixed with 9dc9086dde99ed811bbbfbe16cbf31d469ba6810