search

lairdshaw / fups

FUPS: Forum user-post scraper
GNU Affero General Public License v3.0
21 stars 9 forks source link

CXenForo.php on line 289 #6

Closed superthin closed 5 years ago

superthin commented 5 years ago

When I scrap a XenForo board, this is error: Selection_002

lairdshaw commented 5 years ago

Fixed in commit 469b5c489939723a633fb22711625d5d24f32f1a. This forum adds in a <span> that I hadn't seen before and hadn't accounted for. Not sure whether it's part of a custom skin or configurable in core XenForo code, but I added support for it anyway. Also added support for stripping the Vietnamese word "lúc" out of date-times before trying to parse them.

By the way, I notice that in your settings you'd set Forum IDs to 358 - this is probably a bad idea as it will cause FUPS to try to scrape that entire forum (in addition to scraping the posts of the user with the ID that you entered), and that forum seems to have tens of thousands of posts in it...