search

Deer-Spangle / faexport

The API for Furaffinity you wish existed
https://faexport.spangle.org.uk
BSD 3-Clause "New" or "Revised" License
67 stars 11 forks source link

Artist and title #9

Closed animalillo closed 8 years ago

animalillo commented 8 years ago

Somehow now every artist and every title happens to be "click here"

fortinj1354 commented 8 years ago

The FA devs are super pissy that Furry Network has an auto importer, so this is probably them trying to stop people from scraping data.

Edit- it looks like the click here is from the administrator notice <td align="left" valign="top"> '<h4>Administrator notice:</h4> 'Due to the recent attack we have reset all user passwords. For information on resetting your password '<a href='http://www.furaffinity.net/journal/7586494'><u><b>click here</b></u></a><br/> (Updated: '5/25/2016). </td>

animalillo commented 8 years ago

@fortinj1354 i know, fa is being annoying lately. taking bad approaches as they usually do for stuff that has better and less annoying solutions. But anyway! that's what we've got! Also, furry network is slow as.... something, dunno, but too slow xD

fortinj1354 commented 8 years ago

Yeah they have been having a massive influx of users and are having trouble keeping up :p

fortinj1354 commented 8 years ago

So my hunch was right, it did have to do with the admin notice at the top of the page. Now that it's gone, everything works correctly again.

boothale commented 8 years ago

Sorry for not responding earlier, was busy dealing with a crazy weekend.

A lot of what the scraper goes off of is element counts within the page. Unfortunately this breaks when notices and other stuff is added. If it happens again I'll update the rules to be more robust.