search

Ornias1993 / fetlife-aslsearch-reborn

Tampermonkey user script offering an interface to perform pseudo-automatic searches of the FetLife.com user base filtered by age, sex, location, and role.
6 stars 2 forks source link

Avatars on homepage are not getting scraped #49

Open Ornias1993 opened 5 years ago

Ornias1993 commented 5 years ago

Description

Currently avatars on discussions and profiles (wallposts, friendlists etc) get scraped. Avatars on personal homepages do not

Category

BUG/TODO

Detailed Bug Report

The way those are setup is pretty close, except those on the homepage are inside a table and for some reason jquery is throwingup trying to process the same content inside a table.

It would be nice to scrape those, MOAR data.

Steps to Reproduce

Please enter the steps to reproduce the bug or behaviour:

  1. Turnon debug
  2. Test scraping a profile page
  3. Test scraping you personal homepage.
Ornias1993 commented 5 years ago

However, this might also lead to to many duplicate requests, as people open it frequently and it also contains duplicate users a lot. I will put it on hold and 0.7 for now, maybe together with the new backend we can try filtering out and limiting post requests.

Ornias1993 commented 5 years ago

I seem to gave issues clicking the right button