Ornias1993 / fetlife-aslsearch-reborn

Tampermonkey user script offering an interface to perform pseudo-automatic searches of the FetLife.com user base filtered by age, sex, location, and role.
6 stars 2 forks source link

Full scrape of profile details #67

Open Ornias1993 opened 4 years ago

Ornias1993 commented 4 years ago

Description

According to multiple complaints, scraping userdata is taking WAY too long. 0.6 will improve part of this problem, but we also need a complete scrape of all user profiles.

Category

TODO

Detailed Bug Report

This scraper needs to get writen and executed. Afterwards we need to continue scraping the latest users. Luckily Fetlife f'ed up by using itterative userID's.

This feature would need to be implemented Server Side, to prevent DDOS like scenario's on the API/SQL-server